I say its worth it to go to the pool. Shortly after your arrival the cruise will be returning and the pool usually picks up for a little bit with all the drunken crazies coming off the boat.
Also a great time to become part of the welcoming back party that is held on a retaining wall. People gather there to welcome back the cruise ~4.