Sue, I agree Bali is super easy, but Alor is beautiful and well worth visiting. From Denpasar, we take an early morning flight Kupang with a connecting flight to Alor. Pickup at the airport and 45 min drive to a speed boat that takes us to Pantar Island. You arrive at about 2pm. There are other resorts that have easier access, but we love diving from Pantar Island. The resort provides two dives per day, either two in the morning or one in the morning and another in the afternoon. You will have lots of time at the resort with your group. Non- diving guests can lay around on the beach, walk to little villages on either side of the resort, swim in the morning, and snorkel. You will not see any other bubbles, except from you small group.
Perhaps a good compromise - a week in Bali and a week in Alor.