We greatly enjoyed our time at the Bay Inn in Rolleville. It's on a great beach that's almost completely empty. There is a small coral reef not far from the shore, that's just covered with a huge number of fish (and one invasive Lionfish). You can take kayaks out to explore the area nearby. There is a restaurant/bar next door (Shoreline) also looking out at the beach. There are even some swimming pigs on an island nearby. It's hard to beat the location.
Our room was extremely large, and had a balcony looking out at palm trees and the ocean. Betty and Margaret are great hosts. They cooked dinner for us one night.
The are some things that might be negatives for some people. It is a family-run resort, in a Rolleville Commonage area. This means some of their relatives are staying in other rooms in the building, and some are rented to tourists. The relatives have dogs and kids running around. We found everyone really friendly, but don't go expecting a gated resort with nothing but tourists, that's not what this place is. Our room had a fridge/freezer, hot plate, microwave and toaster, but it wasn't a full kitchen. Very minimal cooking supplies, but you could make do. No kitchen sink, so washing up is difficult.
However they have plans to add a restaurant on site, add more units next door, and perhaps add full kitchens to each unit. So I think with their fantastic location, their plans for expansion will make it even better.
I think it could use a better name, Bay Inn is too generic. Maybe "Rolleville Beach Resort" or something more descriptive of the area.