I stayed at Turtle Cove Inn for $79 a night. The place is old and could use some sprucing up but it was clean.
I would stay there again.
It was 10 minutes walk from a great beach and had a few decent restaurants within a 2 minute walk.
It is the cheapest lodging on the island.