The cave actually has an altar for preaching inside. A fun place to explore and there is a beach nearby.
More information on the official tourist website http://www.bahamas.com/vendor/preachers-cave
Address Bahamas
Coordinates 25°33'28.804" N -76°41'45.434" E