We went this past (2013) summer and can recommend two campgrounds. These are right on the water the first is Old Shipyard Beach Campground.
Old Shipyard Beach Campground
Right on Bay of Fundy.
The other is King Neptune Campground. Close to Peggy's Cove Lighthouse. Again, you can get a site right on the water and watch beautiful sunsets. Full hookup. We never used the bath house so can not comment but loved our site.
There is obviously a lot more to see in NS but these are the two places we stayed. I'm sure others can add to this. It is beautiful no matter where you go.
__________________
2016 Siverback 33IK, Towed 50K+ mile
2018 Ford F-350 Lariat 6.7L V8 Diesel 4WD Crew Cab
"If you don't know where you are going, any road will get you there."