Parking and launch access are free. There can be a good deal of boat traffic on the river, especially ferries, but if you are careful, you can paddle around the Statue of Liberty and Ellis Island. The museum in the old railroad/ferry terminal is another point of interest.
More: Liberty State Park (Jersey City) ...
More of a pond than a lake, only about half a mile long, but accessible in Thompson Park. Never actually been there. Nearby Swimming River Reservoir is completely off-limits, even to the people that live on it!
More: Marlu Lake (Tinton Falls) ...
Mercer Lake is actually a big gravel pit that was dug out for highway fill. In 1975, someone got the bright idea of damming it off, and it turned into one of the nicest lakes in the state. The lake fills from a creek to the east, and the water is very clean. Mercer county turned the whole area into a beautiful park, great for all sorts of other activities as well.
More: Mercer Lake (Windsor) ...
The Swimming River is to the west.
More: Navesink River ...