Parking and launch access are free. There can be a good deal of boat traffic on the river, especially ferries, but if you are careful, you can paddle around the Statue of Liberty and Ellis Island. The museum in the old railroad/ferry terminal is another point of interest.
More: Liberty State Park (Jersey City) ...