Campground on the Old Mine Rd is a good choice. Cant find a website for them but I know campground is still there.
I believe its state owned but I have not been there in ages so I don't know if anything changed.
Word of advise if you will be using it though. Make sure all food is locked away as far as possible from the tent. Bears do come down and I have personally seen them tearing the tent apart 3 spots away from me after the family decided to leave food lying around. Lucky for the family they were out hiking.
__________________________________________________ ___________
Another one which might be pricier but still a good choice is Kittatinny Canoes campground in Barryville. They have an immediate access to the river, I mean you can literally park your inflatable 5 feet away from your tent. They have a stocked trout stream there as well. Used this campground on multiple occasions when using canoe over the weekend on Delaware.
Details here:
http://kittatinny.com/camping/kittatinny-campground/
As far as what to target your choices are plenty. Trout, bass, pike, catfish, walley just to name a few.
I do believe Kittatinny offers drop of service along the river and their launching points. So you can get a campground and have them take you up with your boat upstream so all you have to do is just take the current take you down. I know they did that to kaykaers so you can verify with them if you go this route.
Regardless enjoy your time and let your lines be tight.
Andre