I doubt you will find the "perfect" book or field guide that covers what you want. A few from my library... along with many wildflower books.
This one is not bad with cooking receipes; "Edible Wild Plants of Pennsylvania and Neighboring States" by Richard Medve and Mary Lee Medve. (Penn State Press), 1990. It contains line drawings versus pictures.
"Edible Wild Plants, A North American Field Guide", 1990. Outdoor Life Books
"Field Guide to Medicinal Wild Plants", Bradford Angier, 1978.
"Edible Wild Plants" Peterson Field Guides, Lee Allan Peterson. Covers East of the Mississippi River
"Wildflowers & Plant Communities of the Southern Applachain Mountains and Piedomont", Tim Spira, 2011. A bit difficult to use., but well done if you approach plants from a community perspective.
Some of the better wildflower books are also good as they have tidbits on toxicity or folk uses of various plants. Most of your wild plants flower, so they get captured in the wildflower books.
Added: Mushrooms from my way of thinking take a lot of effort to positively identify. I generally leave them alone unless I know for sure it is an edible mushroom. Some books from my library on mushrooms. The better ones are listed:
"Mushrooms of the Great Smokies" by L.R. Hesler, 1960, Univ of TN press (Black and white photos mostly, but okay)
"Mushrooms Demystified" by David Arora, 1986.
"Mushrooms of North America" by Orson Miller Jr. Fairly easy to use due to pictures and sized like a field guide.
"Simon & Schusters Guide to Mushrooms" Gary Lincoff
Audubon field guides are okay.