The biggest park on the island is Fort Ward, a former military base which has never actually seen action. A great place for hiking, berry-picking, boat-launching, and picnicking. The shoreline is rather rocky, though. The path down to the water is a bit steep, but makes a very nice woods walk.
Look for beach roses and lupins down near the water.