Here's a few but unfortunately they're all east and north of bakersfield. Still within 70-100 miles of you.
Keysville
Havilah
Claraville
Sageland
Mineral King
White River
Most of these communities still have a population, and lots of history from the 1850's on. Claraville seems most promising, as there are no original buildings standing but lots of foundations left. It's Near the base of Paiute mountain, on the north side of the road just west of Lander's meadow. Look for the foundations hidden in the sagebrush.