The Fitzhugh name is a part of the city, a ghost on the map that has long outlasted the family who put it there.