Built in 1910 by HL Johnson, the Alleghany Water Works was privately owned until 1939.
The District was incorporated as a County Water District on March 8, 1939. At that time Alleghany had approximately 500 residents. The 1970 census recorded 125 residents and the 2010 census recorded 58 residents.