Shiloh (Old Site) Baptist Church was established in Ruby in 1870 by acquiring one acre of land that was purchased for $1.00. The first church was a bush harbor or shelter. The second one was constructed of logs. In 1894, a frame structure was erected.

The church was purchased in 1942 for expansion of US Marine Corps Quantico and rebuilt on its current site in 1949.   The historic church cemetery remains on the grounds of the old church inside the base while a new cemetery was created with the new location.   Many members of the congregation also lost their land during the expansion which might have been a reason for the split with a Shiloh New Site being on Highway 1 in Aquia beginning in 1942 while the Old Site remained in the Ruby area.