The first known Episcopal service in Elberton was held on September 10, 1894, at the Methodist Church by Rev. O. T. Porcher of Greenwood, South Carolina. The first organized Episcopal community was the Church of the Holy Apostles in 1898. This mission church disbanded in 1906, but services revived under the direction of the Rev. Thomas Duck of Toccoa.

By the 1930s, the mission congregation was meeting in the home of Dr. and Mrs. Hawes on Heard Street, and services were held by the Rev. David Cady Wright of Athens. The church's name was changed to St. Alban's in 1941, the same year the present church building was completed and dedicated. This took place on September 10, at the same time the first minister, the Rev. J. Britt Ellington, was ordained. Both ordination and dedication were performed by the Rt. Rev. H. J. Mikell. Granite for the new building was donated by Mr. B. Frank Coggins Sr.

St. Alban's was granted full parish status by the Diocese of Atlanta in 1960. In the seventy years since the present church building was completed, the Rev. Herschel Atkinson has had the longest tenure as priest (from 1970 through October 31, 1997).

Over the years, there have been various improvements to the church building and grounds. In 1956, a new parish house was built at the rear of the existing church. The addition contained various small rooms and offices on the upper floor and a kitchen and large assembly room on the lower floor. Around the turn of the century (ca. 2000), St. Alban's acquired a paved parking lot, and in 2014, a driveway, with a turnaround, was added from the parking lot to the downstairs Parish Hall doors for improved access. As of 2015, the kitchen was finally renovated.