The YMCA (Young Men's Christian Association), emphasizing mind, body and spirit, was founded in London in 1844. The first associations in North America were organized in 1851. Five years later, the YMCA came to Columbus, Georgia on November 18, 1856.

The "Y" began in Columbus when a committee consisting of P. H. Colquitt, William Gesner and S. Boykin, calling themselves "the Committee of the Young Men's Christian Association" invited young men of Columbus to an organizational meeting. Two months later, the Association had 30 members and grew to 70 members by July 1857. The meetings were held in various churches around Columbus. The first president was W. C. Hodges.

By May 1859 YMCA activities were conducted at 89 Broad Street above the Redd-Johnson Dry Goods Company in the central part of the city. J. S. Pemberton, the inventor of the Coca-Cola formula, was president. The outbreak of the Civil War disrupted the work of the "Y". The Association was re-established in 1883 with R. J. Clark as president. At that time, the "Y" was located at 1011 Broad Street above the Max Cohn Store.

In 1888, the "Hock Strausser" corner, later known as the Ralph Howard Drug Store corner, Eleventh and Broad Streets, became the scene of YMCA activities. While at this location, the physical department was added to the religious and social activities.

In a letter dated September 20, 1901, philanthropist George Foster Peabody makes the following proposal to then YMCA President J. A. Kirven:
. . . I beg now, upon behalf of my brothers [Roy Canfield Peabody and Charles Jones Peabody] and my self to formally confirm our offer to erect a building to cost not less than $35,000 suitable for occupancy by the YMCA and to be placed upon a lot of ground to be provided and deeded to the association by other friends, free of lien. This offer is conditioned upon the purchase and payment for this land, and upon the raising of as much as $10,000 in cash to be invested and held by the trustees of the association for an endowment fund.

The original marble YMCA building located at 118 East 11th Street was dedicated on December 2, 3 and 4, 1903. The construction was completed in 1907. According to Johnny Sharp, former YMCA Metropolitan Executive Director (1975), the building was modeled after the YMCA in London. In "Columbus on the Chattahoochee" (1951), Etta Blanchard Worsley wrote "George Foster Peabody gave to Columbus the only marble YMCA in America."

The adjacent brick building currently used by the Central YMCA was added in 1952. The handsome three-story and basement addition cost $578,000.00. The building was dedicated in January 1954 "to the glory of God" by Dr. Frederick S. Porter, then Chaplain at City Hospital (now known as the Medical Center). Dr. Porter was the former pastor of the First Baptist Church of Columbus.