Following the War of 1812, the U. S. Army began a nationwide rebuilding and modernization of coastal defenses. Included in that effort was the building of the two-story Officer's Quarters. Like a dollar bill, the Officer's Quarters is made up of four quarters to house commissioned officers. Each quarter was made up of two rooms, connected by a back hallway.

There were many officers of several ranks who occupied this building during their service. Future governor of South Carolina, Captain Robert K. Scott (1826-1900) was stationed here in 1848. Major Benjamin K. Pierce (1790-1850), older brother of President Franklin Pierce (1804-1869), was stationed here in 1836. Captain Thomas J. Biddle (1790-1831), of the prominent Biddle family, was one of the first to serve here in 1814. The most decorated officer served here in 1817. Colonel Moses Porter (1756-1822) served in the Revolution, the Quasi-War, and the War of 1812.