The original small building was erected in about 1854 as a guardhouse to protect the rear of Fort Albert. The building was vulnerable to fire from higher ground from behind. It was impossile for the defence to fire on or see any attacker who managed to reach the wall. Due to it’s limited value it was replaced by a more effective structures.The Royal Commission Report of 1859 said that addition ordnance should be placed behind earthen ramparts in the Cliff End area. Consequantly a small fort was constructed in the 1860’s to supplement Fort Albert.

When heavier militery equipement became available the fort was replaced by a battery in 1876 and became know as the Cliff End battery. Guns consisted of six 12.5in rifled muzzle-loaders and four 10in muzzle-loaders were installed. These were replaced in the late 1890’s by eighteen 6in breech loaders which stayed in position until the end of World War II. The battery was finally abandoned in 1956.