Tower 56, as with numbers 57 and 58, was situated along the shoreline of Pevensey Bay, and therefore always was in danger of being lost. It is not recorded exactly when it disappeared, but it is mentioned in the 1841 Census as being occupied by three men, receiving half pay from either the Army or Navy.

By 1851 it was manned by two coastguards, but by 1873 was in a precarious position, and close to the sea.