Lathallan School was originally located next to Lathallan Farm just south of the hamlet of Largoward in Fife. However, following a fire in the early hours of 2nd September 1949 the school with 74 boys, moved to Brotherton Castle which was then owned by Charles Alexander, a parent.
During the Second World War Brotherton Castle was turned into a maternity hospital. Mr Charles Alexander In 1950 sold the castle and its grounds to the school governors. In 1976 the school finally became co-educational.