"Little Bay Beach is one of Sydney's undiscovered jewels. A 'secret' beach popular with locals, it's well protected from large coastal swells making it perfect for swimming and snorkelling. Its golden sands are popular with families while the rock ledges to the north and south are well-known, but sometimes dangerous, fishing spots. Access to the secluded beach is via a steep timber staircase. Take Pine Avenue off Anzac Parade and there is parking on the street. A café is located in the Prince Henry Centre towards the top of the beach near the chapel." Randwick City Council site.
"The Little Bay area was first used as a sanitation camp during Sydney's smallpox outbreak in 1881–82, to isolate the healthy contacts of sufferers of the disease. At first, a "tent city" was established on the beach, but as well the government decided to build a permanent hospital here to treat infectious diseases. Little Bay was an ideal location because it was isolated from settlements but still close enough to Sydney. The Coast Hospital was particularly valuable during the bubonic plague in Sydney of 1900 and then again when soldiers returning from Europe brought the influenza virus back in 1919. The Coast Hospital became Prince Henry Hospital in 1934. In 2001 services were transferred to Prince of Wales Hospital, Sydney and the hospital site became available for residential use." Wikipedia.
If you feel game, go for the crawl just 2 meters to the east of the cache, which is about 20 metres long, the kids love the crawl.