During the winter you can usually just walk/skate to the island to get the cache, but during spring, summer, and fall you have to take a boat(canoe/kayak). You can rent a boat from the town, if you don't have one, at the boat launch during the summer.
Take only photos and memories (and possibly trash), leave only footprints...
Happy caching!