The are no signs in English on the road, and the woman at the entrance was quite surprised to see our Caucasian faces there, and asked where we got the info about. So just follow the coords, and look for the sign よへなあじさい園 everywhere starting from the pineapple park.
You're looking for a small lock-n-lock container. It really should be wheelchair accessible, but the parking is difficult.