Need help with Key West

Vancouver level 100 requires 40 green gems to build. I have been back to all the previous sites and even my if I use the side helping hands I can’t get 40. This could be really expensive if I choose that route of digging for them Anyone else have this problem