Finally figured out that the gems have to match the background color of the box they fall into

I am so confused in new endless levels. I don't understand how the pumpkin boxes work