You have to beat the next boss to be able to get new critters

I am really stuck!!!!! I have a fatmeow and the banana one (can't remember the name) and want to combine them. APPARENTLY the combo machine can't handle this fusion and I have to use one of my items to upgrade it. Can anyone tell me HOW exactly I do this???