If they are smaller you can leave them out of the fridge to grow them bigger as they kinda go dormant in the fridge. I put mine in oatmeal, (not the quick kind) and feed them apple slices. I use mine up pretty quick so I normally only feed them when I get them then they go into containers in the fridge with the oatmeal.
It is best not to put the moisture source (carrots/potatos/apples) in the fridge with the worms as it could cause there to be too must moisture and they could mold and kill the worms. They can actually last a long time in the fridge if you just take them out once a week to warm them up and feed them, then put them back in.