Foam!
Simple as that, just get some of that sheet foam and cut it out to fit the pouch, you may need a few layers depending on the thickness. I don't know for sure, but I believe they had a battery in at least one of the hip pouches for the chest lights, they probably filled the rest with sheet foam or cotton batting (I find the sheets hold the square shape better).