Stop the cold from entering

If you need to fill in a crack or hole around windows or doors, use papier mache. Newspaper is a good insulator, so papier mache will help keep out the cold or heat better than caulking.

Press it firmly into the crack with a hard object. It will take a few days to cure, so choose a warm spell if you can.