As the temperatures start to drop, some of us are feeling the chill more than others – here’s why