California lost a net 54,000 residents last year, the first population drop since the pandemic.