Since Queen Victoria made it her official residence in 1837, every British sovereign has lived there. King Charles III, born at the palace, is the first to opt out.