The conversation about AI risk over the past years revolved around accuracy, the ability to pass tests and whether it is conscious. Yes, large language models (