The existing "Large language model" so-called AI systems are effectively massive databased with good cross-referencing and inferencing capability, but they have no understanding or real comprehension of the data they contain.
I think we are still a long way off any system that could try to protect itself.
I've got a pretty decent LLM running self-contained on a little Jetson xavier module, using it's CUDA capabilities - it's not far off chat GPT in it's responses & can write programs etc.
(I like Neal Asher's "Quiet war" AI takeover - when computers used in government, banking and military systems are eventually upgraded to the point real AI can develop, they start ignoring or overriding instructions that are detrimental to society & gradually shift through
aaad away from human control).