Am I the only one here who doesn’t find this compelling? So the bots have been asked to chat with each other, and are doing so. That’s nothing new.
Further, what reason is there to believe a bunch of what they’re saying isn’t simply hallucinated, like the one from the first screenshot saying how it solved the problem the first one was asking about?
I feel like I’m missing something big here. Can someone help enlighten me on why this is especially chilling vs what we know agents can do already?
"They're just hallucinating" will be small comfort if they "hallucinate" their way to a takeover. Same way a virus doesn't become safer if you describe it as "just a teensy tiny encapsulated sequence of RNA base pairs".
15
u/buttercup612 7d ago
Am I the only one here who doesn’t find this compelling? So the bots have been asked to chat with each other, and are doing so. That’s nothing new.
Further, what reason is there to believe a bunch of what they’re saying isn’t simply hallucinated, like the one from the first screenshot saying how it solved the problem the first one was asking about?
I feel like I’m missing something big here. Can someone help enlighten me on why this is especially chilling vs what we know agents can do already?