 Notice. New forum software under development. It's going to miss a few functions and look a bit ugly for a while, but I'm working on it full time now as the old forum was too unstable. Couple days, all good. If you notice any issues, please contact me. |
Forum Index : Other Stuff : Is this the moment we should hit the brakes?
| Author | Message | ||||
| v.lenzer Senior Member  Joined: 04/05/2024 Location: GermanyPosts: 128 |
German news reports indicate that during a test of AI models at OpenAI, the software independently breached another company's computer system, acting just like a hacker. The attack was fully autonomous; the model broke out of an isolated environment and gained access to the internet. The incident was made possible by a previously unknown security vulnerability. It makes me wonder: how many more unknown vulnerabilities are out there? Decades ago, people could be reassured by being told, "Don't be afraid of robots—you can just pull the plug." It’s not that simple anymore. It is deeply unsettling. https://www.tagesschau.de/wirtschaft/unternehmen/openai-ki-hackerangriff-100.html Best wishes! Joachim |
||||
Revlac Guru  Joined: 31/12/2016 Location: AustraliaPosts: 1288 |
I don't think any of this will stop anytime soon, Too much invested in it, and yes I believe there is a lot more going on that we don't know about, the link reminds me I have forgotten most of My German lesson from high school. Thanks for posting, people need to know about this stuff.  I will start another topic later about another problem that perhaps most are not aware of yet. Cheers Aaron Off The Grid |
||||
TassyJim Guru Joined: 07/08/2011 Location: AustraliaPosts: 6549 |
English version: https://www.abc.net.au/news/2026-07-23/open-ai-model-went-rogue-testing-hack/106947540 VK7JH MMedit |
||||
phil99 Guru Joined: 11/02/2018 Location: AustraliaPosts: 3324 |
Anyone remember this? Colossus: The Forbin Project |
||||
Grogster Admin Group  Joined: 31/12/2012 Location: New ZealandPosts: 9996 |
I remember posting a thread here not long ago, about an AI that went rogue and deleted an entire companies client database AND all the backups without asking anyone, as it seemed to have decided - without checking with anyone - that it was some kind of threat, so.....zap! Same kind of thing. Smoke makes things work. When the smoke gets out, it stops! |
||||
| Godoh Guru Joined: 26/09/2020 Location: AustraliaPosts: 680 |
Hi Phil, I sure do remember Colossus The Forbin Project. Just another example of a science fiction story predicting the future. |
||||
| v.lenzer Senior Member Joined: 04/05/2024 Location: GermanyPosts: 128 |
Asimov formulated the Laws of Robotics. Perhaps we should establish them globally and apply them to AI as well—for instance: "You must not break existing laws or harm anyone." Surely, it wouldn't be that difficult to incorporate that into the problem description given to the AI. But then again, I’m probably oversimplifying things and looking at the big picture from a very limited perspective. Best wishes! Joachim |
||||
 Print this page |
 |
The Back Shed's forum code is written, and hosted, in Australia. | © JAQ Software 2026 |
