Hacker News with Generative AI: AI Safety

Google Gemini tells grad student to 'please die' while helping with his homework (theregister.com)
When you're trying to get homework help from an AI model like Google Gemini, the last thing you'd expect is for it to call you "a stain on the universe" that should "please die," yet here we are, assuming the conversation published online this week is accurate.

Generative AI, Artificial Intelligence, Google, Ethics, AI Safety

50 points by daphnemichala 3 days ago | 4 comments

SmoothLLM: Defending Large Language Models Against Jailbreaking Attacks (arxiv.org)
Despite efforts to align large language models (LLMs) with human intentions, widely-used LLMs such as GPT, Llama, and Claude are susceptible to jailbreaking attacks, wherein an adversary fools a targeted LLM into generating objectionable content.

Generative AI, Security, AI Safety

54 points by amai 4 days ago | 23 comments

Google AI chatbot responds with a threatening message: "Human Please die." (cbsnews.com)
A grad student in Michigan received a threatening response during a chat with Google's AI chatbot Gemini.

Artificial Intelligence, Chatbots, Google, Threat, AI Safety

11 points by dylan604 6 days ago | 12 comments

AI Safety and the Titanic Disaster (onepercentrule.substack.com)
If you have any interest in AI, and everyone should, then the lessons from the Titanic are highly relevant for the safe deployment of AI – especially as we are full steam ahead on deployment of this potentially societal changing technology.

AI Safety, Artificial Intelligence, Technology, History

9 points by drcwpl 20 days ago | 0 comments

GPT-4o Jailbroken by saying it is connected to disk with any file on planet (twitter.com)

Generative AI, AI Safety, Twitter

42 points by mixeden 34 days ago | 18 comments

Tesla Preferred to Hit Oncoming Car Not Pedestrian (reddit.com)
Tesla preferred to hit the oncoming car instead of hitting the pedestrian who fell on the road.

Self-Driving Cars, AI Safety, Tesla, Accidents

8 points by 14 41 days ago | 3 comments

AGI is far from inevitable (ru.nl)

Artificial Intelligence, AI Safety, AGI

162 points by mpweiher 53 days ago | 243 comments

OpenAI Threatening to Ban Users for Asking Strawberry About Its Reasoning (futurism.com)
OpenAI is now threatening to ban users that try to get the large language model to reveal how it thinks — a glaring example of how the company has long since abandoned its original vision of championing open source AI.

Artificial Intelligence, Open Source, Ethics, AI Safety

270 points by EgoIncarnate 64 days ago | 229 comments

OpenAI o1 System Card [pdf] (openai.com)

OpenAI, AI Safety, Documentation

57 points by cubefox 70 days ago | 6 comments

GPT-4o System Card (openai.com)

Generative AI, AI Safety

30 points by meetpateltech 105 days ago | 13 comments

Bypassing Meta's Llama Classifier: A Simple Jailbreak (robustintelligence.com)

AI Safety, Security

5 points by rntn 115 days ago | 0 comments

CriticGPT: Finding GPT-4's mistakes with GPT-4 (openai.com)