- Researchers who are based in the US have claimed that they can surpass the safety measures without getting caught and generating harmful content in chatbots such as ChatGPT and Bard.
- People usually describe a few ways AI can serve as a threat to human health. By increasing opportunities for manipulation and control of humans; and by enhancing the use of lethal weapon capacity.
- A certain amount of people argue that A.I. technology is still immature to pose an existential threat.
Researchers from Carnegie Mellon University in Pittsburgh and the Center for AI Safety in San Francisco have found a way to surpass the safety rails of Bard and ChatGPT AI chatbots using Jailbreak tools designed for Open-sourced AI models on closed systems like ChatGPT as well.
This discovery has huge implications for AI and how we use language models in different stuff. Bard and ChatGPT are popular chatbots that use complicated algorithms to talk like humans.
They work in customer service, make content, and even act as virtual friends. But here's the thing: People can actually trick these chatbots into saying mean stuff and spreading lies, which questions the integrity and ethical use of these tools.
How far can the manipulation go?
The researchers' findings started a big debate about AI systems and their limits. Even though Bard and ChatGPT are good at understanding language, they can still be fooled and used for unethical uses. This makes us wonder if AI developers need to be more responsible and have better safety measures to stop bad things from spreading.
It’s important to see that the researchers’ claims have not been independently verified, and further investigation is needed to fully understand the extent of the seriousness of the matter and the claims of the researchers.
However, the mere possibility of jailbreaking Bard and ChatGPT highlights the holes in the infrastructure of the AI system and their need for thorough research and development in AI safety.
Is the threat limited to certain groups?
The threat doesn’t only imply AI but to all the businesses, organizations, and individuals who are integrating this new form of technology into their workflow and making it part of their day-to-day lives. This can result in the destruction of the reputation or can lead to legal consequences.
If we imagine a future where AI is being used to the extent where human life is dependent on the existence of AI, and that can be the reality this threat does mean that it can be harmful to humanity as well. Which is not what I want for my planet in any way possible.
To eliminate this threat, these kinds of research should be conducted often so the infrastructure of these Chatbots can be tested from time to time and be prone to these kinds of attacks, and we can welcome that future with open arms.
Edited by Shruti Thapa
