Newzchain
News·Artificial Intelligence

Can the threat to AI pose a threat on us as well

Kunal Bandil
Kunal Bandil·Aug 12, 2023·2 min read
Researchers found a way to surpass safety rails of Bard and ChatGPT AI chatbots using jailbreak tools

Researchers from Carnegie Mellon University in Pittsburgh and the Center for AI Safety in San Francisco have found a way to surpass the safety rails of Bard and ChatGPT AI chatbots using Jailbreak tools designed for Open-sourced AI models on closed systems like ChatGPT as well.

This discovery has huge implications for AI and how we use language models in different stuff. Bard and ChatGPT are popular chatbots that use complicated algorithms to talk like humans.

They work in customer service, make content, and even act as virtual friends. But here's the thing: People can actually trick these chatbots into saying mean stuff and spreading lies, which questions the integrity and ethical use of these tools.

How far can the manipulation go?

The researchers' findings started a big debate about AI systems and their limits. Even though Bard and ChatGPT are good at understanding language, they can still be fooled and used for unethical uses. This makes us wonder if AI developers need to be more responsible and have better safety measures to stop bad things from spreading.

It’s important to see that the researchers’ claims have not been independently verified, and further investigation is needed to fully understand the extent of the seriousness of the matter and the claims of the researchers.

Newsletter

The corridor, every morning.

Funding rounds and cross-border capital moves, one email, five minutes.

However, the mere possibility of jailbreaking Bard and ChatGPT highlights the holes in the infrastructure of the AI system and their need for thorough research and development in AI safety.

Is the threat limited to certain groups?

The threat doesn’t only imply AI but to all the businesses, organizations, and individuals who are integrating this new form of technology into their workflow and making it part of their day-to-day lives. This can result in the destruction of the reputation or can lead to legal consequences.

If we imagine a future where AI is being used to the extent where human life is dependent on the existence of AI, and that can be the reality this threat does mean that it can be harmful to humanity as well. Which is not what I want for my planet in any way possible.

To eliminate this threat, these kinds of research should be conducted often so the infrastructure of these Chatbots can be tested from time to time and be prone to these kinds of attacks, and we can welcome that future with open arms.


Edited by Shruti Thapa

More in News