Listen to this Post
Artificial Intelligence (AI) has transformed various industries, but its capabilities are now being exploited in alarming ways by cybercriminals. According to a new report by threat intelligence firm Kela, discussions about AI jailbreaks and malicious AI tools skyrocketed in 2024, showing how cybercriminals are actively weaponizing AI. These AI-powered threats range from sophisticated phishing attacks to deepfake scams and ransomware, highlighting the urgent need for stronger cybersecurity defenses.
AI in Cybercrime: Key Findings from Kela’s 2025 AI Threat Report
Kela’s latest study, 2025 AI Threat Report: How Cybercriminals are Weaponizing AI Technology, sheds light on the rapid evolution of malicious AI. The findings are stark:
- 52% increase in discussions about jailbreaking AI tools like ChatGPT.
- 219% surge in mentions of malicious AI tools, referred to as “dark AI.”
What is Dark AI?
Dark AI refers to AI tools that have been jailbroken or specifically built for cybercrime. These tools can be:
1. Jailbroken versions of legitimate AI systems, modified to remove ethical safeguards.
2. Custom-built AI models, trained for malicious purposes using open-source large language models (LLMs).
One prominent example is WormGPT, a version of the GPT-J LLM adapted for fraudulent activities like business email compromise (BEC) and phishing scams.
AI-as-a-Service: Cybercrime’s New Model
Kela’s report reveals that malicious AI tools are now being offered as AI-as-a-Service (AIaaS), allowing cybercriminals to purchase automated AI tools on underground forums. These tools significantly lower the barrier to entry, making it easier for criminals to:
– Automate phishing attacks and deepfake scams.
– Scan and exploit system vulnerabilities faster.
– Develop advanced malware and ransomware.
– Bypass identity verification checks using deepfake AI.
– Enhance cyber-attacks like password cracking and DDoS.
Fake AI Tools: Scammers Scamming Scammers
The demand for these tools is so high that even cybercriminals are falling victim to fraud. Kela reports that some threat actors are selling fake versions of AI hacking tools, scamming their own peers.
The Future of AI-Powered Cybercrime
Yael Kishon, AI product research lead at Kela, warns that cybercriminals are no longer just using AI—they are creating entire underground networks dedicated to AI-driven attacks. This shift marks a new era of cyber threats that require AI-powered defenses to counteract them.
What Undercode Says:
AI: A Double-Edged Sword in Cybersecurity
AI’s integration into cybersecurity was initially seen as a major advantage for defense teams. However, as Kela’s report highlights, criminals have weaponized AI just as rapidly. This duality presents unprecedented risks to organizations worldwide.
Why AI Makes Cybercrime More Dangerous
AI’s ability to automate, scale, and optimize cyber-attacks makes it a game-changer for threat actors. Some key advantages AI provides to cybercriminals include:
- Speed & Efficiency: AI-driven hacking tools can scan for vulnerabilities much faster than human attackers.
- Scalability: AI can generate thousands of phishing emails or deepfake videos instantly, making large-scale fraud easier.
- Adaptability: AI can quickly modify malware or phishing tactics to evade detection.
- Accessibility: With AI-as-a-Service, even low-skilled hackers can launch sophisticated attacks.
The Rise of AI Warfare
Cybercrime is entering a new phase where AI vs. AI battles will dominate the cybersecurity landscape. As threat actors deploy AI-powered hacking tools, organizations must invest in AI-driven defense systems that can detect and neutralize these threats in real time.
Jailbreaking AI: Ethical AI vs. Rogue AI
The concept of jailbreaking AI is particularly concerning. While AI models are designed with ethical safeguards, criminals are actively finding ways to remove these restrictions. This allows them to use AI for fraud, hacking, and other malicious activities without limitations.
How Organizations Can Defend Against AI-Powered Attacks
To combat this growing threat, businesses and security teams should:
- Adopt AI-based threat detection systems that can identify AI-generated attacks.
– Train employees to recognize AI-enhanced phishing scams.
- Implement stricter AI usage policies to prevent misuse within organizations.
- Monitor dark web activity for emerging AI threats.
Conclusion: The Cybersecurity Arms Race
AI is no longer just a tool for innovation—it is now a battleground. Organizations must stay ahead of cybercriminals by leveraging AI for defense just as aggressively as attackers are using it for offense. Those who fail to adapt will find themselves vulnerable in an increasingly AI-driven cybercrime era.
Fact Checker Results
– AI-powered cybercrime has
References:
Reported By: https://www.infosecurity-magazine.com/news/dark-web-mentions-malicious-ai/
Extra Source Hub:
https://www.quora.com/topic/Technology
Wikipedia
Undercode AI
Image Source:
Pexels
Undercode AI DI v2
