ブログ
/
AI
/
November 3, 2024

AI and Cybersecurity: Predictions for 2025

Discover the role of AI in shaping cybersecurity predictions for 2025 and how organizations can prepare for emerging threats.
Inside the SOC
Darktrace cyber analysts are world-class experts in threat intelligence, threat hunting and incident response, and provide 24/7 SOC support to thousands of Darktrace customers around the globe. Inside the SOC is exclusively authored by these experts, providing analysis of cyber incidents and threat trends, based on real-world experience in the field.
Written by
The Darktrace Community
Default blog imageDefault blog imageDefault blog imageDefault blog imageDefault blog imageDefault blog image
03
Nov 2024

Introduction: AI cybersecurity predictions for 2025

Each year, Darktrace's AI and cybersecurity experts reflect on the events of the past 12 months and predict the trends we expect to shape the cybersecurity landscape in the year ahead. In 2024, we predicted that the global elections, fast-moving AI innovations, and increasingly cloud-based IT environments would be key factors shaping the cyber threat landscape.

Looking ahead to 2025, we expect the total addressable market of cybercrime to expand as attackers add more tactics to their toolkits. Threat actors will continue to take advantage of the volatile geopolitical environment and cybersecurity challenges will increasingly move to new frontiers like space. When it comes to AI, we anticipate the innovation in AI agents in 2024 to pave the way for the rise of multi-agent systems in 2025, creating new challenges and opportunities for cybersecurity professionals and attackers alike.

Here are ten trends to watch for in 2025:

1. The overall Total Addressable Market (TAM) of cybercrime gets bigger

Cybercrime is a global business, and an increasingly lucrative one, scaling through the adoption of AI and cybercrime-as-a-service. Annual revenue from cybercrime is already estimated to be over $8 trillion, which we’ve found is almost 5x greater than the revenue of the Magnificent Seven stocks. There are a few key factors driving this growth.

The ongoing growth of devices and systems means that existing malware families will continue to be successful. As of October 2024, it’s estimated that more than 5.52 billion people (~67%) have access to the internet and sources estimate 18.8 billion connected devices will be online by the end of 2024. The increasing adoption of AI is poised to drive even more interconnected systems as well as new data centers and infrastructure globally.

At the same time, more sophisticated capabilities are available for low-level attackers – we’ve already seen the trickle-down economic benefits of living off the land, edge infrastructure exploitation, and identity-focused exploitation. The availability of Ransomware-as-a-Service (RaaS) and Malware-as-a-Service (MaaS) make more advanced tactics the norm. The subscription income that these groups can generate enables more adversarial innovation, so attacks are getting faster and more effective with even bigger financial ramifications.

While there has also been an increasing trend in the last year of improved cross-border law enforcement, the efficacy of these efforts remains to be seen as cybercriminal gangs are also getting more resilient and professionalized. They are building better back-up systems and infrastructure as well as more multi-national networks and supply chains.

2. Security teams need to prepare for the rise of AI agents and multi-agent systems

Throughout 2024, we’ve seen major announcements about advancements in AI agents from the likes of OpenAI, Microsoft, Salesforce, and more. In 2025, we’ll see increasing innovation in and adoption of AI agents as well as the emergence of multi-agent systems (or “agent swarms”), where groups of autonomous agents work together to tackle complex tasks.

The rise of AI agents and multi-agent systems will introduce new challenges in cybersecurity, including new attack vectors and vulnerabilities. Security teams need to think about how to protect these systems to prevent data poisoning, prompt injection, or social engineering attacks.

One benefit of multi-agent systems is that agents can autonomously communicate, collaborate, and interact. However without clear and distinct boundaries and explicit permissions, this can also pose a major data privacy risk and avenue for manipulation. These issues cannot be addressed by traditional application testing alone. We must ensure these systems are secure by design, where robust protective mechanisms and data guardrails are built into the foundations.

3. Threat actors will be the earliest adopters of AI agents and multi-agent systems

We’ve already seen how quickly threat actors have been able to adopt generative AI for tasks like email phishing and reconnaissance. The next frontier for threat actors will be AI agents and multi-agent systems that are specialized in autonomous tasks like surveillance, initial access brokering, privilege escalation, vulnerability exploitation, data summarization for smart exfiltration, and more. Because they have no concern for safe, secure, accurate, and responsible use, adversaries will adopt these systems faster than cyber defenders.

We could also start to see use cases emerge for multi-agent systems in cyber defense – with potential for early use cases in incident response, application testing, and vulnerability discovery. On the whole, security teams will be slower to adopt these systems than adversaries because of the need to put in place proper security guardrails and build trust over time.

4. There is heightened supply chain risk for Large Language Models (LLMs)

Training LLMs requires a lot of data, and many experts have warned that world is running out of quality data for that training. As a result, there will be an increasing reliance on synthetic data, which can introduce new issues of accuracy and efficacy. Moreover, data supply chain risks will be an Achilles heel for organizations, with the potential interjection of vulnerabilities through the data and machine learning providers that they rely on. Poisoning one data set could have huge trickle-down impacts across many different systems. Data security will be paramount in 2025.

5. The race to identify software vulnerabilities intensifies

The time it takes for threat actors to exploit newly published CVEs is getting shorter, giving defenders an even smaller window to apply patches and remediations. A 2024 report from Cloudflare found that threat actors quickly weaponized proof of concept exploits in attacks as quickly as 22 minutes after the exploits were made public.

At the same time, 2024 also saw the first reports from researchers across academia and the tech industry using AI for vulnerability discovery in real-world code. With threat actors getting faster at exploiting vulnerabilities, defenders will need to use AI to identify vulnerabilities in their software stack and to help identify and prioritize remediations and patches.

6. Insider threat risks will force organizations to evolve zero trust strategies

In 2025, an increasingly volatile geopolitical situation and the intensity of the AI race will make insider threats an even bigger risk for businesses, forcing organizations to expand zero-trust strategies. The traditional zero-trust model provides protection from external threats to an organization’s network by requiring continuous verification of the devices and users attempting to access critical business systems, services, and information from multiple sources. However, as we have seen in the more recent Jack Teixeira case, malicious insiders can still do significant damage to an organization within their approved and authenticated boundary.

To circumvent the remaining security gaps in a zero-trust architecture and mitigate increasing risk of insider threats, organizations will need to integrate a behavioral understanding dimension to their zero-trust approaches. The zero-trust best practice of “never trust, always verify” needs to evolve to become “never trust, always verify, and continuously monitor.”

7. Identity remains an expensive problem for businesses

2024 saw some of the biggest and costliest attacks – all because the attacker had access to compromised credentials. Essentially, they had the key to the front door. Businesses still struggle with identity and access management (IAM), and it’s getting more complex now that we’re in the middle of a massive Software-as-a-Service (SaaS) migration driven by increasing rates of AI and cloud use across businesses.

This challenge is going to be exacerbated in 2025 by a few global and business factors. First, there is an increasing push for digital identities, such as the rollout of the EU Digital Identity Framework that is underway, which could introduce additional attack vectors. As they scale, businesses are turning more and more to centralized identity and access solutions with decentralized infrastructure and relying on SaaS and application-native security.

8. Increasing vulnerabilities at the edge

During the COVID-19 pandemic, many organizations had to stand-up remote access solutions quickly – in a matter of days or weeks – without the high level of due diligence that they require to be fully secured. In 2025, we expect to see continued fall-out as these quickly spun-up solutions start to present genuine vulnerability to businesses. We’ve already seen this start to play out in 2024 with the mass-exploitation of internet-edge devices like firewalls and VPN gateway products.

By July 2024, Darktrace’s threat research team observed that the most widely exploited edge infrastructure devices were those related to Ivanti Connect Secure, JetBrains TeamCity, FortiClient Enterprise Management Server, and Palo Alto Networks PAN-OS. Across the industry, we’ve already seen many zero days and vulnerabilities exploiting these internet-connected devices, which provide inroads into the network and store/cache credentials and passwords of other users that are highly valuable for threat actors.

9. Hacking Operational Technology (OT) gets easier

Hacking OT is notoriously complex – causing damage requires an intimate knowledge of the specific systems being targeted and historically was the reserve of nation states. But as OT has become more reliant and integrated with IT systems, attackers have stumbled on ways to cause disruption without having to rely on the sophisticated attack-craft normally associated with nation-state groups. That’s why some of the most disruptive attacks of the last year have come from hacktivist and financially-motivated criminal gangs – such as the hijacking of internet-exposed Programmable Logic Controllers (PLCs) by anti-Israel hacking groups and ransomware attacks resulting in the cancellation of hospital operations.  

In 2025, we expect to see an increase in cyber-physical disruption caused by threat groups motivated by political ideology or financial gain, bringing the OT threat landscape closer in complexity and scale to that of the IT landscape. The sectors most at risk are those with a strong reliance on IoT sensors, including healthcare, transportation, and manufacturing sectors.

10. Securing space infrastructure and systems becomes a critical imperative

The global space industry is growing at an incredibly fast pace, and 2025 is on track to be another record-breaking year for spaceflight with major missions and test flights planned by NASA, ESA, CNSA as well as the expected launch of the first commercial space station from Vast and programs from Blue Origin, Amazon and more. Research from Analysis Mason suggests that 38,000 additional satellites will be built and launched by 2033 and the global space industry revenue will reach $1.7 trillion by 2032. Space has also been identified as a focus area for the incoming US administration.

In 2025, we expect to see new levels of tension emerge as private and public infrastructure increasingly intersect in space, shining a light on the lack of agreed upon cyber norms and the increasing challenge of protecting complex and remote space systems against modern cyber threats.  Historically focused on securing earth-bound networks and environments, the space industry will face challenges as post-orbit threats rise, with satellites moving up the target list.

The EU’s NIS2 Directive now recognizes the space sector as an essential entity that is subject to its most strict cybersecurity requirements. Will other jurisdictions follow suit? We expect global debates about cyber vulnerabilities in space to come to the forefront as we become more reliant on space-based technology.

Conclusion: Preparing for the future

Whatever 2025 brings, Darktrace is committed to providing robust cybersecurity leadership and solutions to enterprises around the world. Our team of subject matter experts will continue to monitor emerging threat trends, advising both our customers and our product development teams.

And for day-to-day security, our multi-layered AI cybersecurity platform can protect against all types of threats, whether they are known, unknown, entirely novel, or powered by AI. It accomplishes this by learning what is normal for your unique organization, therefore identifying unusual and suspicious behavior at machine speed, regardless of existing rules and signatures. In this way, organizations with Darktrace can be ready for any developments in the cybersecurity threat landscape that the new year may bring.

Discover more about Darktrace's predictions on the AI and cybersecurity landscape for 2025 by watching the full recorded webinar here.

Inside the SOC
Darktrace cyber analysts are world-class experts in threat intelligence, threat hunting and incident response, and provide 24/7 SOC support to thousands of Darktrace customers around the globe. Inside the SOC is exclusively authored by these experts, providing analysis of cyber incidents and threat trends, based on real-world experience in the field.
Written by
The Darktrace Community

More in this series

No items found.

Blog

/

AI

/

May 21, 2026

Prompt Security in Enterprise AI: Strengths, Weaknesses, and Common Approaches

Default blog imageDefault blog image

How enterprise AI Agents are changing the risk landscape  

Generative AI Agents are changing the way work gets done inside enterprises, and subsequently how security risks may emerge. Organizations have quickly realized that providing these agents with wider access to tooling, internal information, and granting permissions for the agent to perform autonomous actions can greatly increase the efficiency of employee workflows.

Early deployments of Generative AI systems led many organizations to scope individual components as self-contained applications: a chat interface, a model, and a prompt, with guardrails placed at the boundary. Research from Gartner has shown that while the volume and scope of Agentic AI deployments in enterprise environments is rapidly accelerating, many of the mechanisms required to manage risk, trust, and cost are still maturing.

The issue now resides on whether an agent can be influenced, misdirected, or manipulated in ways that leads to unsafe behavior across a broader system.

Why prompt security matters in enterprise AI

Prompt security matters in enterprise AI because prompts are the primary way users and systems interact with Agentic AI models, making them one of the earliest and most visible indicators of how these systems are being used and where risk may emerge.

For security teams, prompt monitoring is a logical starting point for understanding enterprise AI usage, providing insight into what types of questions are being asked and tasks are being given to AI Agents, how these systems are being guided, and whether interactions align with expected behavior. Complete prompt security takes this one step further, filtering out or blocking sensitive or dangerous content to prevent risks like prompt injection and data leakage.

However, visibility only at the prompt layer can create a false sense of security. Prompts show what was asked, but not always why it was asked, or what downstream actions were triggered by the agent across connected systems, data sources, or applications.

What prompt security reveals  

The primary function of prompt security is to minimize risks associated with generative and agentic AI use, but monitoring and analysis of prompts can also grant insight into use cases for particular agents and model. With comprehensive prompt security, security teams should be able to answer the following questions for each prompt:

  • What task was the user attempting to complete?
  • What data was included in the request, and was any of the data high-risk or confidential?
  • Was the interaction high-risk, potentially malicious, or in violation of company policy?
  • Was the prompt anomalous (in comparison to previous prompts sent to the agent / model)?

Improving visibility at this layer is a necessary first step, allowing organizations to establish a baseline for how AI systems are being used and where potential risks may exist.  

Prompt security alone does not provide a complete view of risk. Further data is needed to understand how the prompt is interpreted, how context is applied, what autonomous actions the agent takes (if any), or what downstream systems are affected. Understanding the outcome of a query is just as important for complete prompt security as understanding the input prompt itself – for example, a perfectly normal, low-risk prompt may inadvertently result in an agent taking a high-risk action.

Comprehensive AI security systems like Darktrace / SECURE AI can monitor and analyze both the prompt submitted to a Generative AI system, as well as the responses and chain-of-thought of the system, providing greater insight into the behavior of the system. Darktrace / SECURE AI builds on the core Darktrace methodology, learning the expected behaviors of your organization and identifying deviations from the expected pattern of life.

How organizations address prompt security today

As prompt-level visibility has become a focus, a range of approaches have emerged to make this activity more observable and controllable. Various monitoring and logging tools aim to capture prompt inputs to be analyzed after the fact.  

Input validation and filtering systems attempt to intervene earlier, inspecting prompts before they reach the model. These controls look for known jailbreak patterns, language indicative of adversarial attacks, or ambiguous instructions which could push the system off course.

Importantly, for a prompt security solution to be accurate and effective, prompts must be continually observed and governed, rather than treated as a point-in-time snapshot.  

Where prompt security breaks down in real environments

In more complex environments, especially those involving multiple agents or extensive tool use, AI security becomes harder to define and control.

Agent-to-Agent communications can be harder to monitor and trace as these happen without direct user interaction. Communication between agents can create routes for potential context leakage between agents, unintentional privilege escalation, or even data leakage from a higher privileged agent to a lower privileged one.

Risk is shaped not just by what is asked, but by the conditions in which that prompt operates and the actions an agent takes. Controls at the orchestration layer are starting to reflect this reality. Techniques such as context isolation, scoped memory, and role-based boundaries aim to limit how far a prompt’s influence can extend.  

Furthermore, Shadow AI usage can be difficult to monitor. AI systems that are deployed outside of formal governance structures and Generative AI systems hosted on unknown endpoints can fly under the radar and can go unseen by monitoring tools, leaving a critical opening where adversarial prompts may go undetected. Darktrace / SECURE AI features comprehensive detection of Shadow AI usage, helping organizations identify potential risk areas.

How prompt security fits in a broader AI risk model

Prompt security is an important starting point, but it is not a complete security strategy. As AI systems become more integrated into enterprise environments, the risks extend to what resources the system can access, how it interprets context, and what actions it is allowed to take across connected tools and workflows.

This creates a gap between visibility and control. Prompt security alone allows security teams to observe prompt activity but falls short of creating a clear understanding of how that activity translates into real-world impact across the organization.

Closing that gap requires a broader approach, one that connects signals across human and AI agent identities, SaaS, cloud, and endpoint environments. It means understanding not just how an AI system is being used, but how that usage interacts with the rest of the digital estate.

Prompt security, in that sense, is less of a standalone solution and more of an entry point into a larger problem: securing AI across the enterprise as a whole.

Explore how Darktrace / SECURE AI brings prompt security to enterprises

Darktrace brings more than a decade of AI expertise, built on an enterprise‑wide platform designed to operate in and understand the behaviors of the complex, ambiguous environments where today’s AI now lives. With Darktrace / SECURE AI, enterprises can safely adopt, manage, monitor, and build AI within their business.  

Learn about Darktrace / SECURE AI here.

Sign up today to stay informed about innovations across securing AI.

[related-resource]

Continue reading
About the author
Jamie Bali
Technical Author (AI) Developer

Blog

/

OT

/

May 21, 2026

Data Center Security: Improving Visibility and Threat Detection Across IT, OT, and IoT

Default blog imageDefault blog image

What is data center cybersecurity?

Much of the conversation surrounding the data center boom has focused on power generation, cooling efficiency and water resources, construction, and compute capacity. In addition, cybersecurity has quietly become one of the most critical operational concerns as modern data centers are becoming some of the most operationally complex networked environments.

The more connected data center environments become, the larger and more dynamic their attack surface grows. What makes data center security particularly challenging is that they no longer resemble traditional enterprise IT environments alone. Instead, they operate like critical infrastructure facilities

Challenges of securing data centers

What makes these environments complicated is that the technologies responsible for keeping them operational: power distribution, cooling systems, airflow management, environmental controls, surveillance, and physical access management, all rely heavily on Operational Technology (OT), Industrial IoT (IIoT), and IoT systems alongside traditional IT infrastructure.

Programmable logic controllers (PLCs), building management systems (BMS), energy management systems (EMS), surveillance cameras, access control platforms, virtualization infrastructure, engineering workstations, contractor laptops, and cloud-connected orchestration systems now coexist within the same environment. Many are connected through routable networks, managed remotely, and accessed by 3rd party OEMs or System Integrators.

Why modern data center infrastructure faces increasing cyber risk

The challenge is not simply that there are more devices. It is that these IT, OT and IOT systems and devices are now deeply interconnected in ways that blur the boundaries between operational and enterprise infrastructure.

OT systems responsible for cooling and power distribution communicate alongside enterprise IT infrastructure. IoT devices used for physical security sit adjacent to cloud-connected management platforms. Third-party vendors and contractors frequently require remote access to maintain operations and optimize performance. AI-driven automation platforms increasingly orchestrate workflows across multiple environments simultaneously.

Every additional connection improves efficiency and scalability, but every additional connection also creates new relationships between systems that adversaries may exploit.

How IT, OT, and IoT convergence expands the data center attack surface

Historically in critical infrastructure environments enterprise IT, and OT or industrial control systems ICS, have been often separated by a DMZ.

That separation has steadily disappeared in pursuit of efficiency and access to valuable data that lives within the OT networks such as how many widgets were produced today. This conceptually is commonly referred to as “IT OT convergence.”

Modern data centers increasingly depend on interconnected systems operating across multiple domains simultaneously and face a similar reality when it comes to IT OT convergence.  

This convergence creates efficiency and visibility benefits, but it also introduces structural security challenges that traditional approaches struggle to address.

Many of the OT systems were never originally designed with modern cybersecurity requirements in mind. OT devices often prioritize uptime and operational continuity over security controls. IoT and OT devices may have limited security hardening, are inconsistently patched, or insecure default configurations. Third-party connectivity introduces external dependencies that organizations do not fully control.

As environments converge the attack surface changes and grows, attackers may exploit weaker systems positioned adjacent to critical operations for initial access. For example, a compromised IoT device may provide access into broader infrastructure, or an exposed remote management interface may enable lateral movement into OT systems.  

For defenders, rather than forcing segmentation where it’s not possible, focus oversight and monitoring across interconnected systems and how this activity might create operational risk, gaining visibility across these systems will ensure better awareness of and protection across the cracks in your systems attackers look to exploit.

Why traditional data center security tools create visibility gaps

Many organizations still secure IT, OT, and IoT environments through separate tools, teams, and workflows. Historically, this made sense. The environments themselves were more isolated, and the operational priorities were different.

But convergence changes the nature of detection and response.

Modern attacks increasingly move across domains as lateral movement and discovery techniques are pervasive amongst all the most well-known attacks to have disrupted OT. Adversaries may gain access through phishing or credential compromise, establish persistence in IT systems, pivot into operational infrastructure, exploit unmanaged IoT devices, and move laterally across cloud-connected environments.

Viewed independently, many of these signals may appear low priority or disconnected.

An anomalous login attempt, unusual device communication, changes in network traffic patterns, or abnormal behavior from an industrial controller may not appear significant on their own. The problem emerges when these activities are part of a broader attack chain unfolding across multiple systems simultaneously.

Siloed security models struggle to correlate this activity effectively because they lack shared operational context. Security teams may see isolated indicators while missing the relationships between them.

This creates a fundamental visibility problem that has discursive effects across security teams, leading to analyst overload, tedious alert investigations, and slower response times.

The issue is not simply detecting threats faster. It is understanding how activity across IT, OT, IoT, cloud, and remote access systems relate to one another in real time before operational disruption occurs.

Security measures to safeguard modern data center infrastructure

Rule-based systems, predefined indicators, and signature-driven approaches remain useful for identifying known threats, but they are less effective at identifying subtle behavioral deviations, novel attack paths, insider activity, 3rd party supply chain exploitation or attacks that move across operational domains.  

Darktrace’s Self-Learning AI approach is designed to operate across converged IT, OT, IoT, and cloud environments. Using multiple layers of AI models, Darktrace solutions come together to achieve behavioral prediction, real-time threat detection and response, and incident investigation, all while empowering your security team with visibility and control.

Because the models are environment-specific, they can adapt across highly diverse infrastructure including operational technology, physical security systems, enterprise IT, cloud workloads, and third-party connectivity.

This enables organizations to build a more unified understanding of activity across the data center.

Unified visibility across interconnected environments

Darktrace provides visibility across IT, OT, IoT, and cloud systems through a centralized platform. Security teams and data center operators can maintain live asset inventories, monitor data flows, identify vulnerable or end-of-life systems, and better understand how interconnected infrastructure communicates across the environment.

This becomes increasingly important in environments where unmanaged devices, transient contractor systems, and third-party connectivity continuously alter operational conditions.

Threat detection, investigation, and response

Darktrace applies multiple AI models to identify anomalous activity that may indicate known threats, novel attacks, insider activity, or cross-domain compromise.

By understanding how devices and systems normally behave within the environment, Darktrace can identify subtle deviations that may otherwise remain undetected in siloed environments.

Its autonomous response capabilities can also help contain threats during their early stages before they escalate into operational disruption. Meanwhile, Cyber AI Analyst provides explainable AI-driven investigations that help security teams understand the relationships between events, systems, and users involved in potential incidents.

Proactive risk identification

As data center environments continue to evolve, organizations increasingly need to understand not only active threats, but also where structural weaknesses may exist across interconnected systems.

Through capabilities such as attack path modeling and behavioral risk analysis, Darktrace helps organizations prioritize remediation efforts and identify areas where operational exposure may increase over time.

This supports a more proactive security posture in environments where operational continuity is critical.

Securing the future of interconnected infrastructure

As data centers continue to scale in size, complexity, and operational importance, their reliance on interconnected IT, OT, IoT, cloud, and AI-driven systems will only deepen.

The challenge organizations face is no longer simply protecting individual devices or isolated environments. It is understanding how risk emerges across interconnected systems operating together and detecting threats to these systems in real time.

This is ultimately what makes modern data center security different from traditional enterprise security models. The operational dependencies are broader, the environments are more heterogeneous, and the consequences of disruption and intent of adversaries are more like those in the critical infrastructure space.

Securing these environments therefore requires more than fragmented visibility across disconnected tools. Organizations increasingly need unified approaches capable of understanding relationships across systems, detecting threats early, and responding before operational disruption spreads across critical infrastructure.

As the infrastructure powering the digital economy continues to evolve, cybersecurity resilience will become increasingly inseparable from operational resilience itself.

[related-resource]

Continue reading
About the author
Daniel Simonds
Director of Operational Technology
あなたのデータ × DarktraceのAI
唯一無二のDarktrace AIで、ネットワークセキュリティを次の次元へ