Blog
/

Inside the SOC

/
November 9, 2023

Threat Hunting Life Cycle: Data Collection to Documentation

Default blog imageDefault blog imageDefault blog imageDefault blog imageDefault blog imageDefault blog image
09
Nov 2023
Learn how Darktrace enhances threat hunting from data collection to response in the threat-hunting lifecycle in this comprehensive blog post. Read more!

What is Threat Hunting?

Threat Hunting is a technique to identify adversaries within an organization that go undetected by traditional security tools.

While a traditional, reactive approach to cyber security often involves automated alerts received and investigated by a security team, threat hunting takes a proactive approach to seek out potential threats and vulnerabilities before they escalate into full-blown security incidents. The benefits of hunting include identifying hidden threats, reducing the dwell time of attackers, and enhancing overall detection and response capabilities.

Threat Hunting Methodology

There are many different methodologies and frameworks for threat hunting, including the Pyramid of Pain, the Sqrrl Hunting Loop, and the MITRE ATT&CK Framework.  While there is not one gold standard on how to conduct threat hunts, the typical process can be broken down into several key steps:

Planning and Hypothesis Creation: Define the scope and objective of the threat hunt. Identify potential targets and predict activity that might be taking place.

Data Collection: Refining data collection methods and gathering data from various sources, including logs, network traffic, and endpoint data.

Data Processing: Data that has been collected needs to be processed to generate information.

Data Analysis: Processed data can then be analyzed for anomalies, indicators of compromise (IoCs), or patterns of suspicious behavior.

Threat Identification: Based on the analysis, threat hunters may identify potential threats or security incidents.

Response: Taking action to mitigate or eradicate identified threats if any.

Documentation and Dissemination: It is important to record any findings or actions taken during the threat hunting process to serve as lessons learned for future reference. Additionally, any new threats or tactics, techniques, and procedures (TTPs) discovered may be shared with the cyber threat intelligence team or the wider community.

Building a Threat Hunting Program

For organizations looking to implement threat hunting as part of their cyber security program, they will need both a data collection source and human analysts as threat hunters.

Data collection and analysis may often be performed through existing security tools including SIEM systems, Network Traffic Analysis tools, endpoint agents, and system logs. On the human side, experienced threat hunters may be hired into an organization, or existing SOC analysts may be upskilled to perform threat hunts.

Leveraging AI security tools such as Darktrace can help to lower the bar in building a threat hunting program, both in analysis of the data and in assisting humans in their investigations.

Threat Hunting in Darktrace

To illustrate the benefits of leveraging Darktrace in threat hunting, we can walk through an example hunt following the key steps outlined above.

Planning and Hypothesis Creation

The initial hypothesis used in defining the scope of a threat hunt can come from several sources: threat intelligence feeds, the threat hunter’s own experience, or an anomaly detection that has been highlighted by Darktrace.

In this case, let’s imagine that this hunt is focused on a recent campaign by an Advanced Persistent Threat (APT). Threat intel has provided known file hashes, Command and Control (C2) IP addresses and domains, and MITRE techniques used by the attacker. The goal is to determine whether any indicators of this threat are present in the organization’s environment.

Data Collection and Data Processing

Darktrace can be deployed to cover an organization’s entire digital estate, including passive network traffic monitoring, cloud environments, and SaaS applications. Self-Learning AI is applied to the raw data to learn normal patterns of life for a specific environment and to highlight deviations from normal that might represent a threat. This data gives threat hunters a starting point in analyzing logs, meta-data, and anomaly detections.

Data Analysis

In the data analysis phase, threat hunters can use the Darktrace platform to search for the IoCs and TTPs identified during planning.

When searching for IoCs such as IP addresses or domain names, hunters can query the environment through the Omnisearch bar in the Darktrace Threat Visualizer. This search can provide a summary of all devices or users contacting a suspicious endpoint. From here the hunters can quickly pivot to identify surrounding activity from the source device.

Figure 1: Search for twitter[.]com (now known as X) as a potential indicator of compromise

Alternately, Darktrace Advanced Search can be used to search for these IoCs, but it also supports queries for file hashes or more advanced searches based on ports, protocols, data volumes, etc.

Figure 2: Advanced Search query for connections on port 3389 lasting longer than 60 seconds

While searching for known suspicious domains and IP addresses is straightforward, the real strength of Darktrace lies in the ability to highlight deviations from a device’s ‘normal’ pattern of life. Darktrace has many built-in behavioral models designed to detect common adversary TTPs, all mapped to the MITRE ATT&CK Framework.

In the context of our threat hunt, we know that our target APT uses the Remote Desktop Protocol (RDP) to move laterally within a compromised network, specifically leveraging MITRE technique T1021.001. As each Darktrace model is mapped to MITRE, the threat hunter can search and find specific detection models that may be of interest, in this case the model ‘Anomalous Connection / Unusual Internal Remote Desktop’. From here they can view any devices that may have triggered this model, indicating possible attacker activity.

Figure 3: MITRE Mapping details in the Darktrace Model Editor

Threat hunters can also search more widely for any detections within a specific MITRE tactic through filters found on the Darktrace Threat Tray.

Figure 4: Search for the Lateral Movement MITRE Tactic on the model breach threat tray

Threat Identification

Once a threat hunter has identified connections, model breaches, or anomalies during the analysis phase, they can begin to conduct further investigation to determine if this may represent a security incident.

Threat hunters can use Darktrace to perform deeper analysis through generating packet captures, visualizing surrounding network traffic, and utilizing features like the VirusTotal lookup to consult open-source intelligence (OSINT).

Another powerful tool to augment the hunter’s investigation is the Darktrace Cyber AI Analyst, which assists human teams in the investigation and correlation of behaviors to identify threats. Cyber AI Analyst automatically launches an initial triage of every model breach in the Darktrace platform, but threat hunters can also leverage manual investigations to gain additional context on their findings.

For example, say that an unusual RDP connection of interest was identified through Advanced Search. The hunter can pivot back to the Threat Visualizer and launch an AI Analyst investigation for the source device at the time of the connection. The resulting investigation may provide the hunter with additional suspicious behavior observed around that time, without the need for manual log analysis.

Figure 5: Manual Cyber AI Analyst investigations

Response

If a threat is detected within Darktrace and confirmed by the threat hunter, Darktrace's Autonomous Response can be leveraged to take either autonomous or manual action to contain the threat. This provides the security team with additional time to conduct further investigation, pull forensics, and remediate the threat. This process can be further supported through the bespoke, AI-generated playbooks offered by Darktrace / Incident Readiness & Recovery, allowing an efficient recovery back to normal.

Figure 6: Example of a manual RESPOND action used to block suspicious connectivity on port 3389 to contain possible lateral movement

Documentation and Dissemination

An important final step is to document the threat hunting process and use the results to better improve automated security alerting and response. In Darktrace, reporting can be generated through the Cyber AI Analyst, Advanced Search exports, and model breach details to support documentation.

To improve existing alerting through Darktrace, this may mean creating a new detection model or increasing the priority of existing detections to ensure that these are escalated to the security team in the future. The Darktrace model editor provides users with full visibility into models and allows the creation of custom detections based on use cases or business requirements.

Figure 7: The Darktrace Model Editor showing the Breach Logic configuration

Conclusions

Proactive threat hunting is an important part of a cyber security approach to identify hidden threats, reduce dwell time, and improve incident response. Darktrace’s Self-Learning AI provides a powerful tool for identifying attacker TTPs and augmenting human threat hunters in their process. Utilizing the Darktrace platform, threat hunters can significantly reduce the time required to complete their hunts and mitigate identified threats.

Inside the SOC
Darktrace cyber analysts are world-class experts in threat intelligence, threat hunting and incident response, and provide 24/7 SOC support to thousands of Darktrace customers around the globe. Inside the SOC is exclusively authored by these experts, providing analysis of cyber incidents and threat trends, based on real-world experience in the field.
Author
Brianna Leddy
Director of Analysis

Based in San Francisco, Brianna is Director of Analysis at Darktrace. She joined the analyst team in 2016 and has since advised a wide range of enterprise customers on advanced threat hunting and leveraging Self-Learning AI for detection and response. Brianna works closely with the Darktrace SOC team to proactively alert customers to emerging threats and investigate unusual behavior in enterprise environments. Brianna holds a Bachelor’s degree in Chemical Engineering from Carnegie Mellon University.

Book a 1-1 meeting with one of our experts
Share this article

More in this series

No items found.

Blog

/

December 12, 2024

/
No items found.

Company Shuts Down Cyber-attacks with “Flawless” Detection and Response from Darktrace

Default blog imageDefault blog image

Growing pains: Balancing efficiency with risk  

This organization has recently scaled its operations, and numerous acquisitions have significantly boosted the organization’s capabilities and growth. However, this also creates work and high expectations for the organization’s IT and security teams. Within 12 months of an acquisition, the teams must fully integrate each new business onto the company’s platform. “A huge piece of that integration plan is rolling out our security controls,” said the CISO. “While our goal is to connect those facilities up as quickly as possible to drive efficiency, we also need to implement the proper security controls to protect the enterprise.”

Gap beyond the perimeter  

The organization had established strong security measures to safeguard its perimeter; however, the CISO identified a critical gap in real-time network monitoring. If the perimeter were breached, threats were only discovered after an endpoint was compromised and the issue was manually reported.

As digital transformation progresses, the need to adopt advanced technologies is becoming essential, particularly as organizations begin to open up operational environments to greater connectivity. Many processes still rely on traditional methods, and integrating innovative solutions could drive significant improvements in efficiency and productivity. “We’re committed to adopting cutting-edge technologies,” the CISO explained. “But we understood that without more robust network security controls, opening up our operational environments would expose us to heightened risks, including advanced threats like ransomware.”

Building a layered, proactive security strategy with Darktrace  

To close the gap beyond the perimeter, the company embarked on a free trial with Darktrace. The CISO recalls: “The trials were fantastic. It was obvious that Darktrace was exactly what we needed. The Darktrace team was also very knowledgeable and helpful throughout the process, which was impressive.”  

Today, the organization is using a combination of Darktrace solutions for its layered security approach, including:

Detecting unusual behavior with AI  

Darktrace’s use of machine learning and Self-Learning AI is one of the reasons the company chose Darktrace. Instead of teaching an AI system what an ‘attack’ looks like, training it on large data lakes of thousands of organizations’ data, Darktrace AI learns from the company’s own unique data and user activity to learn and create baseline models of what ‘normal’ looks like for their business.

Darktrace can then detect subtle deviations and unusual activity that signals a possible threat. “That fascinated us because what it really means is this technology doesn’t need to know about every single threat because the threat itself isn’t important, it’s the behavior of the activity that’s important. That capability is unique when it when it comes to threat detection,” said the CISO.

Identifying and mitigating high-impact attack paths

The security team appreciated that with Darktrace they could take a more proactive approach to security by exposing high-risk attack paths through modeling and AI risk assessments. Darktrace / Proactive Exposure Management gives them visibility into vulnerable entry points and assets, identifies active risks, and prioritizes the most important security issues to be addressed.

“Specific users and assets within our business have a higher risk of being targeted by a cyber-attack, for example our executives,” said the CISO. “With Darktrace, we get an adversarial view of our risk. We can see the attack path around those potential targets and proactively take measures to mitigate that vulnerability and prevent an attack.”

Driving up productivity while putting the brakes on cyber-attacks  

The security team collaborated with Darktrace to fine tune the models that really fit their business. With Darktrace now automating most of their threat detection and response efforts, productivity has soared, the security team is now focused on delivering greater value to the business and, most importantly, Darktrace proved it could quickly detect and shut down a major cyber-attack–and do so without impacting business operations.

Fueling team productivity with automation and AI

Prior to using Darktrace, the security team had little visibility into potential risks beyond the perimeter. Today, the team has full control and visibility over the network. “My team is now spending 80-90% of their time doing proactive work because Darktrace is managing the vast majority of our detect and response needs. The team really has faith in the Darktrace system,” said the CISO.  

With less time spent on low-level manual tasks, the security team can now focus on higher priority initiatives. For example, they have expanded their internal vulnerability assessments across the entire group. The team couldn’t focus on this additional audit and vulnerability management work if Darktrace wasn’t taking care of most of their security monitoring. “Darktrace has allowed us to move on to these additional kinds of governance projects that we otherwise would have to hire an army of staff to get through”.

Stopping email threats in their tracks

Using Darktrace / EMAIL, the company has identified and blocked a significant percentage of emails that were making it past their native email filters. “Darktrace is especially good at detecting impersonation emails, and we really appreciate its ability to automatically remove suspicious emails directly from a user’s inbox. It adds an extra level of confidence,” said the CISO.

Self-Learning AI understands anomalies within unique communication patterns to stop known and unknown threats. For example, when an employee sent an email to a brand new domain, Darktrace identified the behavior as unusual and inconsistent with baseline models and blocked the email.

Darktrace passes the biggest test of all

In 2024, the company experienced the value of the security system firsthand when attackers exploited a vulnerability in a third-party remote support solution that they was using. This solution provided remote access and tech support capabilities. If successful, the attackers could have infiltrated high-value end points and created their own administrative user, giving them full control over the server.

“We first became aware of the attack when Darktrace notified us of unusual behavior coming from the remote support server,” said the CISO. The attackers were attempting to put backdoors onto the service with the intent of selling access to the highest bidder who would then install ransomware on their servers. It all happened very quickly, as the attackers tried to connect to the internal network and other servers, while also firing off a host of other actions, like PowerShell commands, to escalate their privileges.  

“Darktrace worked flawlessly. There was no chance that ransomware was ever going to come in,” the CISO said. “Even though there was no signature to really look at, Darktrace realized this was not normal behavior for this server, shutting down connections and doing everything it could do to stop the attack.” Within eight hours, the security team identified and stopped the attack, severed its connection to the third-party solution, and completed additional analysis and clean-up. “In addition to our own investigation, third parties like our external SOC and legal department also confirmed that Darktrace performed as expected. We were able to report back to the executive team that there was zero risk that any data or systems were compromised.”

Post-attack, there was no need to make any changes to Darktrace. The team consistently reviews its models and baselines, often collaborating with Darktrace to make adjustments when needed to continuously improve performance. “Because of this relationship and constant engagement with Darktrace’s technical teams, we didn't have to go back and ask: ‘why wasn’t this updated’ or ‘why didn’t this model work.’ The models worked.”

His advice to other organizations facing similar challenges? First, focus on updating, patching, and vulnerability management, and act quickly when vulnerabilities are identified. His second piece of advice: “have an automated detection system like Darktrace in place so you can respond at the speed that these attacks evolve. Humans can no longer keep up with a scripted attack as it moves around and tries to compromise items on your network. You need the right technology to fight these types of attacks.”

Dynamic capabilities for a dynamic future

Real-time playbooks

With a proactive, enterprise-wide security strategy in place, the CISO now has the time to think about future projects and innovations. He’s particularly interested in the idea of generating playbooks on the fly in response to real-time events. He believes cyber-attacks are far too varied for a static playbook to be useful; when an attack strikes, teams need to quickly understand exactly what’s in front of them and how to shut it down. “This fits into our future cybersecurity strategy, and Darktrace is the only company I’ve seen talking about building playbooks dynamically. This kind of technology would really help bring our cybersecurity strategy full circle.”

“Darktrace ’s technology, experience and expertise is helping us staying ahead of cyber-attacks, minimizing our risk and driving greater productivity for our team,” said the CISO. In collaboration with Darktrace, the team have created a security foundation that is both powerful and agile. “While Darktrace is detecting and responding to attacks targeting our business today, we know that it’s always learning, adapting and scaling to ensure we’re protected tomorrow. That gives me peace of mind and the freedom to focus on our future.”

Download the Darktrace / NETWORK Solution Brief

Darktrace / NETWORK solution brief screenshot

Protect in real time: Defend against known and emerging threats without relying on historical data or external intelligence.

Full visibility: Gain comprehensive insights across all network environments, including on-premises, cloud, and remote devices.

AI-powered efficiency: Streamline incident response with AI automation, saving time and resources while ensuring minimal disruption to operations.

Continue reading
About the author
The Darktrace Community

Blog

/

December 11, 2024

/
No items found.

Darktrace is Positioned as a Leader in the IDC MarketScape: Worldwide Network Detection and Response 2024 Vendor Assessment

Default blog imageDefault blog image

Darktrace is pleased to announce that we have been positioned as a Leader in the IDC MarketScape: Worldwide Network Detection and Response 2024 Vendor Assessment. We believe this further highlights Darktrace’s position as a pioneer in the NDR market and follows similar recognition from KuppingerCole, who recently named Darktrace as an Overall Leader, Product Leader, Market Leader and Innovation Leader in the KuppingerCole Leadership Compass: Network Detection and Response (2024).

Network Detection and Response (NDR) solutions are uniquely positioned to provide visibility over the core hub of a business and employee activity, analyzing North-South and East-West traffic to identify threats across the modern network. NDR provides a rich and true source of anomalies and goes beyond process level data that is relied on by Endpoint Detection and Response (EDR) agents that do not provide network level visibility and can be misconfigured at any time.1

Metadata from network traffic can be used to detect a variety of different threats based on events such as anomalous port usage, unusual upload/download activity, impossible travel and many other activities. This has been accelerated by the increased usage of user behavioral analytics (UBA) in network security, which establishes statistical baselines about network entities and highlights deviations from expected activity.1

Darktrace is recognized as a Leader in the IDC MarketScape due to our leadership in the market and our pioneering leadership in AI over the past decade, alongside a variety of other unique differentiators and innovations in the NDR industry.

Darktrace / NETWORK™ delivers full visibility, real time threat detection and Autonomous Response capabilities across an organization’s on-premises, cloud, hybrid and virtual environments, including remote worker endpoints.

Unique Approach to AI

Most NDR vendors and network security tools such as IDS/IPS rely on detecting known attacks with historical data and supervised machine learning, leaving organizations blind and vulnerable to novel threats such as zero-days, variants of known attacks, supply chain attacks and insider threats.

These vendors also tend to apply AI models that are trained globally, and are not unique to each organization’s environment, which creates a high number of false positives and alerts that ultimately lack business context.

The IDC MarketScape recognizes that Darktrace takes a differentiated approach in the market with regards to delivering network detection and response capabilities, noting; “Darktrace is unique in that it does not rely on rules and signatures but rather learns what constitutes as normal for an organization and generates alerts when there is a deviation.”1

Darktrace / NETWORK achieves this through the use of Self-Learning AI and unsupervised machine learning to understand what is normal network behavior, continuously analyzing, mapping and modeling every connection to create a full picture of devices, identities, connections and potential attack paths. Darktrace Self-Learning AI autonomously optimizes itself to cut through the noise and quickly surface genuine, prioritized network security incidents – significantly reducing false positives and removing the hassle of needing to continually tuning alerts manually.

Darktrace’s unique approach to AI also extends to the investigation and triage of network alerts with Cyber AI Analyst. Unlike a chat or prompt based LLM, Cyber AI Analyst investigates all relevant alerts in an environment, including third party alerts, autonomously forming hypotheses and reaching conclusions just like a human analyst would, accelerating SOC Level 2 analyses of incidents by 10x. Cyber AI Analyst also typically providing SOC teams with up to 50,000 additional hours annually of Level 2 analysis producing high level alerts and written reporting, transforming security operations.2

Darktrace also uses its deep understanding of what is normal for a network to identify suspicious behavior, leveraging Autonomous Response capabilities to shut down both known and novel threats in real time, taking targeted actions without disrupting business operations. Darktrace / NETWORK is the only NDR solution that can autonomously enforce a pattern of life based on what is normal for a standalone device or group of peers, rapidly containing and disarming threats based on the overall context of the environment and a granular understanding of what is normal for a device or user – instead of relying on historical attack data.

Continued NDR Market Leadership

Darktrace has been recognized as a Leader in the NDR market, and the IDC MarketScape listed a variety of strengths:

  • Darktrace achieves roughly one-fifth of all global NDR revenue. This is important because other IT and cybersecurity solutions providers necessarily want to have integration with Darktrace.
  • The AI algorithms that Darktrace uses for NDR have had 10 years of deployments, tuning, and learning to draw from.
  • Darktrace is available as a SaaS, as an enterprise license, and as physical, hybrid, or virtual appliances. Darktrace also offers an endpoint agent and visibility into VPN and ZTNA.
  • Darktrace integrates with 30+ different interfaces including SIEM, SOAR, XDR platforms, IT ticketing solutions, and their own dashboards. The Darktrace Threat Visualizer highlights events and incidents from the entire deployment including cloud, apps, email, endpoint, zero trust, network, and OT.
  • Darktrace / NETWORK charts the progress that the SOC is making over time with key metrics such as MTTD/MTTR, alerts generated and processed, and other criteria.
  • Darktrace reported coverage of 14 MITRE ATT&CK categories, 158 techniques, and 184 subtechniques

Proactive Network Resilience

The IDC MarketScape notes, “Ultimately, NDR shines as a standalone detection and response technology but is especially powerful when combined with other platforms. NDR in combination with other control points such as endpoint, data, identity, and application provides the proper context when winnowing alerts and trying to uncover a single source of truth.” . Darktrace comprehensively addresses this as part of the ActiveAI Security Platform, by combining network alerts with data from / EMAIL, / IDENTITY, / ENDPOINT, / CLOUD and / OT, providing deeper contextual analysis for each network alert and automatically enriching investigations.

Darktrace also goes beyond NDR solutions with capabilities that are closely linked to our NDR offering, helping clients to achieve and maintain a state of proactive network resilience:

  • Darktrace / Proactive Exposure Management – look beyond just CVE risks to discover, prioritize and validate risks by business impact and how to address them early, reducing the number of real threats that security teams need to handle.
  • Darktrace / Incident Readiness & Recovery – lets teams respond in the best way to each incident and proactively test their familiarity and effectiveness of IR workflows with sophisticated incident simulations based on their own analysts and assets.

Together, these solutions allow Darktrace / NETWORK to go beyond the traditional approach to NDR and shift teams to a more hardened and proactive stance.

Protecting Clients with Continued Innovation

Darktrace invests heavily in Research and Development to continue providing customers with market-leading NDR capabilities and innovations, which was reflected in our position in the Leader category of the MarketScape report for both capabilities and strategy. We are led by the needs and challenges of our customers, which serve as the driving force behind our continued innovation and leadership in the NDR market. The IDC MarketScape report underlines this approach with the following feedback presented by Darktrace customers:

“A customer intimated that 99% of their detections were OOTB with little need to tune or define parameters.”
“A customer reported that it had early warnings for adversarial tactics such as suspicious SMB scanning, suspicious remote execution, remote desktop protocol (RDP) scanning, data exfiltration, C2C, LDAP query, and suspicious Kerberos activity.”
“The client could use Regex to determine if suspicious behavior was found elsewhere on the network.”

Thousands of customers around the world across all industries and sectors rely on Darktrace / NETWORK to protect against known and novel threats. From the latest vulnerabilities in network hardware to sophisticated new strains of ransomware and everything in-between, Darktrace helps clients detect and respond to all types of threats affecting their networks and avoid business disruption, even from the latest attacks.

Find out more about the unique capabilities of Darktrace / NETWORK and our application of AI in network security in the IDC MarketScape excerpt.

References

  1. IDC MarketScape: Worldwide Network Detection and Response 2024 Vendor Assessment (Doc #US51752324, November 2024)
  2. Darktrace Cyber AI Analyst Customer Fleet Data
Continue reading
About the author
Mikey Anderson
Product Manager, Network Detection & Response
Your data. Our AI.
Elevate your network security with Darktrace AI