Blog
/
No items found.
/
June 21, 2018
No items found.

Unsupervised Machine Learning and JA3 for Enhanced Security

Default blog imageDefault blog imageDefault blog imageDefault blog imageDefault blog imageDefault blog image
21
Jun 2018
Unlock the true power of Darktrace's algorithms. Learn how JA3 enhances cybersecurity defenses with unique TLS/SSL fingerprints & unsupervised machine learning.

Introducing JA3

JA3 is a methodology for fingerprinting Transport Layer Security applications. It was first posted on GitHub in June 2017 and is the work of Salesforce researchers John Althouse, Jeff Atkinson, and Josh Atkins. The JA3 TLS/SSL fingerprints created can overlap between applications but are still a great Indicator of Compromise (IoC). Fingerprinting is achieved by creating a hash of 5 decimal fields of the Client Hello message that is sent in the initial stages of an TLS/SSL session.

JA3 is an interesting approach to the increasing usage of encryption in networks. There is also a clear uptick in cyber-attacks using encrypted command and control (C2) channels – such as HTTPS – for malware communication.

The benefits of JA3 for enhancing rules-and-signatures security

These near-unique fingerprints can be used to enhance traditional cyber security approaches such as whitelisting, deny-listing, and searching for IoCs.

Let’s take the following JA3 hash for example: 3e860202fc555b939e83e7a7ab518c38. According to one of the public lists that maps JA3s to applications, this JA3 hash is associated with the ‘hola_svc’ application. This is the infamous Hola VPN solution that is non-compliant in most enterprise networks. On the other hand, the following hash is associated with the popular messenger software Slack: a5aa6e939e4770e3b8ac38ce414fd0d5. Traditional cyber security tools can use these hashes like traditional signatures to search for instances of them in data sets or trying to deny-list malicious ones.

While there is some merit to this approach, it comes with all the known limitations of rules-and-signatures defenses, such as the overlaps in signatures, the inability to detect unknown threats, as well as the added complexity of having to maintain a database of known signatures.

JA3 in Darktrace

Darktrace creates JA3 hashes for every TLS/SSL connection it encounters. This is incredibly powerful in a number of ways. First, the JA3 can add invaluable context to a threat hunt. Second, Darktrace can also be queried to see if a particular JA3 was encountered in the network, thus providing actionable intelligence during incident response if JA3 IoCs are known to the incident responders.

Things become much more interesting once we apply our unsupervised machine learning to JA3: Darktrace’s AI algorithms autonomously detect which JA3s are anomalous for the network as a whole and which JA3s are unusual for specific devices.

It basically tells a cyber security expert: This JA3 (3e860202fc555b939e83e7a7ab518c38) has never been seen in the network before and it is only used by one device. It indicates that an application, which is used by nobody else on the network, is initiating TLS/SSL connections. In our experience, this is most often the case for malware or non-compliant software. At this stage, we are observing anomalous behavior.

Darktrace’s AI combines these IoCs (Unusual Network JA3, Unusual Device JA3, …) with many other weak indicators to detect the earliest signs of an emerging threat, including previously unknown threats, without using rules or hard-coded thresholds.

Catching Red-Teams and domain fronting with JA3

The following is an example where Darktrace detected a Red-Team’s C2 communication by observing anomalous JA3 behavior.

The unsupervised machine learning algorithms identified a desktop device using a JA3 that was 100% unusual for the network connecting to an external domain using a Let’s Encrypt certificate, which, along with self-signed certificates, is often abused by malicious actors. As well as the JA3, the domain was also 100% rare for the network – nobody else visited it:

It turned out that a Red-Team had registered a domain that was very similar to the victim’s legitimate domain: www.companyname[.]com (legitimate domain) vs. www.companyname[.]online (malicious domain). This was intentionally done to avoid suspicion and human analysis. Over a 7-day period in a 2,000-device environment, this was the only time that Darktrace flagged unusual behavior of this kind.

As the C2 traffic was encrypted (therefore no intrusion detection was possible on the payload) and the domain was non-suspicious (no reputation-based deny-listing worked), this C2 had remained undetected by the rest of the security stack.

Combining unsupervised machine learning with JA3 is incredibly powerful for the detection of domain fronting. Domain fronting is a popular technique to circumvent censorship and to hide C2 traffic. While some infrastructure providers take action to prevent domain fronting on their end, it is still prevalent and actively used by attackers.

The only agreed-upon method within wide parts of the cyber-security community to detect domain fronting appears to be TLS/SSL inspection. This usually involved breaking up encrypted communication to inspect the clear-text payloads. While this works, it commonly involves additional infrastructure, network restructuring and comes with privacy issues – especially in the context of GDPR.

Unsupervised machine learning makes the detection of domain fronting without having to break up encrypted traffic possible by combining unusual JA3 detection with other anomalies such as beaconing. A good start for a domain fronting threat hunt? A device beaconing to an anomalous CDN with an unusual JA3 hash.

Conclusion

JA3 is not a silver bullet to pre-empt malware compromise. As a signature-based solution, it shares the same limitations of all other defenses that rely on pre-identified threats or deny-lists: having to play a constant game of catch-up with innovative attackers. However, as a novel means of identifying TLS/SSL applications, JA3 hashing can be leveraged as a powerful network behavioral indicator, an additional metric that can flag the use of unauthorized or risky software, or as a means of identifying emerging malware compromises in the initial stages of C2 communication. This is made possible through the power of unsupervised machine learning.

Inside the SOC
Darktrace cyber analysts are world-class experts in threat intelligence, threat hunting and incident response, and provide 24/7 SOC support to thousands of Darktrace customers around the globe. Inside the SOC is exclusively authored by these experts, providing analysis of cyber incidents and threat trends, based on real-world experience in the field.
Author
Max Heinemeyer
Chief Product Officer

Max is a cyber security expert with over a decade of experience in the field, specializing in a wide range of areas such as Penetration Testing, Red-Teaming, SIEM and SOC consulting and hunting Advanced Persistent Threat (APT) groups. At Darktrace, Max is closely involved with Darktrace’s strategic customers & prospects. He works with the R&D team at Darktrace, shaping research into new AI innovations and their various defensive and offensive applications. Max’s insights are regularly featured in international media outlets such as the BBC, Forbes and WIRED. Max holds an MSc from the University of Duisburg-Essen and a BSc from the Cooperative State University Stuttgart in International Business Information Systems.

Book a 1-1 meeting with one of our experts
Share this article

More in this series

No items found.

Blog

/

December 12, 2024

/
No items found.

Company Shuts Down Cyber-attacks with “Flawless” Detection and Response from Darktrace

Default blog imageDefault blog image

Growing pains: Balancing efficiency with risk  

This organization has recently scaled its operations, and numerous acquisitions have significantly boosted the organization’s capabilities and growth. However, this also creates work and high expectations for the organization’s IT and security teams. Within 12 months of an acquisition, the teams must fully integrate each new business onto the company’s platform. “A huge piece of that integration plan is rolling out our security controls,” said the CISO. “While our goal is to connect those facilities up as quickly as possible to drive efficiency, we also need to implement the proper security controls to protect the enterprise.”

Gap beyond the perimeter  

The organization had established strong security measures to safeguard its perimeter; however, the CISO identified a critical gap in real-time network monitoring. If the perimeter were breached, threats were only discovered after an endpoint was compromised and the issue was manually reported.

As digital transformation progresses, the need to adopt advanced technologies is becoming essential, particularly as organizations begin to open up operational environments to greater connectivity. Many processes still rely on traditional methods, and integrating innovative solutions could drive significant improvements in efficiency and productivity. “We’re committed to adopting cutting-edge technologies,” the CISO explained. “But we understood that without more robust network security controls, opening up our operational environments would expose us to heightened risks, including advanced threats like ransomware.”

Building a layered, proactive security strategy with Darktrace  

To close the gap beyond the perimeter, the company embarked on a free trial with Darktrace. The CISO recalls: “The trials were fantastic. It was obvious that Darktrace was exactly what we needed. The Darktrace team was also very knowledgeable and helpful throughout the process, which was impressive.”  

Today, the organization is using a combination of Darktrace solutions for its layered security approach, including:

Detecting unusual behavior with AI  

Darktrace’s use of machine learning and Self-Learning AI is one of the reasons the company chose Darktrace. Instead of teaching an AI system what an ‘attack’ looks like, training it on large data lakes of thousands of organizations’ data, Darktrace AI learns from the company’s own unique data and user activity to learn and create baseline models of what ‘normal’ looks like for their business.

Darktrace can then detect subtle deviations and unusual activity that signals a possible threat. “That fascinated us because what it really means is this technology doesn’t need to know about every single threat because the threat itself isn’t important, it’s the behavior of the activity that’s important. That capability is unique when it when it comes to threat detection,” said the CISO.

Identifying and mitigating high-impact attack paths

The security team appreciated that with Darktrace they could take a more proactive approach to security by exposing high-risk attack paths through modeling and AI risk assessments. Darktrace / Proactive Exposure Management gives them visibility into vulnerable entry points and assets, identifies active risks, and prioritizes the most important security issues to be addressed.

“Specific users and assets within our business have a higher risk of being targeted by a cyber-attack, for example our executives,” said the CISO. “With Darktrace, we get an adversarial view of our risk. We can see the attack path around those potential targets and proactively take measures to mitigate that vulnerability and prevent an attack.”

Driving up productivity while putting the brakes on cyber-attacks  

The security team collaborated with Darktrace to fine tune the models that really fit their business. With Darktrace now automating most of their threat detection and response efforts, productivity has soared, the security team is now focused on delivering greater value to the business and, most importantly, Darktrace proved it could quickly detect and shut down a major cyber-attack–and do so without impacting business operations.

Fueling team productivity with automation and AI

Prior to using Darktrace, the security team had little visibility into potential risks beyond the perimeter. Today, the team has full control and visibility over the network. “My team is now spending 80-90% of their time doing proactive work because Darktrace is managing the vast majority of our detect and response needs. The team really has faith in the Darktrace system,” said the CISO.  

With less time spent on low-level manual tasks, the security team can now focus on higher priority initiatives. For example, they have expanded their internal vulnerability assessments across the entire group. The team couldn’t focus on this additional audit and vulnerability management work if Darktrace wasn’t taking care of most of their security monitoring. “Darktrace has allowed us to move on to these additional kinds of governance projects that we otherwise would have to hire an army of staff to get through”.

Stopping email threats in their tracks

Using Darktrace / EMAIL, the company has identified and blocked a significant percentage of emails that were making it past their native email filters. “Darktrace is especially good at detecting impersonation emails, and we really appreciate its ability to automatically remove suspicious emails directly from a user’s inbox. It adds an extra level of confidence,” said the CISO.

Self-Learning AI understands anomalies within unique communication patterns to stop known and unknown threats. For example, when an employee sent an email to a brand new domain, Darktrace identified the behavior as unusual and inconsistent with baseline models and blocked the email.

Darktrace passes the biggest test of all

In 2024, the company experienced the value of the security system firsthand when attackers exploited a vulnerability in a third-party remote support solution that they was using. This solution provided remote access and tech support capabilities. If successful, the attackers could have infiltrated high-value end points and created their own administrative user, giving them full control over the server.

“We first became aware of the attack when Darktrace notified us of unusual behavior coming from the remote support server,” said the CISO. The attackers were attempting to put backdoors onto the service with the intent of selling access to the highest bidder who would then install ransomware on their servers. It all happened very quickly, as the attackers tried to connect to the internal network and other servers, while also firing off a host of other actions, like PowerShell commands, to escalate their privileges.  

“Darktrace worked flawlessly. There was no chance that ransomware was ever going to come in,” the CISO said. “Even though there was no signature to really look at, Darktrace realized this was not normal behavior for this server, shutting down connections and doing everything it could do to stop the attack.” Within eight hours, the security team identified and stopped the attack, severed its connection to the third-party solution, and completed additional analysis and clean-up. “In addition to our own investigation, third parties like our external SOC and legal department also confirmed that Darktrace performed as expected. We were able to report back to the executive team that there was zero risk that any data or systems were compromised.”

Post-attack, there was no need to make any changes to Darktrace. The team consistently reviews its models and baselines, often collaborating with Darktrace to make adjustments when needed to continuously improve performance. “Because of this relationship and constant engagement with Darktrace’s technical teams, we didn't have to go back and ask: ‘why wasn’t this updated’ or ‘why didn’t this model work.’ The models worked.”

His advice to other organizations facing similar challenges? First, focus on updating, patching, and vulnerability management, and act quickly when vulnerabilities are identified. His second piece of advice: “have an automated detection system like Darktrace in place so you can respond at the speed that these attacks evolve. Humans can no longer keep up with a scripted attack as it moves around and tries to compromise items on your network. You need the right technology to fight these types of attacks.”

Dynamic capabilities for a dynamic future

Real-time playbooks

With a proactive, enterprise-wide security strategy in place, the CISO now has the time to think about future projects and innovations. He’s particularly interested in the idea of generating playbooks on the fly in response to real-time events. He believes cyber-attacks are far too varied for a static playbook to be useful; when an attack strikes, teams need to quickly understand exactly what’s in front of them and how to shut it down. “This fits into our future cybersecurity strategy, and Darktrace is the only company I’ve seen talking about building playbooks dynamically. This kind of technology would really help bring our cybersecurity strategy full circle.”

“Darktrace ’s technology, experience and expertise is helping us staying ahead of cyber-attacks, minimizing our risk and driving greater productivity for our team,” said the CISO. In collaboration with Darktrace, the team have created a security foundation that is both powerful and agile. “While Darktrace is detecting and responding to attacks targeting our business today, we know that it’s always learning, adapting and scaling to ensure we’re protected tomorrow. That gives me peace of mind and the freedom to focus on our future.”

Download the Darktrace / NETWORK Solution Brief

Darktrace / NETWORK solution brief screenshot

Protect in real time: Defend against known and emerging threats without relying on historical data or external intelligence.

Full visibility: Gain comprehensive insights across all network environments, including on-premises, cloud, and remote devices.

AI-powered efficiency: Streamline incident response with AI automation, saving time and resources while ensuring minimal disruption to operations.

Continue reading
About the author
The Darktrace Community

Blog

/

December 11, 2024

/
No items found.

Darktrace is Positioned as a Leader in the IDC MarketScape: Worldwide Network Detection and Response 2024 Vendor Assessment

Default blog imageDefault blog image

Darktrace is pleased to announce that we have been positioned as a Leader in the IDC MarketScape: Worldwide Network Detection and Response 2024 Vendor Assessment. We believe this further highlights Darktrace’s position as a pioneer in the NDR market and follows similar recognition from KuppingerCole, who recently named Darktrace as an Overall Leader, Product Leader, Market Leader and Innovation Leader in the KuppingerCole Leadership Compass: Network Detection and Response (2024).

Network Detection and Response (NDR) solutions are uniquely positioned to provide visibility over the core hub of a business and employee activity, analyzing North-South and East-West traffic to identify threats across the modern network. NDR provides a rich and true source of anomalies and goes beyond process level data that is relied on by Endpoint Detection and Response (EDR) agents that do not provide network level visibility and can be misconfigured at any time.1

Metadata from network traffic can be used to detect a variety of different threats based on events such as anomalous port usage, unusual upload/download activity, impossible travel and many other activities. This has been accelerated by the increased usage of user behavioral analytics (UBA) in network security, which establishes statistical baselines about network entities and highlights deviations from expected activity.1

Darktrace is recognized as a Leader in the IDC MarketScape due to our leadership in the market and our pioneering leadership in AI over the past decade, alongside a variety of other unique differentiators and innovations in the NDR industry.

Darktrace / NETWORK™ delivers full visibility, real time threat detection and Autonomous Response capabilities across an organization’s on-premises, cloud, hybrid and virtual environments, including remote worker endpoints.

Unique Approach to AI

Most NDR vendors and network security tools such as IDS/IPS rely on detecting known attacks with historical data and supervised machine learning, leaving organizations blind and vulnerable to novel threats such as zero-days, variants of known attacks, supply chain attacks and insider threats.

These vendors also tend to apply AI models that are trained globally, and are not unique to each organization’s environment, which creates a high number of false positives and alerts that ultimately lack business context.

The IDC MarketScape recognizes that Darktrace takes a differentiated approach in the market with regards to delivering network detection and response capabilities, noting; “Darktrace is unique in that it does not rely on rules and signatures but rather learns what constitutes as normal for an organization and generates alerts when there is a deviation.”1

Darktrace / NETWORK achieves this through the use of Self-Learning AI and unsupervised machine learning to understand what is normal network behavior, continuously analyzing, mapping and modeling every connection to create a full picture of devices, identities, connections and potential attack paths. Darktrace Self-Learning AI autonomously optimizes itself to cut through the noise and quickly surface genuine, prioritized network security incidents – significantly reducing false positives and removing the hassle of needing to continually tuning alerts manually.

Darktrace’s unique approach to AI also extends to the investigation and triage of network alerts with Cyber AI Analyst. Unlike a chat or prompt based LLM, Cyber AI Analyst investigates all relevant alerts in an environment, including third party alerts, autonomously forming hypotheses and reaching conclusions just like a human analyst would, accelerating SOC Level 2 analyses of incidents by 10x. Cyber AI Analyst also typically providing SOC teams with up to 50,000 additional hours annually of Level 2 analysis producing high level alerts and written reporting, transforming security operations.2

Darktrace also uses its deep understanding of what is normal for a network to identify suspicious behavior, leveraging Autonomous Response capabilities to shut down both known and novel threats in real time, taking targeted actions without disrupting business operations. Darktrace / NETWORK is the only NDR solution that can autonomously enforce a pattern of life based on what is normal for a standalone device or group of peers, rapidly containing and disarming threats based on the overall context of the environment and a granular understanding of what is normal for a device or user – instead of relying on historical attack data.

Continued NDR Market Leadership

Darktrace has been recognized as a Leader in the NDR market, and the IDC MarketScape listed a variety of strengths:

  • Darktrace achieves roughly one-fifth of all global NDR revenue. This is important because other IT and cybersecurity solutions providers necessarily want to have integration with Darktrace.
  • The AI algorithms that Darktrace uses for NDR have had 10 years of deployments, tuning, and learning to draw from.
  • Darktrace is available as a SaaS, as an enterprise license, and as physical, hybrid, or virtual appliances. Darktrace also offers an endpoint agent and visibility into VPN and ZTNA.
  • Darktrace integrates with 30+ different interfaces including SIEM, SOAR, XDR platforms, IT ticketing solutions, and their own dashboards. The Darktrace Threat Visualizer highlights events and incidents from the entire deployment including cloud, apps, email, endpoint, zero trust, network, and OT.
  • Darktrace / NETWORK charts the progress that the SOC is making over time with key metrics such as MTTD/MTTR, alerts generated and processed, and other criteria.
  • Darktrace reported coverage of 14 MITRE ATT&CK categories, 158 techniques, and 184 subtechniques

Proactive Network Resilience

The IDC MarketScape notes, “Ultimately, NDR shines as a standalone detection and response technology but is especially powerful when combined with other platforms. NDR in combination with other control points such as endpoint, data, identity, and application provides the proper context when winnowing alerts and trying to uncover a single source of truth.” . Darktrace comprehensively addresses this as part of the ActiveAI Security Platform, by combining network alerts with data from / EMAIL, / IDENTITY, / ENDPOINT, / CLOUD and / OT, providing deeper contextual analysis for each network alert and automatically enriching investigations.

Darktrace also goes beyond NDR solutions with capabilities that are closely linked to our NDR offering, helping clients to achieve and maintain a state of proactive network resilience:

  • Darktrace / Proactive Exposure Management – look beyond just CVE risks to discover, prioritize and validate risks by business impact and how to address them early, reducing the number of real threats that security teams need to handle.
  • Darktrace / Incident Readiness & Recovery – lets teams respond in the best way to each incident and proactively test their familiarity and effectiveness of IR workflows with sophisticated incident simulations based on their own analysts and assets.

Together, these solutions allow Darktrace / NETWORK to go beyond the traditional approach to NDR and shift teams to a more hardened and proactive stance.

Protecting Clients with Continued Innovation

Darktrace invests heavily in Research and Development to continue providing customers with market-leading NDR capabilities and innovations, which was reflected in our position in the Leader category of the MarketScape report for both capabilities and strategy. We are led by the needs and challenges of our customers, which serve as the driving force behind our continued innovation and leadership in the NDR market. The IDC MarketScape report underlines this approach with the following feedback presented by Darktrace customers:

“A customer intimated that 99% of their detections were OOTB with little need to tune or define parameters.”
“A customer reported that it had early warnings for adversarial tactics such as suspicious SMB scanning, suspicious remote execution, remote desktop protocol (RDP) scanning, data exfiltration, C2C, LDAP query, and suspicious Kerberos activity.”
“The client could use Regex to determine if suspicious behavior was found elsewhere on the network.”

Thousands of customers around the world across all industries and sectors rely on Darktrace / NETWORK to protect against known and novel threats. From the latest vulnerabilities in network hardware to sophisticated new strains of ransomware and everything in-between, Darktrace helps clients detect and respond to all types of threats affecting their networks and avoid business disruption, even from the latest attacks.

Find out more about the unique capabilities of Darktrace / NETWORK and our application of AI in network security in the IDC MarketScape excerpt.

References

  1. IDC MarketScape: Worldwide Network Detection and Response 2024 Vendor Assessment (Doc #US51752324, November 2024)
  2. Darktrace Cyber AI Analyst Customer Fleet Data
Continue reading
About the author
Mikey Anderson
Product Manager, Network Detection & Response
Your data. Our AI.
Elevate your network security with Darktrace AI