Blog
OT
Why the 'Air Gap' is Not Enough to Keep Your OT Systems Resilient
At a Glance:
- Air gaps reduce cyber risk, but they do not prevent modern cyber attacks
- Having visibility into an air-gapped network is better than assuming your defenses are impenetrable and having zero visibility
- Darktrace can provide visibility and resiliency without jeopardizing the integrity of the air gap
What is an 'Air Gap'?
Information technology (IT) needs to fluidly connect with the outside world in order channel a flow of digital information across everything from endpoints and email systems to cloud and hybrid infrastructures. At the same time, this high level of connectivity makes IT systems particularly vulnerable to cyber-attacks.
Operational technology (OT), which controls the operations of physical processes, are considerably more sensitive. OT often relies on a high degree of regularity to maintain continuity of operations. Even the slightest disturbance can lead to disastrous results. Just a few seconds of delay on a programmable logic controller (PLC), for example, can significantly disrupt a manufacturing assembly line, leading to downtime at a considerable cost. In worst-case scenarios, disruptions to OT can even threaten human safety.
An air gap is a ‘digital moat’ where data cannot enter or leave OT environments unless it is transferred manually.
Organizations with OT have traditionally tried to reconcile this conflict between IT and OT by attempting to separate them completely. Essentially, the idea is to let IT do what IT does best — facilitate activities like communication and data transfer at rapid speeds, thus allowing people to connect with each other and access information and applications in an efficient capacity. But at the same time, erect an air gap between IT and OT so that any cyber threats that slip into IT systems do not then spread laterally into highly sensitive, mission-critical OT systems. This air gap is essentially a ‘digital moat’ where data cannot enter or leave OT environments unless it is transferred manually.
Limitations of the Air Gap
The air gap approach makes sense, but it is far from perfect. First, many organizations that believe they have completely air-gapped systems in fact have unknown points of IT/OT convergence, that is, connections between IT and OT networks of which they are unaware.
Many organizations today are also intentionally embracing IT/OT convergence to reap the benefits of digital transformation of their OT, in what is often called Industry 4.0. Examples include the industrial cloud (or ICSaaS), the industrial internet of things (IIoT), and other types of cyber-physical systems that offer increased efficiency and expanded capabilities when compared to more traditional forms of OT. Organizations may also embrace IT/OT convergence due to a lack of human capital, as convergence can make processes simpler and more efficient.
Even when an organization does have a true air gap (which is nearly impossible to confirm without full visibility across IT and OT environments), the fact is that there are a variety of ways for attackers to ‘jump the air gap'. Full visibility across IT and OT ecosystems in a single pane of glass is thus essential for organizations seeking to secure their OT. This is not only to illuminate any points of IT/OT convergence and validate the fact that an air gap exists in the first place, but also to see when an attack slips through the air gap.
.png)
Air Gap Attack Vectors
Even a perfect air gap will be vulnerable to a variety of different attack vectors, including (but not limited to) the following:
- Physical compromise: An adversary bypasses physical security and gains access directly to the air-gapped network devices. Physical access is by far the most effective and obvious technique.
- Insider threats: Someone who is part of an organization and has access to air-gapped secure systems intentionally or unintentionally compromises a system.
- Supply chain compromise: A vendor with legitimate access to air-gapped systems unwittingly is compromised and brings infected devices into a network.
- Misconfiguration: Misconfiguration of access controls or permissions allows an attacker to access the air-gapped system through a separate device on the network.
- Social engineering (media drop): If an attacker was able to successfully conduct a malicious USB/media drop and an employee was to use that media within the air-gapped system, the network could be compromised.
- Other advanced tactics: Thermal manipulation, covert surface vibrations, LEDs, ultrasonic transmissions, radio signals, and magnetic fields are among a range of advanced tactics documented and demonstrated by researchers at Ben Gurion University.
Vulnerabilities of Air-Gapped Systems
Aside from susceptibility to advanced techniques, tactics, and procedures (TTPs) such as thermal manipulation and magnetic fields, more common vulnerabilities associated with air-gapped environments include factors such as unpatched systems going unnoticed, lack of visibility into network traffic, potentially malicious devices coming on the network undetected, and removable media being physically connected within the network.
Once the attack is inside OT systems, the consequences can be disastrous regardless of whether there is an air gap or not. However, it is worth considering how the existence of the air gap can affect the time-to-triage and remediation in the case of an incident. For example, the existence of an air gap may seriously limit an incident response vendor’s ability to access the network for digital forensics and response.
Kremlin Hackers Jumping the Air Gap
In 2018, the U.S. Department of Homeland Security (DHS) issued an alert documenting the TTPs used by Russian threat actors known as Dragonfly and Energetic Bear. Further reporting alleged that these groups ‘jumped the air gap,’ and, concerningly, gained the ability to disable the grid at the time of their choosing.
These attackers successfully gained access to sensitive air-gapped systems across the energy sector and other critical infrastructure sectors by targeting vendors and suppliers through spear-phishing emails and watering hole attacks. These vendors had legitimate access to air-gapped systems, and essentially brought the infection into these systems unintentionally when providing support services such as patch deployment.
This incident reveals that even if a sensitive OT system has complete digital isolation, this robust air gap still cannot fully eliminate one of the greatest vulnerabilities of any system—human error. Human error would still hold if an organization went to the extreme of building a faraday cage to eliminate electromagnetic radiation. Air-gapped systems are still vulnerable to social engineering, which exploits human vulnerabilities, as seen in the tactics that Dragonfly and Energetic Bear used to trick suppliers, who then walked the infection right through the front door.
Ideally, a technology would be able to identify an attack regardless of whether it is caused by a compromised supplier, radio signal, or electromagnetic emission. By spotting subtle deviations from a device, human, or network’s normal ‘pattern of life’, Self-Learning AI detects even the most nuanced forms of threatening behavior as they emerge — regardless of the source or cause of the threat.
Darktrace/OT for Air-Gapped Environments
Darktrace/OT for air-gapped environments is a physical appliance that deploys directly to the air-gapped system. Using raw digital data from an OT network to understand the normal pattern of life, Darktrace/OT does not need any data or threat feeds from external sources because the AI builds an innate understanding of self without third-party support.
Because all data-processing and analytics are performed locally on the Darktrace appliance, there is no requirement for Darktrace to have a connection out to the internet. As a result, Darktrace/OT provides visibility and threat detection to air-gapped or highly segmented networks without jeopardizing their integrity. If a human or machine displays even the most nuanced forms of threatening behavior, the solution can illuminate this in real time.
Security professionals can then securely access Darktrace alerts from anywhere within the network, using a web browser and encrypted HTTPS, and in line with your organization’s network policies.
With this deployment, Darktrace offers all the critical insights demonstrated in other Darktrace/OT deployments, including (but not limited to) the following:
- Illuminating all points of IT/OT convergence, including unknown points of IT/OT convergence in ‘air gapped’ environments
- OT network visibility across all Purdue Levels to the field controller level
- OT asset inventory
- CVE tracking
- Identification of new devices on the network, first seen devices, and last seen active devices
- Threat response and incident reporting that the IT team, security professionals, operators, and engineering can easily read
Organizations seeking to validate whether they have an air gap in the first place and maintain the air gap as their IT and OT environments evolve will greatly benefit from the comprehensive visibility and continuous situational awareness offered by Darktrace’s Self-Learning AI. Also, organizations looking to poke holes in their air gap to embrace the benefits of IT/OT convergence will find that Self-Learning AI’s vigilance spots cyber-attacks that slip through.
Whatever your organizations goals—be it embracing IIoT or creating a full-blown DMZ—by learning ‘you’, Darktrace’s Self-Learning AI can help you achieve them safely and securely.
Credit to: Daniel Simonds and Oakley Cox for their contribution to this blog.
Like this and want more?
More in this series
Blog
Inside the SOC
PurpleFox in a Henhouse: How Darktrace Hunted Down a Persistent and Dynamic Rootkit
Versatile Malware: PurpleFox
As organizations and security teams across the world move to bolster their digital defenses against cyber threats, threats actors, in turn, are forced to adopt more sophisticated tactics, techniques and procedures (TTPs) to circumvent them. Rather than being static and predictable, malware strains are becoming increasingly versatile and therefore elusive to traditional security tools.
One such example is PurpleFox. First observed in 2018, PurpleFox is a combined fileless rootkit and backdoor trojan known to target Windows machines. PurpleFox is known for consistently adapting its functionalities over time, utilizing different infection vectors including known vulnerabilities (CVEs), fake Telegram installers, and phishing. It is also leveraged by other campaigns to deliver ransomware tools, spyware, and cryptocurrency mining malware. It is also widely known for using Microsoft Software Installer (MSI) files masquerading as other file types.
The Evolution of PurpleFox
The Original Strain
First reported in March 2018, PurpleFox was identified to be a trojan that drops itself onto Windows machines using an MSI installation package that alters registry values to replace a legitimate Windows system file [1]. The initial stage of infection relied on the third-party toolkit RIG Exploit Kit (EK). RIG EK is hosted on compromised or malicious websites and is dropped onto the unsuspecting system when they visit browse that site. The built-in Windows installer (MSIEXEC) is leveraged to run the installation package retrieved from the website. This, in turn, drops two files into the Windows directory – namely a malicious dynamic-link library (DLL) that acts as a loader, and the payload of the malware. After infection, PurpleFox is often used to retrieve and deploy other types of malware.
Subsequent Variants
Since its initial discovery, PurpleFox has also been observed leveraging PowerShell to enable fileless infection and additional privilege escalation vulnerabilities to increase the likelihood of successful infection [2]. The PowerShell script had also been reported to be masquerading as a .jpg image file. PowerSploit modules are utilized to gain elevated privileges if the current user lacks administrator privileges. Once obtained, the script proceeds to retrieve and execute a malicious MSI package, also masquerading as an image file. As of 2020, PurpleFox no longer relied on the RIG EK for its delivery phase, instead spreading via the exploitation of the SMB protocol [3]. The malware would leverage the compromised systems as hosts for the PurpleFox payloads to facilitate its spread to other systems. This mode of infection can occur without any user action, akin to a worm.
The current iteration of PurpleFox reportedly uses brute-forcing of vulnerable services, such as SMB, to facilitate its spread over the network and escalate privileges. By scanning internet-facing Windows computers, PurpleFox exploits weak passwords for Windows user accounts through SMB, including administrative credentials to facilitate further privilege escalation.
Darktrace detection of PurpleFox
In July 2023, Darktrace observed an example of a PurpleFox infection on the network of a customer in the healthcare sector. This observation was a slightly different method of downloading the PurpleFox payload. An affected device was observed initiating a series of service control requests using DCE-RPC, instructing the device to make connections to a host of servers to download a malicious .PNG file, later confirmed to be the PurpleFox rootkit. The device was then observed carrying out worm-like activity to other external internet-facing servers, as well as scanning related subnets.
Darktrace DETECT™ was able to successfully identify and track this compromise across the cyber kill chain and ensure the customer was able to take swift remedial action to prevent the attack from escalating further.
While the customer in question did have Darktrace RESPOND™, it was configured in human confirmation mode, meaning any mitigative actions had to be manually applied by the customer’s security team. If RESPOND had been enabled in autonomous response mode at the time of the attack, it would have been able to take swift action against the compromise to contain it at the earliest instance.
Attack Overview
Initial Scanning over SMB
On July 14, 2023, Darktrace detected the affected device scanning other internal devices on the customer’s network via port 445. The numerous connections were consistent with the aforementioned worm-like activity that has been reported from PurpleFox behavior as it appears to be targeting SMB services looking for open or vulnerable channels to exploit.
This initial scanning activity was detected by Darktrace DETECT, specifically through the model breach ‘Device / Suspicious SMB Scanning Activity’. Darktrace’s Cyber AI Analyst™ then launched an autonomous investigation into these internal connections and tied them into one larger-scale network reconnaissance incident, rather than a series of isolated connections.
As Darktrace RESPOND was configured in human confirmation mode, it was unable to autonomously block these internal connections. However, it did suggest blocking connections on port 445, which could have been manually applied by the customer’s security team.
Privilege Escalation
The device successfully logged in via NTLM with the credential, ‘administrator’. Darktrace recognized that the endpoint was external to the customer’s environment, indicating that the affected device was now being used to propagate the malware to other networks. Considering the lack of observed brute-force activity up to this point, the credentials for ‘administrator’ had likely been compromised prior to Darktrace’s deployment on the network, or outside of Darktrace’s purview via a phishing attack.
Exploitation
Darktrace then detected a series of service control requests over DCE-RPC using the credential ‘admin’ to make SVCCTL Create Service W Requests. A script was then observed where the controlled device is instructed to launch mshta.exe, a Windows-native binary designed to execute Microsoft HTML Application (HTA) files. This enables the execution of arbitrary script code, VBScript in this case.
There are a few MSIEXEC flags to note:
- /i : installs or configures a product
- /Q : sets the user interface level. In this case, it is set to ‘No UI’, which is used for “quiet” execution, so no user interaction is required
Evidently, this was an attempt to evade detection by endpoint users as it is surreptitiously installed onto the system. This corresponds to the download of the rootkit that has previously been associated with PurpleFox. At this stage, the infected device continues to be leveraged as an attack device and scans SMB services over external endpoints. The device also appeared to attempt brute-forcing over NTLM using the same ‘administrator’ credential to these endpoints. This activity was identified by Darktrace DETECT which, if enabled in autonomous response mode would have instantly blocked similar outbound connections, thus preventing the spread of PurpleFox.
Installation
On August 9, Darktrace observed the device making initial attempts to download a malicious .PNG file. This was a notable change in tactics from previously reported PurpleFox campaigns which had been observed utilizing .MOE files for their payloads [3]. The .MOE payloads are binary files that are more easily detected and blocked by traditional signatured-based security measures as they are not associated with known software. The ubiquity of .PNG files, especially on the web, make identifying and blacklisting the files significantly more difficult.
The first connection was made with the URI ‘/test.png’. It was noted that the HTTP method here was HEAD, a method similar to GET requests except the server must not return a message-body in the response.
The metainformation contained in the HTTP headers in response to a HEAD request should be identical to the information sent in response to a GET request. This method is often used to test hypertext links for validity and recent modification. This is likely a way of checking if the server hosting the payload is still active. Avoiding connections that could possibly be detected by antivirus solutions can help keep this activity under-the-radar.
The server responds with a status code of 200 before the download begins. The HEAD request could be part of the attacker’s verification that the server is still running, and that the payload is available for download. The ‘/test.png’ HEAD request was sent twice, likely for double confirmation to begin the file transfer.
Subsequent analysis using a Packet Capture (PCAP) tool revealed that this connection used the Windows Installer user agent that has previously been associated with PurpleFox. The device then began to download a payload that was masquerading as a Microsoft Word document. The device was thus able to download the payload twice, from two separate endpoints.
By masquerading as a Microsoft Word file, the threat actor was likely attempting to evade the detection of the endpoint user and traditional security tools by passing off as an innocuous text document. Likewise, using a Windows Installer user agent would enable threat actors to bypass antivirus measures and disguise the malicious installation as legitimate download activity.
Darktrace DETECT identified that these were masqueraded file downloads by correctly identifying the mismatch between the file extension and the true file type. Subsequently, AI Analyst was able to correctly identify the file type and deduced that this download was indicative of the device having been compromised.
In this case, the device attempted to download the payload from several different endpoints, many of which had low antivirus detection rates or open-source intelligence (OSINT) flags, highlighting the need to move beyond traditional signature-base detections.
If Darktrace RESPOND was enabled in autonomous response mode at the time of the attack it would have acted by blocking connections to these suspicious endpoints, thus preventing the download of malicious files. However, as RESPOND was in human confirmation mode, RESPOND actions required manual application by the customer’s security team which unfortunately did not happen, as such the device was able to download the payloads.
Conclusion
The PurpleFox malware is a particularly dynamic strain known to continually evolve over time, utilizing a blend of old and new approaches to achieve its goals which is likely to muddy expectations on its behavior. By frequently employing new methods of attack, malicious actors are able to bypass traditional security tools that rely on signature-based detections and static lists of indicators of compromise (IoCs), necessitating a more sophisticated approach to threat detection.
Darktrace DETECT’s Self-Learning AI enables it to confront adaptable and elusive threats like PurpleFox. By learning and understanding customer networks, it is able to discern normal network behavior and patterns of life, distinguishing expected activity from potential deviations. This anomaly-based approach to threat detection allows Darktrace to detect cyber threats as soon as they emerge.
By combining DETECT with the autonomous response capabilities of RESPOND, Darktrace customers are able to effectively safeguard their digital environments and ensure that emerging threats can be identified and shut down at the earliest stage of the kill chain, regardless of the tactics employed by would-be attackers.
Credit to Piramol Krishnan, Cyber Analyst, Qing Hong Kwa, Senior Cyber Analyst & Deputy Team Lead, Singapore
Appendices
Darktrace Model Detections
- Device / Increased External Connectivity
- Device / Large Number of Connections to New Endpoints
- Device / SMB Session Brute Force (Admin)
- Compliance / External Windows Communications
- Anomalous Connection / New or Uncommon Service Control
- Compromise / Unusual SVCCTL Activity
- Compromise / Rare Domain Pointing to Internal IP
- Anomalous File / Masqueraded File Transfer
RESPOND Models
- Antigena / Network / Significant Anomaly / Antigena Breaches Over Time Block
- Antigena / Network / External Threat / Antigena Suspicious Activity Block
- Antigena / Network / Significant Anomaly / Antigena Significant Anomaly from Client Block
- Antigena / Network / Significant Anomaly / Antigena Enhanced Monitoring from Client Block
- Antigena / Network / External Threat / Antigena Suspicious File Block
- Antigena / Network / External Threat / Antigena File then New Outbound Block
List of IoCs
IoC - Type - Description
/C558B828.Png - URI - URI for Purple Fox Rootkit [4]
5b1de649f2bc4eb08f1d83f7ea052de5b8fe141f - File Hash - SHA1 hash of C558B828.Png file (Malware payload)
190.4.210[.]242 - IP - Purple Fox C2 Servers
218.4.170[.]236 - IP - IP for download of .PNG file (Malware payload)
180.169.1[.]220 - IP - IP for download of .PNG file (Malware payload)
103.94.108[.]114:10837 - IP - IP from Service Control MSIEXEC script to download PNG file (Malware payload)
221.199.171[.]174:16543 - IP - IP from Service Control MSIEXEC script to download PNG file (Malware payload)
61.222.155[.]49:14098 - IP - IP from Service Control MSIEXEC script to download PNG file (Malware payload)
178.128.103[.]246:17880 - IP - IP from Service Control MSIEXEC script to download PNG file (Malware payload)
222.134.99[.]132:12539 - IP - IP from Service Control MSIEXEC script to download PNG file (Malware payload)
164.90.152[.]252:18075 - IP - IP from Service Control MSIEXEC script to download PNG file (Malware payload)
198.199.80[.]121:11490 - IP - IP from Service Control MSIEXEC script to download PNG file (Malware payload)
MITRE ATT&CK Mapping
Tactic - Technique
Reconnaissance - Active Scanning T1595, Active Scanning: Scanning IP Blocks T1595.001, Active Scanning: Vulnerability Scanning T1595.002
Resource Development - Obtain Capabilities: Malware T1588.001
Initial Access, Defense Evasion, Persistence, Privilege Escalation - Valid Accounts: Default Accounts T1078.001
Initial Access - Drive-by Compromise T1189
Defense Evasion - Masquerading T1036
Credential Access - Brute Force T1110
Discovery - Network Service Discovery T1046
Command and Control - Proxy: External Proxy T1090.002
References
- https://blog.360totalsecurity.com/en/purple-fox-trojan-burst-out-globally-and-infected-more-than-30000-users/
- https://www.trendmicro.com/en_us/research/19/i/purple-fox-fileless-malware-with-rookit-component-delivered-by-rig-exploit-kit-now-abuses-powershell.html
- https://www.akamai.com/blog/security/purple-fox-rootkit-now-propagates-as-a-worm
- https://www.foregenix.com/blog/an-overview-on-purple-fox
- https://www.trendmicro.com/en_sg/research/21/j/purplefox-adds-new-backdoor-that-uses-websockets.html
Blog
OT
$70 Million in Cyber Security Funding for Electric Cooperatives & Utilities
What is the Bipartisan Infrastructure Deal?
The Bipartisan Infrastructure Law passed by congress in 2021 aimed to upgrade power and infrastructure to deliver clean, reliable energy across the US to achieve zero-emissions. To date, the largest investment in clean energy, the deal will fund new programs to support the development and deployment of clean energy technology.
Why is it relevant to electric municipalities?
Section 40124 of the Bipartisan Infrastructure Law allocates $250 million over a 5-year period to create the Rural and Municipal Utility Cybersecurity (RMUC) Program to help electric cooperative, municipal, and small investor-owned utilities protect against, detect, respond to, and recover from cybersecurity threats.1 This act illuminates the value behind a full life-cycle approach to cyber security. Thus, finding a cyber security solution that can provide all aspects of security in one integrated platform would enhance the overall security posture and ease many of the challenges that arise with adopting multiple point solutions.
On November 16, 2023 the Office of Cybersecurity, Energy Security, and Emergency Response (CESER) released the Advanced Cybersecurity Technology (ACT) for electric utilities offering a $70 million funding opportunity that aims to enhance the cybersecurity posture of electric cooperative, municipal, and small investor-owned utilities.
Funding Details
10 projects will be funded with application submissions due November 29, 2023, 5:00 pm ET with $200,000 each in cash prizes in the following areas:
- Direct support for eligible utilities to make investments in cybersecurity technologies, tools, training, and improvements in utility processes and procedures;
- Funding to strengthen the peer-to-peer and not-for-profit cybersecurity technical assistance ecosystem currently serving eligible electric utilities; and
- Increasing access to cybersecurity technical assistance and training for eligible utilities with limited cybersecurity resources. 2
To submit for this award visit: https://www.herox.com/ACT1Prize
How can electric municipalities utilize the funding?
While the adoption of hybrid working patterns increase cloud and SaaS usage, the number of industrial IoT devices also continues to rise. The result is decrease in visibility for security teams and new entry points for attackers. Particularly for energy and utility organizations.
Electric cooperatives seeking to enhance their cyber security posture can aim to invest in cyber security tools that provide the following:
Compliance support: Consider finding an OT security solution that maps out how its solutions and features help your organization comply with relevant compliance mandates such as NIST, ISA, FERC, TSA, HIPAA, CIS Controls, and more.
Anomaly based detection: Siloed security solutions also fail to detect attacks that span
the entire organization. Anomaly-based detection enhances an organization’s cyber security posture by proactively defending against potential attacks and maintaining a comprehensive view of their attack surface.
Integration capabilities: Implementation of several point solutions that complete individual tasks runs the risk of increasing workloads for operators and creates additional challenges with compliance, budgeting, and technical support. Look for cyber security tools that integrate with your existing technologies.
Passive and active asset tracking: Active Identification offers accurate enumeration, real time updates, vulnerability assessment, asset validation while Passive Identification eliminates the risk of operational disruption, minimizes risk, does not generate additional network traffic. It would be ideal to find a security solution that can do both.
Can secure both IT and OT in unison: Given that most OT cyber-attacks actually start in IT networks before pivoting into OT, a mature security posture for critical infrastructure would include a single solution for both IT and OT. Separate solutions for IT and OT present challenges when defending network boundaries and detecting incidents when an attacker pivots from IT to OT. These independent solutions also significantly increase operator workload and materially diminish risk mitigation efforts.
Darktrace/OT for Electric Cooperatives and Utilities
For smaller teams with just one or two dedicated employees, Darktrace’s Cyber AI Analyst and Investigation features allow end users to spend less time in the platform as it compiles critical incidents into comprehensive actionable event reports. AI Analyst brings all the information into a centralized view with incident reporting in natural language summaries and can be generated for compliance reports specific to regulatory requirements.
For larger teams, Darktrace alerts can be forwarded to 3rd party platforms such as a SIEM, where security team decision making is augmented. Additionally, executive reports and autonomous response reduce the alert fatigue generally associated with legacy tools. Most importantly, Darktrace’s unique understanding of normal allows security teams to detect zero-days and signatureless attacks regardless of the size of the organization and how alerts are consumed.
Key Benefits of Darktrace/OT
- Anomaly-based detection and real-time response
- Secures IT, OT, and IoT in unison
- Active and Passive Asset Identification
- Automated security reporting
- Attack surface management and vulnerability assessment
- Covers all levels of the Purdue Model
References
