Nationwide Resilient Communications System (N RCS)
Kickoff Meeting
Document 9 - Attachment 1
Matt Wakefield, (mwakefield@epri.com) Director, Information, Communication and Cyber Security, EPRI Ben Sooter, (bsooter@epri.com) Program Manager, Cyber Security, EPRI Rodney O'Bryant, (raobryan@southernco.com), EMS General Manager, Southern Company Tom Galloway, (tgalloway@natf.com) President and CEO of North American Transmission Forum Jesse Sythe, (jesse.sythe@eisac.om) GridEx Program Manager, Electricity Information Sharing and Analysis Center Tim Godfrey, (tgodfrey@epri.com) Senior Technical Executive, Telecommunications, EPRI Jay Herman, (jherman@epri.com) Principal Technical Leader, Telecommunications, EPRI
Click on three dots "..."
Select "Slido" to take the poll Select "Content" to download Presentation
O Slido (polli and Q&A)
Wednesday, January 22, 2025
Use the Chat throughout the presentation
e Content
www.epri.com I 2025 Electric Power Research Institute, Inc. All rights reserved.
3
0
Sierra Club v. Dept of Energy, 4:25-cv-5027
SC_EVERSPLIT0021081
Agenda
Background
Why a Nationwide Resilient Communications System is Needed
Project overview Review findings of prior work Fundamental requirements Discussion & Call to Action
2025 Electric Power Research Institute, Inc All rights reserved.
Sierra Club v. Dept of Energy, 4:25-cv-5027
SC_EVERSPLIT0021082
Background
Sierra Club v. Dept of Energy, 4:25-cv-5027
SC_EVERSPLIT0021083
Black Sky Events & Hazards (Man Made and Natural)
A Black Sky event: An extraordinary, hazardous event producing large,
regional infrastructure disruptions that last significantly longer than typical weather or operational outages.
It impacts electricity, natural gas, water, wastewater treatment, telecommunications and transportation services
.11=4I-a4. EMP -- High Altitude Electromagnetic Pulse IEMI -- Intentional Electromagnetic Interference Cyber Terrorism -- Recently, Salt Typhoon Coordinated Physical Assault Wildfires Seismic Event -- High Magnitude Earthquake GMD -- Geomagnetic Disturbance (Severe Space Weather)
Hurricanes and Other Severe Weather Events
ti
Hurricane Maria -- Puerto Rico
What Critical Capabilities do We Need to Recover the Grid?
4
2025 Electric Power Research Institute, Inc. All rights reserved.
C. .1 121
Sierra Club v. Dept of Energy, 4:25-cv-5027
SC_EVERSPLIT0021084
NATF Spare Tire Project - Voice & Data Communication Needs
External voice communications 2. Internal voice communications 3. Area Contru. ,_,, (ACE) calc,tation 4. Frequency telemetry s. Transmission system monitoring and control 6. Generation dispatch and Automatic Generation Control (AGC) 7. Personnel deployment ("human Remote Terminal Unit (RTU")) 8. State estimation/real-time contingency analysis 9. Interchange scheduling 10. Off-line power flow analysis ii. Load and wind forecasting
El( -1
71-- fErilt =""
Communications are Critical to Recover from a Black Sky Event
5
2025 Electric Power Research Institute, Inc. All rights reserved.
Sierra Club v. Dept of Energy, 4:25-cv-5027
SC_EVERSPLIT0021085
Black Sky Communications - Why Important
No nationwide, coordinated technical communication solution exists today Increasing natural and man-made threats Existing Emergency Communication Solutions Challenges:
Many individual satellite phones are dependent on ground stations & commercial carriers -- which are assumed to be down in a black sky event Don't natively provide multi-party conference calls Are not interoperable with primary and backup communications WE NEED
Y U There is a growing need to establish a nationwide solution EPRI Approach - Industry Collaboration: Formalize Engineering & Design Spec to Meet Nationwide Requirements
Inform a Phase 2 Buildout and Operational Sustainment Plan
2025 Electric Power Research Institute, Inc All rights reserved.
Sierra Club v. Dept of Energy, 4:25-cv-5027
SC_EVERSPLIT0021086
I:II:=15!IIIMI2ii
E-ISAC ELECTRICITY
INFORMATION SHARING AND ANALYSIS CENTER
Resilient Communications Project Update
Jesse Sythe E-ISAC GridEx Program Manager
TLP:CLEAR
RELIABILITY I RESILIENCE I SECURITY
Sierra Club v. Dept of Energy, 4:25-cv-5027
SC_EVERSPLIT0021087
A DIVISION Of NERC
E-ISAC ELECTRICITY
INFORMATION SHARING AND ANALYSIS CENTER
GridEx V, VI, and VII identified gaps in communication:
Project Background
Expanding the type of information communicated.
2. Need for increased resilience of existing communications channels.
Importance of clear roles in crisis communications plans.
Large-scale events strain grid monitoring and control capabilities.
For the past three GridEx iterations, over
60% of the recommendations have
been related to communication.
Sierra Club v. Dept of Energy, 4:25-cv-5027
RELIABILITY I RESILIENCE I SECURIT
SC_EVERSPLIT0021088
E-ISAC ELECTRICITY
INFORMATION SHARING AND ANALYSIS CENTER
Project Objectives
im.inh eft
Define resilient communications challenges that ESCC leadership faces during large scale incidents
9
Assess the current state of communications platforms and processes by reviewing existing policies and interviewing industry leaders
Develop recommendations to close the gap between the current state of communications platforms and processes, with the communication capability desired by ESCC leadership
Sierra Club v. Dept of Energy, 4:25-cv-5027
RELIABILITY I RESILIENCE I SECURIT
SC_EVERSPLIT0021089
A DIVISION Of NE RC
E-ISAC ELECTRICITY
INFORMATION SHARING AND ANALYSIS CENTER
Initial Findings
Existing NA-wide coordination processes do not adequately reflect communications needs during major events
Familiarity with these coordination processes varies widely Communication tools currently in use vary widely There is no single "minimum viable product" PACE planning should be incorporated into these coordination processes, recognizing
technological flexibility and optionality will be key to ensuring continuity of operations
Final report February 2025
Primary Alternate Contingency
Emergency
The best, and intended, methods of communications Another common, but less optimal method Method may not be as fast, convenient or reliable, but can accomplish the task
Communication method of last resort. Emergency methods may cause delays or otherwise affect operations
RELIABILITY I RESILIENCE I SECURI
Sierra Club v. Dept of Energy, 4:25-cv-5027
SC_EVERSPLIT0021090
Project Overview
Sierra Club v. Dept of Energy, 4:25-cv-5027
SC_EVERSPLIT0021091
EPRI National Resilient Communications Project
Black Sky Event
tio An event producing large, N regional infrastructure
disruptions of long
_c duration
U
N Impacts electricity, natural _c gas, water, wastewater
treatment, telecommunications and transportation services
Communications is essential to enable restoration and black start
4-; Independent of
Commercial
UU Communication Solutions
C Capable of operating for weeks without an external
C power source
0 4J Hardened against Black Sky
hazards
0 (1)
Inexpensive enough to be
stationed &/or mobilized
to critical nodes
Interoperable with other existing systems & Scalable -- Regionally, Nationally
Permanent Fixed Stations
0 (Intended for ECCs, EOCs, ;73 and other large critical 0 facilities)
Estimated station cost $400K
-0 Plus site improvements and installation
0 Equipment Bill of Materials
(BOM)
0 VSAT GEO terminal
LEO terminals
HF base station and antenna
Interoperability bridge
Leverage extended duration emergency power from host facility
Funding Strategy
EPRI and group of utilities develop requirements as a supplemental project. Establish core deployment sites ready to commit to cost share Socialize concept with DOE, NATF, NERC, and other organizations and stakeholders
Prepare proposal for GRIP 3.0 FOA
Transpoil Comm Systems Options
Mutualink WAN
2025 Electric Power Research Institute, Inc. All rights reserved.
Sierra Club v. Dept of Energy, 4:25-cv-5027
J 21 SC_EVERSPLIT0021092
Proposed Project Tasks
Phase 1 (This project)
Requirements Definition
Determine min viable
RFI/RFP
Design Spec
Phase 2 (Follow-on project)
Pause Gain Industry Feedback to determine Next
Ste s
Phase 2 Options
Pursue DOE GRIP 3.0 Proposal
(if it comes out)
Pursue Industry Led Nationwide
Solution
1
2025 Electric Power Research Institute, Inc rights reserved.
Sierra Club v. Dept of Energy, 4:25-cv-5027
SC_EVERSPLIT0021093
Reasons to Participate
Increased resiliency of the bulk electric system due to reduced likelihood of major communications outages
Define requirements and a technical specification to provide an NRCS capability.
Demonstrate NERC/CIP compliance with regulations and standards around emergency and alternative communications.
COM-001-3 Alternative Interpersonal Communication capability
Common methods of compliance may not be enough
14
2025 Electric Power Research Institute, Inc All rights reserved.
Image by Al
Sierra Club v. Dept of Energy, 4:25-cv-5027
SC_EVERSPLIT0021094
EPRI Nationwide Resilient Communications Solution (NRCS) project
Objectives and Scope Define requirements for a minimum viable system.
Ca.c t. i.c:2 dots Select "Slido" to take the poll
Select "Content" to download Presentation & Pro ect Overviews
Completely independent of commercial service providers but can interoperate with terrestrial service providers and internet when and if available.
g and Q&A)
Issue vendor RFI/RFP's and produce a design specification. Value
Increased resiliency of the bulk electric system Improve understanding of requirements and the technology necessary to provide an NRCS capability. Contribute to an ability to demonstrate NERC/CIP compliance with regulations and standards around emergency and alternative communications. Deliverables Documented Requirements for a NRCS Inform Phase 2 -- Buildout and Sustainable Operational Plan
https://www.epri.com/research/products/000000003002031079
Membership $45k
9 Months duration
Q1
Q2-Q4
Industry Awareness & feedback
Open Webcasts
Project duration
Member Only
Participation
Contacts
EPRI Customer Assistance center, askeori@eori.corn Jay Herman, Project Lead, iherman@epri.com Tim Godfrey, 1CT, tqodfrev@epri.corn Matt Wakefield, ICCS, mwakefield@epri.corn
Interdependency and the black sky hazard has been recognized as a key vulnerability by the DOE
15
2025 Electric Power Research Institute, IN,- All rigits reserved.
ar=lal
Sierra Club v. Dept of Energy, 4:25-cv-5027
SC_EVERSPLIT0021095
Review Findings of Prior Work
Sierra Club v. Dept of Energy, 4:25-cv-5027
SC_EVERSPLIT0021096
ESCC Resilient Communications Working Group (RCWG) Demo
Problem Statement
Resilient communication systems that BES operators presently have, in addition to their primary and backup systems, are mostly individual satellite phones which allow point to point communications to either other satellite phones or operating commercial phone systems. These satellite phones do not natively support multi-party conference call and are not interoperable with the primary and backup communications.
Approach
Identification of the essential electric grid functions and emergency communication requirements A short-term demonstration of COTS technologies that have the potential to satisfy the requirements for a resilient emergency communications capability.
EPRI Report: Resilient Communication Demonstration Project: Demonstration Evaluation Report
ID 2025 Electric Power Research Institute, Inc All rights reserved.
Sierra Club v. Dept of Energy, 4:25-cv-5027
SC_EVERSPLIT0021097
ESCC RCWG Demo Project Needs Assessment
Support four stages of restoration:
Stage 1 - Initial "all-call" ..of Transmission Owner/Operator (TO/TOP) control centers with Regional Balancing Authorities (BAs) or Reliability Coordinators (RCs)
Stage 2 - Visibility into the substations ..that are essential to establishing an initial picture of grid status and behavior. These substations reside at the intersection of primary transmission corridors or load pockets
Stage 3 - Execution of Black Start Plans for grid restoration. This is the first tier where persistent connectivity to individual generation sites for dispatch is required, given the level of system visibility (albeit limited) into the current state of the system
Stage 4 - At this critical stage of restoration
..when voltage flows and balancing are still volatile, tie-line and substations monitoring is essential for the restoration to the next tier of priority loads following black start critical loads. This category can include life support infrastructure systems such as water/wastewater, natural gas bulk delivery systems, and the commercial communications backbone.
2025 Electric Power Research Institute, Inc All rights reserved.
Sierra Club v. Dept of Energy, 4:25-cv-5027
SI=12I SC_EVERSPLIT0021098
ESCC RCWG Demo Project Stakeholder Identification
Stage 1 through 4 requires resilient communications between the following stakeholders: a) Transmission Owner/Operator
(TO/TOP) control centers b) Regional Balancing Authorities (BA)
or Reliability Coordinators (RC) c) A subset of generators d) A subset of substations e) Critical loads
Image by AI
19
2025 Electric Power Research Institute, Inc. All rights reserved.
al=121
Sierra Club v. Dept of Energy, 4:25-cv-5027
SC_EVERSPLIT0021099
ESCC RCWG Demo Solution Design Considerations
Survivability, Interoperability, Scalability, Maintainability, Deploy-ability
Investigated temporary deployment of two types of COTS solutions:
Emergency Communication Solution -- a private network communications equipment, systems that provide full-duplex, real-time, point-to-point, voice channels at distances of up to 1,000 miles without requiring additional terrestrial infrastructure.
lnteroperability Solution -- consisting of distributed components that provide the functionality of bridging (conference call) and gateway (interconnection and/or extension of different communications paths).
Survivability
Scalability
Interoperability
Maintainability
Deploy-ability
2025 Electric Power Research Institute, Inc. All rights reserved.
Sierra Club v. Dept of Energy, 4:25-cv-5027
Er=la SC_EVERSPLIT0021100
ESCC RCWG Demonstration System Architecture
NYPA
Satellite
Transport Media Types
Southern
Transport Caroms Systems Options
PJM
Mutualudi WAN
4 FM )
Voice/Data communications 42g Interface
taa
_ Voice/Data communications Interface
iaitt 'sae*
4 !Rio
SUS .
EPRI Report:
Resilient Communication Demonstration
Demonstration Evaluation Report
2025 Electric Power Research Institute, Inc. All rights reserved.
Sierra Club v. Dept of Energy, 4:25-cv-5027
SC_EVERSPLIT0021101
ESCC RCWG Demonstration Project Key Learnings
Two-hop broadband GEO satellite link NOT dependent on Ground stations were effective
A network of point-to-point, two-hop*, broadband GEO satellite links created an effective backbone for reliable, low latency, voice communications between the three core sites across long distances.
An interoperability solution enabled connectivity to communication systems as they recover
The common interoperability solution at the core sites was effective in connecting with and bridging a variety of edge site communications technologies (Inmarsat BGAN, Iridium, Globalstar, LMR, and POTS.
Use of COTS enabled using standard interfaces and protocols
All technologies and vendors selected were COTS and integration used standard interfaces and protocols; however, a lab or factory integration test was not performed but likely would have improved results.
HF Radio Network was effective, but further investigation against requirements is needed
HF radio network with remote base stations and NOC was effective in connecting to individual sites and between pairs of sites; however, the three-way connection between the core sites was not established using ALE and a contributing factor was inadequate operator training on the use of the radio consoles.
LEO terminals have physical unobstructed view requirements
LEO terminals (both mobile handheld and fixed station) require an expansive, 360 degree unobstructed view towards the horizon for reliable communications.
* No reliance on satellite operators' ground stations, gateways, commercial carriers
1=121
Sierra Club v. Dept of Energy, 4:25-cv-5027
SC_EVERSPLIT0021102
Fundamental Requirements
Sierra Club v. Dept of Energy, 4:25-cv-5027
SC_EVERSPLIT0021103
Requirements Definition Approach
Start with findings from previous work
Refine and clarify, but avoid scope creep
v
Formal requirements definition likely not needed if continue restriction to COTS
solutions
Natural language requirements statements will be developed
24
2025 Electric Power Research Institute, Inc. All rights reserved.
Sierra Club v. Dept of Energy, 4:25-cv-5027
C!='21 SC_EVERSPLIT0021104
Baseline Fundamental functional requirements
Communications component
Provides one or more voice channels (VoIP) Full-duplex capabilities (simultaneous talk/listen) Real-time experience (one-way latency less than
500 ms preferable) Simultaneous connection and operation between
multiple* distant locations (scalable with tiered architecture to greater numbers for potential post-demo pilot project followed by wide-scale industry adoption) Continuous communications after initial setup and link establishment, i.e. channel remains open with no user actions (e.g. push to talk, dialing or other signaling) necessary to talk or listen
Interoperability component
Bridging of multiple (min. number TBD) selected voice communications channels to provide conference call functionality
Interconnection of two selected voice communications channels to provide extension of one remote channel to a second remote channel
Interface with minimum number (TBD ) of voice communications channels
* Based on agreed-upon minimum viable deployment
2025 Electric Power Research Institute, Inc All rights reserved.
Or=121
Sierra Club v. Dept of Energy, 4:25-cv-5027
SC_EVERSPLIT0021105
Initial Requirements Based on Prior Project
Verizon Frontline
OwMomistoet
26
Set II
Satellite
Transport Media Types
HF
Transport Comms Systems Options
k
Interoperability Component
voice/Data communications
Interface
Voice/Data communications Interface
SUB
626so.
an
Highly Resilient and Widely Scalable
2025 Electric Power Research Institute, Inc All rights reserved.
Sierra Club v. Dept of Energy, 4:25-cv-5027
Internet Private Fiber Local Wireline Telephone Service Providers
SC_EVERSPLIT0021106
Discussion
Sierra Club v. Dept of Energy, 4:25-cv-5027
SC_EVERSPLIT0021107
Considerations & Discussion Items
Discussion Items
What other requirements should be considered for a minimum viable solution?
Technical Requirements Industry Stakeholder Requirements
What other Stakeholders should be engaged in this effort?
Beyond NERC /CIP are you subject to any state/local/PUC requirements for communications resiliency?
Considerations for you
Have you done a self-assessment on your emergency communications for a Black Sky Event?
Have you analyzed external entities on different systems where public communications service provider networks are used?
Enter Comments in the Chat or Unmute yourself to Speak
28
2025 Electric Power Research Institute, Inc. All rights reserved.
ar=121
Sierra Club v. Dept of Energy, 4:25-cv-5027
SC_EVERSPLIT0021108
Previous Vendors for the RFP and Demo
Communications Component
Globalstar Inc Intelsat Stallion Oilfield Services (Intelsat VAR) Collins Aerospace - Urgentlink Blue Sky Networks LLC (Iridium)
Interoperability Component
Mutualink
Are there other Vendors to Consider for a COTS solution?
Enter Comments in the Chat or Unmute Yourself
Image by Al
29
2025 Electric Power Research Institute, Inc. All rights reserved.
al=1-21
Sierra Club v. Dept of Energy, 4:25-cv-5027
SC_EVERSPLIT0021109
Final Discussion and Feedback
Communication Resiliency Self-Assessment Key Item
Sagan! intitlar 1
Determining Minimum Viable Implementation
Balancing Authority
Areas
a tit
NI I
"1=tr.' I
qatinpingl Opt
Stall
PUN /Morel
Call for Action -- We Need Critical Mass Participation for a True Nationwide Solution Please respond to the Poll if interested
30
2025 Electric Power Research Institute, Inc. All rights reserved.
Sierra Club v. Dept of Energy, 4:25-cv-5027
SC_EVERSPLIT0021110
EPRI Nationwide Resilient Communications Solution (NRCS) project
Objectives and Scope Define requirements for a minimum viable system.
Click oil Ciiree dots ... Select "Slido" to take the poll
Completely independent of commercial service providers but can interoperate with terrestrial service providers and internet when and if available.
Issue vendor RFI/RFP's and produce a design specification. Value
Increased resiliency of the bulk electric system Improve understanding of requirements and the technology necessary to provide an NRCS capability. Contribute to an ability to demonstrate NERC/CIP compliance with regulations and standards around emergency and alternative communications. Deliverables Documented Requirements for a NRCS Inform Phase 2 -- Buildout and Sustainable Operational Plan
https://www.epri.com/research/products/000000003002031079
,,,IN. '111 ,T4
t.i,OareN;N.c$gWuraa..n....w.......
k's lli
ii,
i
.....eA. MSEMpaOrtlyMr.SiPtaIIfIfMil.i itIII.I1IIII1N!SSFliteirbaille
I f or
i---frit! Is:** r -fer
Slido (polls g and Q&A)
e Content
Membership $45k
9 Months duration
Q1
Q2-Q4
Industry Awareness & feedback
Open Webcasts
Project duration
Member Only Participation
Contacts
EPRI Customer Assistance center, askeori@eori.corn Jay Herman, Project Lead, iherman@epri.com Tim Godfrey, 1CT, tqodfrev@epri.corn Matt Wakefield, ICCS, mwakefield@epri.corn
Interdependency and the black sky hazard has been recognized as a key vulnerability by the DOE
31
2025 Electric Power Research Institute, IN,- All rigits reserved.
Sierra Club v. Dept of Energy, 4:25-cv-5027
SC_EVERSPLIT0021111
TOGETHER...SHAPING THE FUTURE OF ENERGY
in x f
www.epri.com
20Z4 Electric Power Research Institute, Inc. All rights reserved
Sierra Club v. Dept of Energy, 4:25-cv-5027
SC_EVERSPLIT0021112