texas nodal eds market trials approach wednesday, november 29, 2006
DESCRIPTION
Texas Nodal EDS Market Trials Approach Wednesday, November 29, 2006. Agenda. Market Trials Objectives High Level Schedule EDS Phases EDS Timeline / Detailed Drill Down EDS Detailed Planning Define Transition Plan Traceability Matrix Detail Market Trial Phases and Test Areas - PowerPoint PPT PresentationTRANSCRIPT
http://nodal.ercot.com 1Lead from the front
Texas Nodal
Texas Nodal
EDS Market Trials ApproachWednesday, November 29, 2006
http://nodal.ercot.com 2Lead from the front
Texas Nodal
Agenda
• Market Trials Objectives• High Level Schedule• EDS Phases• EDS Timeline / Detailed Drill Down• EDS Detailed Planning
– Define Transition Plan Traceability Matrix– Detail Market Trial Phases and Test Areas– Create Entrance / Exit Criteria Checklists– Define Test Cycles, MP Segmentation, and Test Calendars– Outline Market Trials reporting requirements
• Next Steps– Market Trials Approach comments and approval– Detail out specific sections and review with TPTF– Tentative Schedule
http://nodal.ercot.com 3Lead from the front
Texas Nodal
Objective of market trials
The objective of market trials is to confirm through a series of structured and unstructured tests that:
“stable and accurate operations of the SCADA, Network Security Analysis, Transmission Constraint Management, SCED, LFC, DAM, RUC, and real time settlement system can be declared”
as outlined in the Nodal Transition Plan.
http://nodal.ercot.com 4Lead from the front
Texas Nodal
Approach aligns with the Nodal Timeline
http://nodal.ercot.com 5Lead from the front
Texas Nodal
Market Trials Phases
• EDS 1 – Data and Telemetry• EDS 2 – State Estimator, Network Security Analysis• EDS 3 – Real Time Market Operations• EDS 4 – Day Ahead Market Operations
http://nodal.ercot.com 6Lead from the front
Texas Nodal
EDS - Market Trials Timeline
EDS 3
Jul 08 Dec 08Sep 08Aug 08Mar 08Feb 08Jan 08 May 08 Jun 08Dec 07 Oct 08 Nov 08Apr 08
Cycle 1 LMP w
Controls
ACE
DR Testing
Compliance
1 hr EECP
Comment Period
ACE – 2 weeks (5.4.8 (2)Compare existing with new ACE results
LMP Market Readiness
Criteria
MET
12/01/08 Realtime
Markets GO LIVE
`12/08/08
Forward Markets GO LIVE
Zonal Markets Shutdown
GO/NO GO
Nov 07
Market Operations Sandbox & ERCOT UAT
Market Trials Start
Resource Registration
All QSEs – Real Time Parallel Operations
AS Qualification
3/31/08 Single Entry
Model GO LIVE
Reasonable LMPs24x7 support
All available MPsReasonableness criteria met
6 months
Oct 07
EDS 4
Feedback
168 hour test
complete
168 Hour Test – 4 weeks to complete; 4 week feedback-fix
168 hour trial
Go-Live & Transition
Jul 07 Sep 07Aug 07May 07 Jun 07
ICCP / Telemetry Validation
SE Validation
SCED testing cycles, voluntary per QSE scripted for 30 daysThereafter all QSEs participate in real time parallel operations
EDS 2
EDS 1
Market Operations Sandbox & ERCOT UAT EDS 4 - Day Ahead Operations
Limited 24x7 support Full 24x7 support
Market Operations Functional Testing
http://nodal.ercot.com 7Lead from the front
Texas Nodal
Market Trials Timeline and the detailed Market Trials Plan
http://nodal.ercot.com 3Lead from the front
Texas Nodal
EDS - Market Trials Timeline
EDS 3
Jul 08 Dec 08Sep 08Aug 08Mar 08Feb 08Jan 08 May 08 Jun 08Dec 07 Oct 08 Nov 08Apr 08
Cycle 1 LMP w
Controls
ACE
DR Testing
Compliance
1 hr EECP
Comment Period
ACE – 2 weeks (5.4.8 (2)Compare existing with new ACE results
LMP Market Readiness
Criteria
MET
12/01/08
Realtime Markets
GO LIVE
`12/08/08
Forward Markets
GO LIVEZonal Markets
Shutdown
GO/NO GO
Nov 07
Market Operations Sandbox & ERCOT UAT
Market Trials Start
Resource Registration
All QSEs – Real Time Parallel Operations
AS Qualification
3/31/08 Single Entry
Model
GO LIVE
Reasonable LMPs24x7 support
All available MPsReasonableness criteria met
6 months
Oct 07
EDS 4
Feedback
168 hour test
complete
168 Hour Test – 4 weeks to complete; 4 week feedback-fix
168 hour trial
Go-Live & Transition
Jul 07 Sep 07Aug 07May 07 Jun 07
ICCP / Telemetry Validation
SE Validation
SCED testing cycles, voluntary per QSE scripted for 30 daysThereafter all QSEs participate in real time parallel operations
EDS 2
EDS 1
Market Operations Sandbox & ERCOT UAT EDS 4 - Day Ahead Operations
Limited 24x7 support Full 24x7 support
http://nodal.ercot.com 1Lead from the front
Texas Nodal
The budget is significantly influenced by the recommended timelineNodal Market & Zonal Shutdown December 2008
EMS
Trials & Implementation
MMS
CRR
MIS
NMMS
Commercial Systems
ERCOT & MP Readiness
Q2 2008 Q3 2009Q4 2008Q3 2008Q2 2007Q1 2007Q4 2006 Q4 2007 Q1 2008Q3 2006 Q1 2009
Integration
EDW
Q2 2009
EDS 3
MMS FAT ITEST
CRR Design, Bui ld, Pre -FAT CRR FAT ITEST
Final MP Interface
Specs 3/31
12/01/08Real Time Operations
GO LIVE
MIS (EMS/MMS/CRR) Design, Build, Pre -FAT
EDW FAT ITEST
StatementsLayout
Script tes t
ITESTEMS EMS FATEMS Requirements, Conceptual Design
ITESTMIS (SCED) Des ign, Build, Pre -
FAT MIS FAT
MMS Design, Build, Pre -FATMMS
Requirements, Conceptual Des ign
ITEST
OS Build
FAT
OS Requirements , Conceptual Des ign
CRR Requirements , Conceptual Design
Commercial Sys tems Design, Build, Pre -FAT CS FAT ITEST
EDW Requirements, Conceptual Design
ITESTSCED Build SCED FATSCED
Requirements, Conceptual Des ign
Registration ready
Bus iness Requirements
complete 10/30
Preliminary MP Interface Specs 12/31
CS Requirements, Conceptual Design
EDW Des ign, Build, Pre-FAT
MIS FAT ITEST
EDS 4 Go-live Trans .
EDS 3 Mote & ERCOT UAT
Planning UI
FAT ITEST
Naming Convention DB
Common model update processNMMS Conceptual Design
Naming Convention information collec tion
Model Data Certification Model Data Remediation Reconcil iation
NMMS Build
Outage Scheduler
EDS 1/2
Build FAT ITESTRequirements, Conceptual Design
ITESTOS FAT
6/30/08LMP Market
Readiness Criteria
MET
Q3 2007
Operations UI
Qualification Freeze
Registration complete
168 hour market trials
windowEnd of Trials
MP Nodal Registration MP Financ ial & Operational Qualification
MPSCED Offers
Begin MP trial
partic ipation
3/31/08Single Entry Model
GO LIVE12/08/08
Day Ahead Market/CRR
GO LIVEZonal Shutdown
GO/NO GO
EDS 3 Training
See detailed EDS 1 & 2 plan
See detailed EDS 3 plan
See detailed EDS 4 plan
http://nodal.ercot.com 13Lead from the front
Texas Nodal
Market Trials Transition Plan Alignment
5.4.1(2) ERCOT shall develop procedures for setup and data implementation requirements applicable to TSPs and QSEs. ERCOT shall with the assistance of TSPs and QSEs:
(a) Verify that all data and telemetry requirements specified
in the nodal Protocols Section 3.10, Network Operations Modeling and Telemetry, have been met and that all data submittals are complete and represent an accurate model of the ERCOT System;
Transition Plan Requirement
Day ahead market4
1-2-08 - MPs submit offers
Real-time market3
3-31-08 – Single entry model go-live
EDS 2 - Assumption: Involves Network Operations Model (only - not planning) and SE/NSA; no outage evaluation/approval
- S.UC2.OP1: Update RT Generation/Transmission Data (EMS Operation)- S.UC2.OP2: Update Transmission Ratings (EMS Operation)- S.UC2.OP3: Implement Proposed Plan (EMS Operation)- S.UC3.OP1: Update Information (NMMS Operation)- S.UC3.OP2: Analyze Solution (NMMS Operation "Send Network Operations Model"
Network model validation
2
This is a joint ERCOT and Market Participant task.
Will require a EDS type functionality from TSP/QSE
QSE/TSP personnel can SIMULATE analog/digital changes on their EDS and ERCOT EDS will be able to accomplish point-to-point check out with ERCOT operatorsExplore programmatic way to validate – this approach can be used later for periodic verification.
12-31-06 –Preliminary MP Interface Specs
3-30-07 – Final Interface Specs
EDS 1 - Assumption: only testing data coming in FROM the fieldICCP-related operations I can think of:- S.UC1.OP1: Update Frequency (EMS operation)- S.UC1.OP3: Update Generation Levels (EMS Operation)- S.UC1.OP5: Update Responsiveness Information (EMS Operation)- S.UC1.OP6: Update QSE Provider Information (EMS Operation)
- S.UC1.OP7: Use Revised Data (EMS Operation)- S.UC1.OP8: Use Telemetry Data (EMS Operation)
- S.UC2.OP1: Update RT Generation/Transmission Data (EMS Operation)- S.UC2.OP2: Update Transmission Ratings (EMS Operation)ICCP information TO the field (external):- S.UC2.OP4: Send Base Points- M.UC12.OP1: Clear RT Market (I know Base Points are communicated to QSEs via ICCP, will need to check which other ones do)
Telemetry & ICCP Validation
1
NotesMP Interventions
Use Case/ OperationsDescriptionEDS
Detailed market trials
plan
Nodal Critical Path
Appendix 8.2
Appendix 8.4
Appendix 8.3
See detailed EDS 3 plan
http://nodal.ercot.com 3Lead from the front
Texas Nodal
EDS - Market Trials Timeline
EDS 3
Jul 08 Dec 08Sep 08Aug 08Mar 08Feb 08Jan 08 May 08 Jun 08Dec 07 Oct 08 Nov 08Apr 08
Cycle 1 LMP w
Controls
ACE
DR Testing
Compliance
1 hr EECP
Comment Period
ACE – 2 weeks (5.4.8 (2)Compare existing with new ACE results
LMP Market Readiness
Criteria
MET
12/01/08
Realtime Markets
GO LIVE
`12/08/08
Forward Markets
GO LIVEZonal Markets
Shutdown
GO/NO GO
Nov 07
Market Operations Sandbox & ERCOT UAT
Market Trials Start
Resource Registration
All QSEs – Real Time Parallel Operations
AS Qualification
3/31/08 Single Entry
Model
GO LIVE
Reasonable LMPs24x7 support
All available MPsReasonableness criteria met
6 months
Oct 07
EDS 4
Feedback
168 hour test
complete
168 Hour Test – 4 weeks to complete; 4 week feedback-fix
168 hour trial
Go-Live & Transition
Jul 07 Sep 07Aug 07May 07 Jun 07
ICCP / Telemetry Validation
SE Validation
SCED testing cycles, voluntary per QSE scripted for 30 daysThereafter all QSEs participate in real time parallel operations
EDS 2
EDS 1
Market Operations Sandbox & ERCOT UAT EDS 4 - Day Ahead Operations
Limited 24x7 support Full 24x7 support
http://nodal.ercot.com 1Lead from the front
Texas Nodal
The budget is significantly influenced by the recommended timelineNodal Market & Zonal Shutdown December 2008
EMS
Trials & Implementation
MMS
CRR
MIS
NMMS
Commercial Systems
ERCOT & MP Readiness
Q2 2008 Q3 2009Q4 2008Q3 2008Q2 2007Q1 2007Q4 2006 Q4 2007 Q1 2008Q3 2006 Q1 2009
Integration
EDW
Q2 2009
EDS 3
MMS FAT ITEST
CRR Design, Bui ld, Pre -FAT CRR FAT ITEST
Final MP Interface
Specs 3/31
12/01/08Real Time Operations
GO LIVE
MIS (EMS/MMS/CRR) Design, Build, Pre -FAT
EDW FAT ITEST
StatementsLayout
Script tes t
ITESTEMS EMS FATEMS Requirements, Conceptual Design
ITESTMIS (SCED) Des ign, Build, Pre -
FAT MIS FAT
MMS Design, Build, Pre -FATMMS
Requirements, Conceptual Des ign
ITEST
OS Build
FAT
OS Requirements , Conceptual Des ign
CRR Requirements , Conceptual Design
Commercial Sys tems Design, Build, Pre -FAT CS FAT ITEST
EDW Requirements, Conceptual Design
ITESTSCED Build SCED FATSCED
Requirements, Conceptual Des ign
Registration ready
Bus iness Requirements
complete 10/30
Preliminary MP Interface Specs 12/31
CS Requirements, Conceptual Design
EDW Des ign, Build, Pre-FAT
MIS FAT ITEST
EDS 4 Go-live Trans .
EDS 3 Mote & ERCOT UAT
Planning UI
FAT ITEST
Naming Convention DB
Common model update processNMMS Conceptual Design
Naming Convention information collec tion
Model Data Certification Model Data Remediation Reconcil iation
NMMS Build
Outage Scheduler
EDS 1/2
Build FAT ITESTRequirements, Conceptual Design
ITESTOS FAT
6/30/08LMP Market
Readiness Criteria
MET
Q3 2007
Operations UI
Qualification Freeze
Registration complete
168 hour market trials
windowEnd of Trials
MP Nodal Registration MP Financ ial & Operational Qualification
MPSCED Offers
Begin MP trial
partic ipation
3/31/08Single Entry Model
GO LIVE12/08/08
Day Ahead Market/CRR
GO LIVEZonal Shutdown
GO/NO GO
EDS 3 Training
See detailed EDS 1 & 2 plan
See detailed EDS 3 plan
See detailed EDS 4 plan
http://nodal.ercot.com 13Lead from the front
Texas Nodal
Market Trials Transition Plan Alignment
5.4.1(2) ERCOT shall develop procedures for setup and data implementation requirements applicable to TSPs and QSEs. ERCOT shall with the assistance of TSPs and QSEs:
(a) Verify that all data and telemetry requirements specified
in the nodal Protocols Section 3.10, Network Operations Modeling and Telemetry, have been met and that all data submittals are complete and represent an accurate model of the ERCOT System;
Transition Plan Requirement
Day ahead market4
1-2-08 - MPs submit offers
Real-time market3
3-31-08 – Single entry model go-live
EDS 2 - Assumption: Involves Network Operations Model (only - not planning) and SE/NSA; no outage evaluation/approval
- S.UC2.OP1: Update RT Generation/Transmission Data (EMS Operation)- S.UC2.OP2: Update Transmission Ratings (EMS Operation)- S.UC2.OP3: Implement Proposed Plan (EMS Operation)- S.UC3.OP1: Update Information (NMMS Operation)- S.UC3.OP2: Analyze Solution (NMMS Operation "Send Network Operations Model"
Network model validation
2
This is a joint ERCOT and Market Participant task.
Will require a EDS type functionality from TSP/QSE
QSE/TSP personnel can SIMULATE analog/digital changes on their EDS and ERCOT EDS will be able to accomplish point-to-point check out with ERCOT operatorsExplore programmatic way to validate – this approach can be used later for periodic verification.
12-31-06 –Preliminary MP Interface Specs
3-30-07 – Final Interface Specs
EDS 1 - Assumption: only testing data coming in FROM the fieldICCP-related operations I can think of:- S.UC1.OP1: Update Frequency (EMS operation)- S.UC1.OP3: Update Generation Levels (EMS Operation)- S.UC1.OP5: Update Responsiveness Information (EMS Operation)- S.UC1.OP6: Update QSE Provider Information (EMS Operation)
- S.UC1.OP7: Use Revised Data (EMS Operation)- S.UC1.OP8: Use Telemetry Data (EMS Operation)
- S.UC2.OP1: Update RT Generation/Transmission Data (EMS Operation)- S.UC2.OP2: Update Transmission Ratings (EMS Operation)ICCP information TO the field (external):- S.UC2.OP4: Send Base Points- M.UC12.OP1: Clear RT Market (I know Base Points are communicated to QSEs via ICCP, will need to check which other ones do)
Telemetry & ICCP Validation
1
NotesMP Interventions
Use Case/ OperationsDescriptionEDS
Detailed market trials
plan
Nodal Critical Path
Appendix 8.2
Appendix 8.4
Appendix 8.3
See detailed EDS 3 plan
http://nodal.ercot.com 8Lead from the front
Texas Nodal
EDS Detailed Planning Overview
• Define Transition Plan Traceability Matrix• Detail Market Trial Phases and Test Areas• Create Entrance / Exit Criteria Checklists• Define test cycles, MP segmentation, and test calendar• Additional Areas
http://nodal.ercot.com 9Lead from the front
Texas Nodal
EDS Detailed Planning
EDS Description Transition Plan Requirement
Operations / SoSA Market Trials tasks MP Interventions
Notes
1 Telemetry & ICCP Validation
5.4.1(2) ERCOT shall develop procedures for setup and data implementation requirements applicable to TSP’s and QSE’s. ERCOT shall with the assistance of TSP’s and QSE’s: (a) Verify that all data and telemetry requirements Specified in the nodal Protocols Section 3.10, Network Operations Modeling and Telemetry, Have been met and that all Data submittals are complete and represent an accurate model of the ERCOT System;
- S.UC1.OP6: Update QSE Provider Information (EMS Operation)- S.UC1.OP7: Use Revised Data (EMS Operation)- S.UC1.OP8: Use Telemetry Data (EMS Operation)- S.UC2.OP1: Update RT Generation/Transmission Data (EMS Operation)- S.UC2.OP2: Update Transmission Ratings (EMS Operation)ICCP information TO the field (external):- S.UC2.OP4: Send Base Points- M.UC12.OP1: Clear RT Market (I know Base Points are communicated to QSE’s via ICCP, will need to check which other ones do)
All telemetry (SCADA/ICCP) points checked out (programmatically or manually) 100 %Status Report at the end of this activity must indicate that 100 % of all points have been tested and verifiedRequire Professional Engineers Seal from Entities to assure accuracy of data. Can be required from QSE’s/TSP’s due to issues of public safety and public interestAlarm Functionality Revalidated SCADA/ICCP enhancement to detect Forced Outage of equipment Real Time Weather Telemetry revalidated Dynamic Rating telemetry Validate all Transmission Element Limits and ConstraintsCheck TSP’s calculation Transmission Element Ratings that are likely to be active in SCED Telemetry Criteria Developed (protocol 3.10.7.4) Define and implement business processes to repair errors.
12-31-06 – Preliminary MP Interface Specs3-30-07 – Final Interface Specs
This is a joint ERCOT and Market Participant task.Will require a EDS type functionality from TSP/QSEQSE/TSP personnel can SIMULATE analog/digital changes on their EDS and ERCOT EDS will be able to accomplish point-to-point check out with ERCOT operatorsExplore programmatic way to validate – this approach can be used later for periodic verification.
2 Network Model ValidationSE Solution
3 Real-time Market Operations
4 Day ahead Market Operations
Define Transition Plan Traceability Matrix
http://nodal.ercot.com 10Lead from the front
Texas Nodal
Transition Plan Traceability Matrix Example
Transition Plan Detail:5.4.1(2a) ERCOT shall develop procedures for setup and data implementation
requirements applicable to TSPs and QSEs. ERCOT shall with the assistance of TSPs and QSEs: Verify that all data and telemetry requirements specified in the nodal Protocols Section 3.10, Network Operations Modeling and Telemetry, have been met and that all data submittals are complete and represent an accurate model of the ERCOT System
http://nodal.ercot.com 11Lead from the front
Texas Nodal
Transition Plan Traceability Matrix Example (cont.)
Requirement:ERCOT shall verify that all data and telemetry requirements have been met and that all data
submittals are complete and represent an accurate model of the ERCOT System
ERCOT Tasks:• Define data and telemetry verification plan based on NP 3.10• Verify that all submittals are complete and represent an accurate model of the ERCOT
system
MP Tasks:• Review data and telemetry verification section of Market Trials Handbook • TSPs and QSEs assist ERCOT with data and telemetry verification
Comments:• NP-Section 3.10, Network Operations Modeling and Telemetry• Requires NMMS to complete ITEST and in pre-production• Issue an EDS 1 RFP to verify that NMMS systems and processes meet section 3.10 of
the ERCOT protocols
> Each requirement will be further detailed in the EDS Detailed Market Trials Test Plan
http://nodal.ercot.com 12Lead from the front
Texas Nodal
EDS Detailed Planning
Detail Market Trial Phases and Test Areas– Define the set of functionality for each EDS phase based on the
transition plan, business requirements, SoSA documentation, etc.– Identify EDS phase for all functionality based on comprehensive
release plan and project schedule.– Define testing scenarios and test plan outlines
http://nodal.ercot.com 13Lead from the front
Texas Nodal
EDS Detailed Planning
Create Entrance / Exit Criteria Checklists
http://nodal.ercot.com 14Lead from the front
Texas Nodal
EDS Detailed Planning
Define test cycles, MP segmentation, and test calendar
– Testing cycles will be used to optimize the trials schedule and reduce resource conflicts by focusing on specific market areas with a reduced number of participants.
– Participants will be logically segmented into appropriate cycles.
– A weekly test calendar will be used to focus weekly activities. Multiple cycles may be scheduled in a single week or over multiple weeks.
http://nodal.ercot.com 15Lead from the front
Texas Nodal
EDS Detailed Planning
Additional Areas• Outline Market Trials reporting requirements• Define Market Trials data requirements• Finalize Market Trial Phase critical inputs
– Interface documentation– Requirements signoff– Design signoff– Market Operations Sandbox timelines
http://nodal.ercot.com 16Lead from the front
Texas Nodal
Next Steps
• Request comments on Market Trials Approach by 12/6/06• Return for approval in January• Begin EDS detailed planning providing opportunities for
comments as follows:– Review Transition Plan Traceability Matrix TBD
– EDS 1 to 4 Detailed Plan – Drafts for comment TBD
– EDS 1 Detailed Plan – Final Signoff TBD
– EDS 2 Detailed Plan – Final Signoff TBD
– EDS 3 Detailed Plan – Final Signoff 3/30/2007
– EDS 3 Market Trials Handbook – Final Signoff 6/29/2007
– EDS 4 Detailed Plan – Final Signoff 9/28/2007
– EDS 4 Market Trials Handbook – Final Signoff 12/31/2007
http://nodal.ercot.com 17Lead from the front
Texas Nodal
Questions?
http://nodal.ercot.com 18Lead from the front
Texas Nodal
http://nodal.ercot.com 19Lead from the front
Texas Nodal
Transducer (kWh)
RTU
AnalogStatus
Accumulator
Equipment Statuses
Sca
lin
g TSP & QSE EMS
SCADA
ICC
P
ICC
P ERCOT
SCADA
Phone Lines
ICCP Link
One-line Displays
Mapping to network
model
ERCOT Quality codes
PT
CT
QSE/TSP data accuracy assurance points by PE seal
ERCOT data accuracy assurance points by PE seal
A
CB
D
E
FG H I K
M
L
SCADA Telemetry Schematic
Segment Certification Requirement Notes
A to H To be certified by MPs
H to I To be certified by TBD (3rd Party ?)
I to N To be certified by ERCOT – PE Seal and verified by System Operators
J
Quality codes posted by TSP
N
ERCOT EDS scope