dr audit & testing tool overview

DR Audit & Testing Tool Overview

Lemuel Gonzalez, Operations Solutions ManagerDRWG, May 4, 2010 Meeting

DRWG, May 4, 2011 Meeting© 2011 ISO New England Inc.

Agenda

• Purpose of DR Audit & Testing Tool

• Process Overview

• High level introduction to the tool

• Training

• Next steps

2


Process is changing, rules are the same

• Provisions in M-RPA have not changed regarding Demand Resource auditing

• The new tool is only changing the process for requesting audits and for reviewing your audit results

• Expect the tool to be available next week, tentatively scheduled for either May 10th or 12th

• Training scheduled for May 5th & 6th and May 17th & 18th

• Plan to publish final versions of the training slides in the last week of May

3


Process OverviewLifecycle of an Audit

4

Establish Need for

Audit

Establish Need for

Audit

• Commercial Operation Audit

• Seasonal DRU Audit

• Commercial Operation Audit

• Seasonal DRU Audit

FCTSFCTS

Lead Participant

Conduct AuditConduct Audit

• Dispatch for Active

• Analysis & Supp Doc for passive

• Dispatch for Active

• Analysis & Supp Doc for passive

A&TTCFE/RTU

CAMS

A&TTCFE/RTU

CAMS

ISO

• Calculate DRV• Settlement• Performance

• Calculate DRV• Settlement• Performance

May use Auditvalues

May use Auditvalues

SMS SMS

ISOAudit Results•Approve•Defer•Fail

Audit Results•Approve•Defer•Fail

• Initialize (Approve or Defer)• Final (Approve or Fail)

• Initialize (Approve or Defer)• Final (Approve or Fail)

A&TTCAMS

A&TTCAMS

ISO

DetermineCommercial Operation

DetermineCommercial Operation

• CODp (FCTS)• FA Return

(tied to AR)

• CODp (FCTS)• FA Return

(tied to AR)

FCTSFAM

FCTSFAM

ISO

Request/Cancel Audit

Request/Cancel Audit

• Start Date Audit

• Start Date Audit

A&TTA&TT

Lead Participant

ISO trigger establishes

a needfor Audit

ISO trigger establishes

a needfor Audit

ISO


DR Audit & Testing Tool (A&TT) Purpose

• Track DR audit requests and corresponding audits results

• Support business processes and workflows associated with DRs– Audits– Data validations and quality

• Allows users to be “in the know” providing transparency and timely delivery of DR performance information– DR Lead Participants– Demand Designated Entities– ISO’s Demand Registration & Performance Auditing (DRPA) group

• Will monitor/track performance of DR and Demand Assets

5


Customer Process & WorkflowA&TT Access Roles

• LP Maintainer – Allows LP to assign users who can view, submit, and edit audit request

and review asset results information

• LP Read Only– Allows LP to assign users who can view the relevant audit request and

asset results data

• DDE Read Only– Allows the DDE of a Demand Resource to view pertinent audit request

and results information in support of their role as the DDE for a resource

6


A&TT Access RolesWho and What

7


Accessing the tool from the SMD Applications Home Page

8


Logging into the A&TTDefault LP View

9


• Home: provides a dashboard view of the Audit Requests

• Resource: provides detailed Demand Resource information that is pertinent to audits

• Asset: provides detailed Demand Asset audit information

• Audit Request: provides access to each Audit Request and the relevant details supporting each audit

• Asset Results: provides searchable asset results

• Qualifying Events: allows LPs to request that an eligible or qualifying event be used as an audit

• Flagged Assets: allows the LPs and DDEs to see any assets that have been flagged for their review, namely due to potential or reported problems with data quality

10


Request Audit Button

Select the appropriate Resources and select Request Audit

11


Resource view provides detailed audit history and resource information

12


Demand Resource Tabs Provide Supporting Info

13

Resource information displayed is based on the selected “As of Date” in relation to the DRV audit periods (where applicable)


Tracking the Status of Audit Requests

• Lead Participants and Demand Designated Entities can view Asset Results in the A&TT

• Dashboard view will provide the status of open audit requests– Pending– Dispatch Received– Asset Review In Progress– Initial Review Complete– Final Review Complete

• Customers will receive an e-mail from DRPA letting them know that the results are available

• Future enhancements to the tool will automate this e-mail

14


Searching for Audit Requests

15

DRWG, May 4, 2011 Meeting© 2011 ISO New England Inc. 16

View list of Audit Requests meeting search criteria, navigate to Detailed Audit Request or Resource Information

Navigates to Audit Request

details

Directs user to Resource information

Actual: Actual Audit DateMIC: Total registered max interruptible capacityCSO: Capacity obligation for the month corresponding to the Window Start date


Viewing Audit Request Information for a Specific Demand Resource

17


Tabbed Details Provide Supporting Information for the Audit Request

18


Demand Asset Information

19


Asset Results

20

Average Interrupted MW column can be selected to bring you to the detailed interval data for that row’s Demand Asset


Asset Result Interval Data (by Asset)

21


DR Qualified Events View

22


CommunicationsHow, Who and When?

• Event driven e-mails sent to defined Lead Market Participant contacts in CAMS

• DR Audit & Testing General Contact– Qualifying Dispatch Event– Seasonal Audit Request additions

• End of season details

• DR Data Quality Contact– Addition, updates deletions to the list of Flagged Assets

23


Sample Emails

24


Communications with DDEs

Option to include DDEs or other providers on communications then create a group e-mail and provide that for the appropriate Person Contact record

25


Training reminder

• Registration & Auditing or Demand Resources training scheduled for:– May 5 & 6 in Springfield (online registration is closed but if interested

we can accommodate the first four to contact us)– May 17 & 18 in Northampton (online registration is closed but new

registrants may be accommodated)

• First day is a revised version of last year’s registration and auditing training

• Second day is entirely focused on the new DR Audit & Testing Tool

26


Next steps

• Consider attending the training

• Work with your Security Administrators to request access to the Audit & Testing Tool (will be available when the tool is released next week)

– There are three roles: LP Maintainer and Read Only and DDE Read Only

• Establish your e-mail contacts in CAMS for use in the DR A&TT application

– DR Audit & Testing General Contact– DR Data Quality Contact

• Establish your audit needs for the summer and request through the tool as needed

27


Support

• Customer Support– Regular business hours

• Monday through Friday, 7:30 A.M. to 5:30 P.M. Eastern Time– Contact information

• Phone : 413-540-4220– All lines are subject to recorded/monitored conversations

• E-mail: [email protected] • Fax: 413-535-4156

• Market Training– Contact information

• E-mail: [email protected]

28


Questions

29

dr audit & testing tool overview

Documents