Market Participant Testing
The Market Participant Testing page will outline the plans, test cases, and resources Market Participants will need to test the changes MRP will be introducing in the renewed market.
If Market Participants experience issues or have questions during the MRP Market Participant Testing Phases, please contact IESO Customer Relations at customer.relations@ieso.ca. Market Participants should also monitor the Planned IT Outages webpage for outages that may occur in the Sandbox environment during the test phases.
Getting Started
The materials below are intended to help organizations prepare to participate in all test phases of Market Renewal in 2024 and 2025. To learn more about the program’s testing approach, the MRP Market Participant Test Plan provides an overview of the different test phases of the program, the applications that are in scope during each phase, and what Market Participants should do to prepare for system testing. The IESO also provided supplementary materials to help Market Participants in setting up their Sandbox user and API accounts during these test phases, as well as a job aid on how to use the IESO’s new test case management tool (qTest).
Connectivity Testing
Connectivity Testing is the first phase of Market Participant Testing. Connectivity Testing allows Market Participants to verify that they are able to log in and connect with the applications and interfaces that are available in the test environment. The materials listed below outlines the test cases, issue log template, and other files to assist Market Participants during Connectivity testing. Market Participants should complete their applicable test cases and resolve all connectivity issues by May 24, 2024.
- Presentation – Kick-off meeting for MRP Connectivity Testing
- Recorded Presentation – Kick-off meeting for MRP Connectivity Testing
- Frequently Asked Questions (FAQs) for Connectivity Testing
- Connectivity Testing: Issue Log Template
- Presentation – Wrap-Up Meeting for MRP Connectivity Testing
- Recorded Presentation – Wrap-Up meeting for MRP Connectivity Testing
Test Cases for Connectivity Testing:
Market Trials Testing
Market Trials is the second phase of MRP Testing, running from July 2024 to October of 2024. Its objective is for Market Participants to confirm that certain functionality of individual tools and interfaces are working as intended.
- Market Renewal Program (MRP): Market Trials Test Plan (External)
- Frequently Asked Questions (FAQs) for Market Trials
- Presentation - Kick-off meeting for Phase 1 of Market Trials
- Presentation – Kick-off meeting for Phase 2 of Market Trials
- Presentation – Kick-off meeting for Phase 3 of Market Trials
- Presentation – Touchpoint #1 Meeting regarding Market Participant Testing
- Presentation – Touchpoint #2 Meeting regarding Market Participant Testing
- Presentation – Wrap-Up Meeting for Market Trials
- Recorded Presentation – Wrap-Up Meeting for Market Trials
Test Cases for Market Trials
- Market Trials: Issue Log Template for Energy Management Interface (EMI) User Interface
- Market Trials: Daily Dispatch Data (DDD) in the Energy Market Interface (EMI) User Interface (UI)
- Market Trials: Real-Time Energy Market (RTEM) in the Energy Market Interface (EMI) User Interface (UI)
- Market Trials: Operating Reserve in the Energy Market Interface (EMI) User Interface (UI)
- Market Trials: Forebay Dispatch Data Submission for Energy Market Interface (EMI) User Interface (UI)
- Market Trials: Schedule and Forecasts in the Energy Market Interface (EMI) User Interface (UI)
- Market Trials Test Cases for the Energy Management Interface (EMI) based on Participation Type
- Market Trials: Issue Log Template for the Market Information Management (MIM) tool
- Market Trials: Daily Dispatch Data in the Market Information Management (MIM) tool
- Market Trials: Real-Time Energy Market (RTEM) in the Market Information Management (MIM) tool
- Market Trials: Operating Reserve in the Market Information Management (MIM) tool
- Market Trials: Forebay dispatch data submission in the Market Information Management (MIM) tool
- Market Trials: Schedule and Forecasts in the Market Information Management (MIM) tool
- Market Trials Test Cases for the Market Information Management (MIM) Tool based on Participation Type
- Market Trials: Issue Log Template for IESO Reports
- List of Market Participant Confidential Reports Available for Market Trials
- Market Trials: IESO Reports – Market Inputs Job Aid
- Market Trials: IESO Reports – Market Power Mitigation Job Aid
- Market Trials: IESO Reports – Day-Ahead Market (DAM) Scheduling and Operating Reserve (OR) Job Aid
- Market Trials: IESO Reports – Day-Ahead Market Pricing Job Aid
- Market Trials: IESO Reports – Real-Time Scheduling and Operating Reserve Job Aid
- Market Trials: IESO Reports – Real-Time Pricing Job Aid
End-to-End Testing
End-to-End Testing is the final phase of MRP testing, running from January 2025 to March of 2025. This test phase will provide an opportunity for Market Participants to confirm their ability to execute key business processes and systems that are changing as a result of Market Renewal. All systems that are in scope for testing will be connected at this time.
- Market Renewal Program (MRP): End-to-End Testing Test Plan (External)
- Frequently Asked Questions (FAQs) for End-to-End Testing
- Settlement Schedule for the End-to-End Testing Test Phase
- Key Calendar Dates for End-to-End Testing
- Quick Take: Update on Constraint Violation Prices in the Pricing Algorithms
- Quick Take: How to Submit Temporary Reference Level Change Requests for End-to-End Testing
- Quick Take: How to Submit Updated Measurement Data for End-to-End Testing
- Template to Submit Updated Measurement Data
- Presentation – Kick-off Meeting for End-to-End Testing
- Presentation – Q&A Session #1
- Presentation – Q&A Session #2
- Presentation – Q&A Session #3
- Presentation – Q&A Session #4
- Recorded Presentation – Kick-off Meeting for End-to-End Testing
- End-to-End Testing: Issue Log Template for Week 1 and Week 2 Test Cases
- End-to-End Testing: Issue Log Template for Week 1 to Week 4 Test Cases
- End-to-End Testing: Issue Log Template for Week 1 to Week 5 Test Cases
- End-to-End Testing: Issue Log Template for Week 1 to Week 6 and Week 8 (Scenario 27 – Resettlement Statement)
- End-to-End Testing: Test Cases based on Participation Type
- Presentation – Wrap-Up Meeting for End-to-End Testing
- Recorded Presentation – Wrap-up Meeting for End-to-End Testing
Test Cases for End-to-End Testing
Week 1 Test Cases
- Scenario 17: Generator Office Guarantee (GOG) Commitment Advancements and Extensions
- Scenario 21: SEAL Constraint
Week 2 Test Cases
- Scenario 4: Notice of Disagreement
- Scenario 12: Hourly Demand Response – HDR Activation
- Scenario 13: Operating Reserve (OR) Activation
- Scenario 18: GOG Commitment withdrawn by MP with more than 4 hours advance notice
- Scenario 19: GOG Commitment withdrawn by MP with less than 4 hours advance notice
Week 3 and 4 Test Cases
- Scenario 2: Day-Ahead Market (DAM) Failure
- Scenario 5: Make-Whole Payment
- Scenario 7: Market Power Mitigation (MPM)
- Scenario 16: GOG Commitment Terminated by the IESO
- Scenario 22: MPM Global Threshold
Week 5 Test Cases
Week 6 Test Cases
- Scenario 8: Curtailment of DAM scheduled intertie transactions
- Scenario 23: Major Outage – EW Tie Binding
- Scenario 26: Capacity Flag – Import/Export
Week 8 Test Cases
Pre-Production Connectivity and Cutover Testing
The IESO will be offering two additional testing activities for market participants to verify that they can smoothly transition to the new Production systems next year: Pre-Production Connectivity Testing, and Cutover Testing.
The purpose of the Pre-Production Connectivity Testing is to ensure that Market Participants can access the new and updated market-facing systems and address connectivity issues prior to the cutover to the Production environment starting on April 30, 2025. This test is targeted to run from March 17, 2025 to March 28, 2025.
The purpose of the Cutover Testing is to verify that Market Participants can follow the cutover sequence in the prescribed time that is outlined in the MRP Readiness Plan for Market Renewal Launch (Table 3-1 Market Renewal Launch Timeline). This test is targeted to run from March 31, 2025 to April 2, 2025.
- Presentation – Cutover Testing and Pre-Production Testing
- Recorded Presentation – Cutover Testing and Pre-Production Testing
Pre-Production Connectivity Testing
- Pre-Production Connectivity Testing: Market Information Management (MIM) Application Programming Interface (API) using API Tool Test Case
- Pre-Production Connectivity Testing: Dispatch Service (DS) User Interface (UI) Test Cases
Cutover Testing
- Market Renewal Program (MRP): Cutover Test Plan
- Market Renewal Program (MRP): Walkthrough of the Activities During the Cutover Test
- Presentation: Lessons Learned from Connectivity and Cutover Test and Walkthrough of the Production Launch Activities
- Recorded Presentation: Lessons Learned from Connectivity and Cutover Test and Walkthrough of the Production Launch Activities