Consumer-led Industrial and Commercial (I&C) flexibility allows large energy consumers (factories, retailers, office blocks, data centres, hospitals etc.) to adjust their net energy consumption for short periods in response to the needs of the grid, incentivised through flexibility markets.

In the electricity market, this enables demand to respond to supply, a crucial shift as sectors move towards electrification and as electricity production shifts to cheaper, cleaner, but more intermittent, renewable sources.

Flexibility forms up a core part of the government’s Clean Power 2030 Action Plan and is explored in depth in the Clean Flexibility Roadmap. It also delivers clear value, from reducing system costs for networks to unlocking new revenue streams and resilience for energy users. But, realising its full potential and accelerating the transition to Net Zero requires market-wide adoption.

Benefits of I&C flexibility

For grid operators, enabling flexibility can deliver:

• Reduced generation curtailment
• Reduced need for expensive grid-scale energy storage projects
• Reduced costs for grid capacity upgrades
• Alignment with Ofgem’s forthcoming RIIO-ED3 price control

For I&C Consumers, benefits include:

• Lower energy costs
• New revenue streams
• Reduced expenditure on grid connection upgrades
• Increased resilience for key consumers, such as hospitals, in times of grid stress

Data is the common thread

And yet, I&C flexibility isn’t one-size-fits-all. It encompasses a spectrum of approaches from direct demand response (where consumption is increased or decreased for a set period) to more sophisticated coordination of co-located technologies like solar, battery storage, heat pumps, and EV fleets.

What connects these approaches is data. Granular, trusted data sharing enables I&C sites to assess what options are feasible and maximise the benefits of participating in flexibility markets. Electricity networks also need real-time, high-quality data to plan and operate their networks, and to balance supply and demand. Without this, take-up of I&C flexibility will not reach its full potential, or will be costly to implement.

Sharing large amounts of data between diverse groups or organisations can lead to challenges including:

• Varying data formats, standards and semantics
• Separate representations of network assets and constraints
• Different data publication schedules
• Non-interoperable licensing and permissioning frameworks
• Issues with machine-readability
• Commercial and security sensitivities
• A lack of easy consumer data portability
• Fragmented data on existing I&C flexibility participation and performance

For I&C consumers, these barriers make it harder to identify viable flexibility opportunities and build robust business cases. This increases cost and complexity, often diverting time and investment elsewhere.

Unlocking flexibility at the speed and scale required to decarbonise the grid will therefore require a fundamental shift in how data is shared.

A data sharing scheme to accelerate I&C flexibility

The market needs a way for I&C actors to securely and easily share data with authorised parties to assess, plan and deliver flexibility at scale. Open Energy’s mission is to collaboratively define and develop a data sharing Scheme to support this, recognising that delivery is a co-ordination challenge, requiring collaboration to solve.

No single organisation can solve this alone, and implementing technical solutions without understanding the needs, constraints, and capabilities of others risks becoming an expensive exercise with unreliable outcomes.

The scheme will align with wider energy and cross sector initiatives such as NESO Data Sharing Infrastructure, RECCo Consumer Consent Solution, Elexon Flexibility Market Asset Register, Market-Wide Half-Hourly Settlement, and Smart Data policy), strengthening the overall data ecosystem and enabling interoperability.

Open Energy brings together energy system and I&C participants to build the data foundations for accelerating flexibility. IB1 acts as a neutral facilitator and data governance expert supported by the Energy Sector Trust Framework, a ready-to-use mechanism for governing the exchange of data in a consistent, trusted, and scalable way, without the need for centralised infrastructure.

How your organisation can benefit

If flexibility impacts your organisation, whether as an opportunity, a challenge, or a dependency, being part of Open Energy gives you a seat at the table, where the future of data sharing is being built. You’ll also help shape how the Energy Sector Trust Framework evolves to meet the specific needs of the flexibility market.

For networks:

• Contribute to, and benefit from, sector-wide alignment on data classification, licensing, and access controls
• Reduce the risk of costly inconsistencies emerging as flexibility markets mature.

For flexibility providers and aggregators:

• Access cleaner, more consistent data pipelines
• Access a governance framework that makes it easier to operate across multiple network areas.

For large energy consumers and trade bodies:

• Gain faster visibility of viable flexibility opportunities and incentives
• Access insights to support adoption and decision-making

Join us & your peers

To find out more about the Industrial & Commercial Flexibility use case, or to join Open Energy, get in touch with us at openenergy@ib1.org

And register for our upcoming webinar: https://events.humanitix.com/oe-i-and-cflex-webinar

The decisions being made now will shape the direction of the energy sector for years to come. Those helping to shape it will be best placed to benefit from the opportunities that follow.

Please note that throughout this consultation, Icebreaker One uses the terms Open, Shared and Closed data as defined here.

If you have any questions about our submission or require clarifications please do not hesitate to contact us via policy@ib1.org.

Consultation response:

Regarding paragraph 3.36 in the Statutory Consultation on the RIIO-3 Licence Drafting modifications – reasons and effects document:

Generally IB1 supports a common Digitalisation Re-opener to encourage digitalisation by allowing network companies to seek funding for data and digital related projects with a broader scope than just IT hardware or software upgrades and to align with RIIO-ED2.

IB1 supports digitalisation as key for energy sector decarbonisation, and required for the investment in flex services and the coordination between sectors who rely on energy to meet their decarbonisation targets (water, transportation, built environment, industry).

IB1 supports sector-wide convening and governance to ensure digitalisation happens in a coordinated manner and can enable ‘whole system solutions,’ as promoted in RIIO-ED2 and realise the subsequent cost savings. IB1 supports Ofgem to continue to promote and finance whole system digitalisation coordination in RIIO-ED3.

As there are many ongoing data sharing and data governance initiatives e.g. consumer consent solution, flexibility services, Data Sharing Infrastructure (DSI), which are currently in progress at different stages of development (definition, prototype, or pilot). Ofgem should not expect these programmes and underlying challenges the projects aim to solve to be resolved by the end of RIIO-ED3 (2031). Data sharing and data governance needs and subsequent solutions will evolve over time as we continue to electrify and connect the UK’s grid. As mentioned above, Ofgem needs to ensure ongoing governance and sector collaboration on data and digitalisation – reinforcement of this would be welcomed in addition to specific plans to expand/evolve data governance initiatives.

With the progress of the Data Sharing Infrastructure (DSI) programme, IB1 anticipates ‘Shared Data’ sharing will evolve and will inform the evolution of data best practice (DBP) guidance. In particular, as data sharing scales, the need to standardise and harmonise legal and technical approaches will become more pressing in order not to slow innovation and add unnecessary cost. IB1 recommends that DBP should include guidance around Shared Data within the triage processes and licensing decisions, highlighting the role of Shared Data Schemes to provide definitions that aid interoperability and maximise impact.

Please note that throughout this consultation, Icebreaker One uses the terms Open, Shared and Closed data as defined here.

If you have any questions about our submission or require clarifications please do not hesitate to contact us via policy@ib1.org. We have omitted questions which we did not answer.

Consultation response:

Do you agree with the proposed implementation approach? Yes.

Rationale: We appreciate that there is a governance in place to discuss and approve the proposed implementation. We would welcome further transparency on the outcomes of applications to access data via this method and suggest that a summary of cases are made openly available after a 6-12 month trial period. Ongoing avenues for scrutiny remain important.

Please provide any further comments you may have.

As we are looking holistically at the smart meter data landscape, we will continue to work with the SEC and engage as it develops on a case by case basis and impacts wider use cases.

with Rohan Graham, Head of Asset Data, National Grid and Jay Chen, Data Process Administrator, IT&D Data Engineering and Process, NGED

Data sharing is key for reaching our net zero targets; this is something IB1’s strategic partner National Grid Electricity Distribution (NGED) has long recognised. And, as the company looks to cement its position as a digital leader in the energy industry, IB1 remains a key component and catalyst in accelerating its digitalisation journey. 

We caught up with Rohan Graham from National Grid and Jay Chen from NGED, to discuss how interoperability across Distribution Network Operators (DNOs) is fundamental to unlocking the potential of open data in the energy sector.

Building trusted open data

Last year, NGED identified a need to improve how it publishes assured open data. While the DNO had already established an open data portal, it wanted to review both what it was publishing and how it was publishing it. This shift signalled a commitment to providing data that is trusted, consistent and usable across the sector. 

“Our goal is to contribute to the broader movement of publishing interoperable assured open data, explore genuine shared-data use cases, and understand how to make that data available securely through trust frameworks, while considering and aligning to the DSI under development.” Rohan Graham. 

Sector-wide collaboration

NGED sits within a much wider ecosystem of UK DNOs, all of which publish similar datasets. Because these datasets are used across the energy sector, (not just within each DNO’s own business) ensuring their interoperability is essential.

To achieve the level of interoperability required and to build sector-wide collaboration, harmonisation is essential. Once in place, the value of this interoperability is far-reaching: it strengthens trust, encourages the wider use of data across the sector and ultimately accelerates the entire sector’s digital maturity. 

“Over the next 3-5 years, we’ll see the increase of interoperability of data between organisations as well as the increasing use of flexibility services across multiple DNOs.” Jay Chen, NGED. 

Data Action

The Data (Use and Access) Act might also be a catalyst for positive change in the sector. Its focus on the roll-out of smart data schemes is a move in the right direction. But, whether this alone will galvanise the sector toward a more connected, net-zero future remains to be seen.

“It’s definitely a positive move. It’s set up some of the frameworks for how Open Energy can be pushed forward, but really, the Act alone won’t create immediate change. Specific to Open Energy, the real push comes from facilitation by Icebreaker One, a common purpose and active participation from members of the ecosystem.” 

Rohan Graham, National Grid

IB1: The great facilitator 

Through our Open Energy programme, IB1 has helped to establish best practices for publishing open data; focusing on machine readability, standardised metadata and overall consistency; all of which help to facilitate trust across the sector. 

“Working with IB1 has been really valuable in providing awareness, guidance, and direction, mainly from an open data perspective, so far. One of the biggest benefits has been driving the collaboration between the DNOs through steering and working groups. This kind of collaboration is crucial for progressing interoperability and shared best practices”. Rohan Graham.

“Our strategic partnership enables NGED to have a driving seat in shaping the future of decarbonisation through working groups with sector organisations, facilitated by IB1.”

Jay Chen, NGED

What’s next?

Looking ahead, National Grid is set to continue its progress toward a more connected, digital energy system. Central to achieving this vision is the ability to continue identifying datasets that truly move the dial on flexible energy markets and decarbonisation.

“Understanding who needs that data, why they need it, and how to deliver it securely and at scale will be key. The sector needs to  remain focused on publishing what truly drives progress toward net zero – whether that’s open or shared data.” Rohan Graham. 

IB1’s work in Open Energy is creating a connected web of energy data – making it more discoverable, interoperable, and impactful, in the collective mission to reach net zero.

If you’re interested in becoming a Strategic Partner, an Open Energy member, or part of our expert network, you can join us at ib1.org/join or reach out at partners@ib1.org to start a conversation about unlocking data for net zero.

Sara Vaughan, Co-chair of the Open Energy Steering group, framed the start of the session by pointing to a lack of alignment in the sector which might be hindering progress. At the same time, she highlighted what sets Open Energy apart from other initiatives: the involvement from regulators, who are brought into the process to support and provide continued feedback.

This collaborative approach sits at the heart of Open Energy, as it brings the sector together to co-design the rulebook for data sharing and develop Trust Frameworks that unlock the value of energy data.

The data sharing landscape

As we progressed through the webinar, Chris Pointon, Product Manager, Trust Services, reflected on what Open Energy can build upon as it evolves. Themes included wider governance areas such as assurance, common identity services, and shared data infrastructure. Key to exploring these themes are actionable use cases. These give us a tangible grasp on user needs, and allow us to develop solutions that accurately address industry and consumer pain points.

Harmonisation over Standardisation

The focus on workable use cases also made up a large part of discussion in the Q&A segment and helped attendees to understand why harmonisation, not standardisation, is needed to guide the sector forward.

“While data standardisation focuses on uniformity, data harmonisation is about making disparate data sets interoperable”

Michael Glass, Data Governance and Information Manager at SSE posed a critical question:

“DNOs all have different internal definitions and languages that they use. How do they agree on a common language?”

The answer is to pick a use case that is supported by working groups and centre collaboration around it. By starting from real-world use cases, we can reduce cost and friction for everyone.

“That’s how we harmonise. Psychologically and operationally, it’s a much easier approach.” Gavin Starks, CEO, IB1.

The results are in

Towards the end of the webinar we conducted a poll asking our participants questions such as: ‘Which of these barriers affects your confidence’ to better understand whether uncertainty around data licensing, data access, data maturity, legal risk or alignment with the rest of the sector is holding them back.

Uncertainty about alignment with the rest of the sector made up a large portion of the vote, and echoed our previous discussions on the need for harmonisation.

What’s next?

We’re at a critical moment in the UK’s history around data sharing. Government departments now have significant budgets dedicated to designing smart data schemes, signalling real momentum.

But amidst this progress, we need a coordinated effort to ensure we navigate towards the low-cost, low-friction future we’ve all set out to achieve – one where collaboration across the sector shapes the future of trusted energy data sharing in the UK and beyond.

Looking ahead, we’re encouraging continued discussion through upcoming Open Energy Working Groups. The first session will take place on Wednesday 26 November, and will aim to develop a single, DNO-backed approach to align on the language and decisions discussed during the webinar.

Whilst the form is now closed, you can still join by emailing partners@ib1.org

During March’s meeting, there was a reaffirmation of the shared commitment to Open Energy’s vision, mission and values. The importance of cross-industry collaboration, and coordinating efforts between members to accelerate progress, was emphasized. Discussions highlighted the critical role of governance-driven programs in ensuring trust, transparency, and interoperability and explored some of the key current regulatory developments, including the Smart Data Scheme Call for Evidence and the earlier Consumer Consent consultation.

With strong foundations in place, Open Energy is well-positioned to deliver impact in 2025.

Key Insights:

• It was noted that members were reminded of the vision, mission and values of Open Energy
  • Vision: A connected web of energy data for an efficient, decentralised, net zero future
  • Mission: Deliver robust, scalable data governance that convenes experts to identify, co-design and implement trusted data sharing Schemes for Open and Shared Data
  • Values: 
    • Empowering
    • Open
    • Sustainable
• The high-level plan for 2025 was shared and members were asked for their endorsement. It was noted that: 
  • Targets focus on building community and creating schemes. 
  • The objective is to prioritise a use case and co-author a bid.
  • The desire is to make a market-wide scheme which has been designed and signed off on collaboratively

• The plan was well-received and agreed to have a strong approach
• It was noted that value will come with adoption, with the cross-collaboration that is already starting to happen signalling this
• There was discussion around CP2030, focusing in on both DESNZ’s Energy Smart Data Scheme call for evidence, and Ofgem’s Consumer Consent consultation
  • It was noted that governance driven programmes play a key role in arriving at interoperable systems, with trust and transparency central to this
  • It was noted that data is key to driving decision-making and reaching a liquid flexibility market 
  • The importance of speeding up the delivery of existing work and coordinating these programmes was noted 

The next meeting will be held 13th May 2025.

At the NSTA, Sara is part of a regulatory body, pushing for security of supply and reduced emissions, as it influences industries spanning Oil & Gas, Offshore hydrogen and Carbon Capture and Storage (CCS). 

As Chair of the Board at Elexon, the Balancing and Settlement Code (BSC) administrator for Britain’s energy system, Sara is part of an organisation that has, for some years, been proactively shifting its approach to data. An approach that it shares with UK energy regulator, Ofgem. 

A common thread

Despite being on different sides of the regulatory fence – one as a regulator and the other as a soon-to-be regulated entity – the two organisations share a common thread in their net zero ambitions, viewing data as foundational to achieving this. Sara explains that Elexon recognised, early on, the value of making data discoverable, accessible and interoperable:

“Elexon was already heading in the direction that the regulator (Ofgem) was pushing for. In June 2021, we passed a modification that stated all data under the BSC were presumed open. Now we have market-wide half hourly settlement data on the horizon, which is going to massively increase the amount of data that we have to handle”. 

Elexon saw the critical role that data would play in the future of energy, understanding that the amount of data it would need to handle was going to increase exponentially. Following appointment by Ofgem in 2021, Elexon now leads a push that will require settlement on a half-hourly basis across the entire energy retail market by the end of 2026. 

Open Energy 

Sara found herself in a similar environment of preempting regulatory drivers, when working with Icebreaker One on the Open Energy project:

“I first got involved with Icebreaker One in early 2021 and remember thinking, how are we going to get companies to open up their data without a regulatory push? They either need to be able to see the advantages for themselves or need to be required to do it. Otherwise, it all seems quite theoretical.” 

The Open Energy project looked at how energy data should be classified, laying the foundational principles of Trust Frameworks while delving deep into work on APIs (application programming interface). Crucially, the project was use-case centric, questioning why and for what purpose the energy industry would want to open up their data. Potential benefits for EV charging infrastructure and solar energy offered two suitable use cases and potential answers to this question. 

“There’s been a number of developments in the energy sector since this work. Most notable is a recognition of the importance of automatic asset registration. Installers  have to share data on location of certain assets with their local network operator. It’s a prime example of people being more aware of the issues and the possibilities that can arise from sharing data” 

Water sector woes

The energy sector looks to be leading the charge in their approach to data. Compare this to the water sector, and we see an industry that is seemingly lagging behind. One potential reason for this disparity and a driver for the energy sector’s progress is competition. 

“I’m a firm believer that competition drives innovation, this certainly rings true when it comes to data. Competition opens up possibilities and aids the development of new ideas. And, as companies look at new ways to innovate, having more open and better-quality data only expands these possibilities”. 

Political Pressures 

With Labour’s recent victory in the UK general election, our thoughts now turn to how this change in government might impact Elexon and the NSTA. For the NSTA, whose sole shareholder is the Secretary of State, the change in government could bring in different opinions on which direction the regulator should take. 

For Elexon, the expectation is that the direction of the company will not change. And, more positively, the new government is looking to accelerate progress towards a zero carbon electricity system. Despite this, there may be a slowing down of progress in certain areas. The organisation is due to be industry-owned, for example, transitioning from the newly set-up National Energy System Operator (NESO). The outcome of the election could slow this process. 

“With any new administration, roles change and it is likely to take some time for things to get back on track again – although the Labour government does seem to have hit the ground running”. 

“Legislation is a really powerful tool, as it removes the argument on whether the data should or can be collected, replacing it with the fact that the law says this is how it’s going to be’’. Nic Granger, Director of Corporate, North Sea Transition Authority.

You might expect a radical change in a sector’s approach to data could be met with some resistance, but this was not the case. Instead, organisations now had a legal requirement to fulfil, including the need for a named individual to hold these responsibilities, meaning data management teams were given the budget and attention they’d been asking for. And now, the regulatory foresight shown by the NSTA has led to far-reaching benefits in sectors such as carbon capture and storage (CCS), hydrogen, offshore wind and oil & gas. 

Carbon Capture and Storage

The NSTA’s mission is to accelerate the energy transition, support emissions reduction and ensure the UK maintains a secure supply of energy. This involves regulating and influencing industries spanning oil & gas, offshore hydrogen and carbon capture and storage (CCS). 

CCS (the process of capturing and storing carbon dioxide emissions and storing them, often underground or within rock formations) is seen by many as a critical component of the UK’s net zero strategy:

“We see carbon capture and storage having a significant impact on the energy transition. The 21 licences that we issued in September, could capture ten percent of UK carbon emissions,” says Granger, “and the six licences which were in place before that could add even greater capacity.”.  

The previous government set a target to store 20-30 million tonnes of CO2 by 2030. And, while the plans of the newly-elected Government remain to be seen, the first round of CCS projects critical to meeting these targets are due for a final investment decision in the near future.

Seismic Data

One type of data, previously used for oil and gas projects, is now proving its worth in CCS. By helping to identify geological formations and assess storage capacity, seismic data is immensely valuable in CCS, highlighted by the fact that the NSTA’s data downloads increased 20-fold on the day the CCS licensing round opened. 

Now, following an announcement in the 2023 Energy Act, the NSTA has the power to collect carbon storage data from industry. Again, demonstrating its proactive approach to data governance as the CCS industry begins to pick up speed.

The value of seismic data stretches beyond the confines of the CCS sector however, it includes the top 100 metres of geological data, making it ideal for siting offshore wind farms:

“In 2015, the government funded two large chunks of seismic data. That data was intended to be used for oil and gas but what we’re now seeing is the data being reprocessed and used for offshore wind, another crucial pillar for energy transition in the UK.”

Democratising Data

Another type of data showing promising benefits across industries is GIS (geographic information system) data. Primarily generated through regulatory transactions, and made openly available by the NSTA, GIS data is helping to identify existing oil and gas infrastructure such as pipelines. These pipelines then have the potential to be repurposed for use in hydrogen or carbon dioxide transportation.

“This data is available on the equivalent of an open government licence, so it’s an open NSTA licence. We’ve now had over 500 million spatial server requests, roughly 2 million hits a week. The data is great from a spatial planning point of view, and it really helps to explain the importance of data when you can see it visually.”

By opening up datasets like these, the NSTA is also helping to democratise data and reduce costs. This allows academics to access datasets that were previously too expensive for their research budgets. Armed with these datasets, academics can then research ways to phase out fossil fuels and achieve net zero, faster. But, having large quantities of data is one thing, in order to truly reap the benefits of open data, it must be high quality.  

“Our approach is to open up as much data as we can. There’s a huge volume of industry data available under the NSTA’s NDR user agreement but the ownership is retained by industry. We have over a petabyte of data and we’re now ensuring new data loaded is high quality and machine readable.”

This in-depth report details Icebreaker One’s work during the Alpha Phase of the project with a specific focus on data sharing, accessibility and interoperability. It explores three core pillars of work:

• Reviewing the data landscape supporting NIMBUS
• Evaluating dataset applicability to NIMBUS
• Convening expert input to guide the project and ensure transferability to the wider energy sector and beyond.

Download our data accessibility and interoperability report here

The REACT project is funded by energy network users and consumers through the Strategic Innovation Fund (SIF), a programme from the UK’s independent energy regulator Ofgem, managed in partnership with Innovate UK. The project’s partners are Scottish and Southern Electricity Networks (SSEN) Transmission, National Grid Electricity Transmission, SGN, Olsights, MapStand and Icebreaker One.

Access the report here.

Aligned with our ethos of collaboration: ‘to go far, we go together’, they contribute to our mission of making data work harder to reach net zero. Now we want to highlight some of the important work they do for both people and the planet.

This week, I speak with Melissa Tallack, Managing Director of C2Life and co-lead on the Stream initiative. The conversation covers our ever-changing relationship with water as well as looking at the water sector’s journey into open data. We also discuss the important decision to value encouragement over mandates and to champion collaboration over siloed work.

Ross: Hi Mellisa, thanks so much for taking the time to speak to me. Could you start by giving me an idea of your background in the water sector and your journey so far?

Melissa: I joined the water industry off the back of its privatisation. Privatisation was in 1989 and I joined in 1993. I first joined Anglian Water, only planning to stay for a couple of years, but I discovered that there’s a lot to do in the water sector. I’ve been fortunate enough to have a variety of roles from frontline operations to scientific to asset management.

The last third of my time at Anglian Water was spent in the world of data and information. The reason I stepped into that role was because, in 2014, a regulation change came into place that required us to make different investment decisions. It meant not just looking at capital expenditure (CAPEX) and operating expenditure (OPEX) but now also total cost of expenditure (TOTEX). Data became critical here, as you need more and more reliable information to make these decisions. 

There was also a strong feeling in the sector that the data we had wasn’t up to standard, everybody felt it was either bad or simply not good enough. And yet, no one was really prepared to step forward and do anything about it. Myself and a couple of colleagues then started leading a piece of work around enterprise information management to solve that challenge. That sort of began my career in data and my interest in data as a fundamental resource in the company.

Following this, I went on to stand up an alliance of partners to work alongside Anglian Water in tackling the challenges of enterprise information management. I ended up running the data service and digital service within Anglian Water which modernised big data analytics platforms as well as modernising a lot of technology and practices within Anglian Water. 

During that time we were increasingly thinking, if we only use our own company data to answer these questions, we’re going to end up with a very siloed view of the world. We wanted to bring in external data sets and open data sets, but we also believed that by publishing our own data sets, we could get more eyes on the problem. Getting that diversity of thought was key and we were already used to being challenged from the outside in, so it kind of felt like a natural progression.

At the same time Northumbrian Water were gathering like-minded people together to talk about open data. They shared our view that this was the way forward but agreed it would be better if we all did it together. We got enough indication to suggest it was valuable and we then set our eyes on securing some funding to enable us to build out this thing which would enable open data for the sector. This marked the beginning of ‘Stream’. 

Ross: It’s fascinating to hear the journey that the water sector has been on and your place in it! Could you help me understand the Stream initiative better?

Melissa: What we’re trying to do with Stream is lower the barrier to publication as much as possible. It doesn’t matter how rough and ready it is or if you can’t connect to it programmatically, we will get there and we’ll build that capability together within the consortium of water companies. What’s important is getting data out there. I understand that people are reluctant to release data because they might be worried about it being the right format. But some data is better than none. That is definitely the philosophy we’re adopting. We’ll learn through doing, we’ll learn what people value and we’ll improve our own capability as a sector by doing this. But you have to start somewhere. It’s about building a two-way conversation with your community of users. You have to encourage, you can’t mandate.

In terms of datasets it’s very early days and so far, we’ve only released three datasets. One of those is a very foundational dataset that focuses on the boundaries between water companies. The other one that’s been published is drinking water quality. Traditionally, people would have to go to a company website and enter in a postcode to get a value for that postcode, which is useful if you want to look at one data point, but actually not very useful if you want to look at this compared to elsewhere in the region or in another water company. Now, by publishing historical drinking water quality data, you are able to do that comparison. Having said that, it’s a downloadable data set and not one that you can connect to programmatically. So I think that will probably limit the use of that data.

Ross: So it seems like there needs to be transparency not only of the data but also transparency and honesty in the ways we approach it? Where do you envision the key benefits coming from in the Stream initiative?  

Melissa: I think the environment is probably going to be a key beneficiary because that’s where a lot of the focus is. And, I hope it is, because the fundamental hypothesis behind opening water company data is to encourage transparency and trust and to drive innovation. By helping the environment, these benefits should trickle down to helping people and societies because whether we like it or not, we’re all intrinsically linked to the water environment because we rely on clean water to survive. But water companies are just one of the players in the natural environment. We can’t solve that problem alone and we need to rely on other people to work with us. A key ingredient to all of this is people’s willingness to collaborate. 

What’s promising is that we first started talking about this in April 2020. It shows you the level of commitment from the water companies to do this because we’re all still here and we’ve grown in number. In fact, we’ve now got all but two of the UK water companies as members of Stream so it’s great to see an industry actually pulled together like this. Don’t get me wrong, there is a varying spectrum across the water companies but there is certainly a strong willingness to collaborate and do this together because we know the benefits are greater if we’re working as one.

Ross: Do you think our relationship to water and the water sector has changed?

Melissa: Our relationship to water has changed, especially over the last few years. During Covid more people were spending time outside, taking up wild swimming. In fact, I think our relationship to water is always shifting. Water scarcity is certainly an increasing problem in the face of climate change and changing weather patterns, certainly for the vast majority of the UK but in the South especially. It’s here that water consumption and unaccounted for water leakage are key issues to address because we’ve got to have enough water to go around. 

If we’re able to make the operational data more transparent, people can be better informed and make different decisions about what they do with water. As an example, if you knew how you as an individual compared to people who live in the same type of property or have the same demographics and were able to see that information, would you make different decisions? And it’s not only the individuals, but what products and services can be built off the back of that data to help. 

But as I mentioned, there are many other factors and stakeholders involved. We operate in a system of systems. Take energy and water, for example, they have a strong reliance on each other. And while, historically, water has been more reliant on the energy sector, this relationship is beginning to invert. When people think of water, they think about drinking water but people rely on water for a multitude of reasons. And now, you’ve got a large number of hydrogen projects coming up where water is, of course, fundamental. 

During March’s meeting, we heard updates on the current state of play in the energy sector, including new publications, investment announcements, code reforms and the government’s Smart Data strategy. Icebreaker One outlined work in productisation of data sharing initiatives. Ofgem shared an update on consumer consent, the use of ‘Trust – Prepare – Share’ principles in Data Sharing Infrastructure (DSI) and data best practices. The top three priority areas of DESNZ include publishing the Digital Spine Feasibility Study; innovative projects in the development of automatic asset registration; and Smart Data Schemes. Finally, updates on the Virtual Energy System (VES) and DSI were shared, including a high level roadmap for delivery. 

With 2024 looking to be pivotal for the energy sector, the Open Energy Steering Group is actively inviting stakeholders to join and participate in these key discussions.

Key insights:

• Updates on the current state of play were noted, including:
  • REMA Review Documents
  • Ofgem’s publication on data sharing in a digital future.
  • Ofgem’s open letter on data best practices.
  • National Grid ESO £60B announcement on upgrades.
  • Energy codes reform as code bodies may become licensed.
  • The ‘Data Bill’ (DPDI) is progressing to Royal Assent this year. 
  • The recent budget has an allocation for smart data. 
• Updates from IB1 were noted, outlining work in productisation of data sharing initiatives:
  • Icebreaking – the process of governance, including SG and five AGs to select use cases, collectively define and approve the rules in a Scheme .
  • Trust Framework – identity management and registry, assurance, principles of data sharing and Open Data publishing (https://ib1.org/definitions/trust-framework)
  • Scheme – use-case-led set of specific rules related to data sharing and  its market implementation (https://ib1.org/definitions/scheme)
• Ofgem presented an update on:
  • Consumer consent – a secure, trusted method for giving informed consent to share smart meter data to allow for Flex, innovative products, enhanced visibility and lower costs.
  • Data Sharing Infrastructure – secure and reliable Data Transfer, using ‘Trust – Prepare – Share’ principles.
  • Data Best Practices – standardising and surfacing system data through licence/code obligation to follow the DBP. Expansion across the energy sector will evolve common standards & methods of triage, aggregation, taxonomy, etc.
• An update from DESNZ was presented, including three priority areas:

1. Publishing the Digital Spine Feasibility Study.
2. Visibility of small assets (asset registration service).
3. Smart Data Schemes.

• A Virtual Energy System & Data Sharing Infrastructure update was presented:
  • The feasibility study resulted in ‘Trust, Prepare, Share’ framing. The Prepare and Trust elements are being delivered by the National Digital Twin and IB1 (via Open Energy) respectively.
  • A high-level roadmap for delivery was shared.
• It was further discussed that the broader vision of the ‘digital spine’, ‘virtual energy system’ and ‘open energy’ (which all now sit under the Data Sharing Infrastructure) is market-wide interoperability.
• The governance of Open Energy was discussed:
  • It was noted that given the various programmes and priorities discussed, that 2024 is a pivotal year for energy data.
  • Government values broad industry representation, so who should be in the SG?
  • Broadening industry representation was seen as a priority. 
  • Stakeholders in retail, smart device manufacturers and suppliers were suggested.

Email us at openenergy@ib1.org to get involved in Open Energy.

Wednesday January 24th marked the second advisory group meeting for the NIMBUS (Network Innovation and Meteorology to BUild for Sustainability) project, a collaboration involving Icebreaker One, SSEN Transmission, SSEN Distribution, IBM and Palantir.

The meeting explored the energy sector’s readiness for data sharing, outlining the importance of this for the NIMBUS project as it looks to grapple with energy asset degradation and reliability.

Understanding weather data

There are a number of weather events that can impact energy infrastructure. These include wind damage, flooding, temperature extremes, lighting strikes and more. And, by accurately factoring in these weather-related events, organisations can optimise maintenance schedules or plan for equipment replacements therefore extending the life cycle of these assets. 

Despite this, not all weather events are factored into risk. Lighting strikes, due to their transient nature, are an example of a weather event that has proven hard to predict and difficult to factor into the risk assessment of an energy asset. That’s not to say that lightning strikes aren’t tracked, with one member of the advisory group noting that network operators look at historical data on lighting strikes to find patterns, and identify similar conditions in the future. 

Historical vs real-time data

Accessing historical data on weather events is generally more straightforward than accessing live, real-time data. This is because historical weather data is often open and more easily accessible for users. This compared to real-time weather data which is more likely to be subject to licensing agreements. These discrepancies were noted by the advisory group, with a collective recognition that the energy industry, as a whole, requires a shift in mindset when it comes to sharing data. 

The current reality of siloed pockets of data across the energy sector is a system that no longer serves the industry. More than this, it’s a system that’s holding the energy industry back. By incorporating a governance structure, we can break down these silos within the energy industry and beyond, building a culture of collaboration. All steps that will help SSEN-Transmission accelerate its net-zero transition. 

Demonstration of a digital tool

During the meeting, a live demonstration showcased a digital tool focused on transmission lines, towers, and subcomponents, offering a detailed view of operational data, faults, work orders, and inspections. Utilising IBM’s weather data, the digital tool incorporated over 30 variables, providing a granular analysis of weather patterns over a six-year history. The landing page offered insights into weather data associated with towers, exploring historical patterns to understand potential damages. 

Now halfway through Ofgem’s Strategic Innovation Fund (SIF) Alpha stage, NIMBUS has developed a high level plan and roadmap for a use case. It has also identified system requirements, created architecture for proof of concept and fed asset and weather data (from IBM) into its model.

In January 2024, we convened the second REACT Advisory Group meeting, co-chaired by SSEN-Transmission and Icebreaker One. In partnership with SSEN Transmission, Olsights, MapStand, National Grid Electricity Transmission and SGN, IB1 is part of the Alpha phase of REACT, which aims to create a geographical planning tool providing users with the ability to view electricity grid connection requests in real-time, using an interactive visualisation map.

The purpose of this meeting was to gain a collective understanding of progress on sprints, and to discuss what datasets developers would like to have access to and what would be possible if they could access these datasets. Advisory Group members also discussed what the risks are to share this data, and how to improve interoperability of data going into and out of REACT. 

Key insights

• REACT Tool Progress Update from Olsights & Mapstand:
  • Sprints 1 & 2 have been completed and include “negative” land use layers, ie. areas where projects cannot be sited.
  • Sprint 3 is underway and is focused on specific Hydrogen project site requirements, such as available water supply.
  • Future sprints will focus on curtailment, future scenarios, and “positive” land use, i.e. where Hydrogen projects are actively encouraged.
• There are a large number of potentially shareable datasets within the network connection request process. Prioritising which to share should be based on user needs and how they solve business problems.
• Making datasets shareable does not necessarily mean publishing them openly but may mean sharing them within a safe and secure Trust Framework.
• REACT must embrace interoperability both into and out of the tool to ensure the tool can be used by the greatest number of potential stakeholders.
• With regard to accessing datasets, it was discussed that:
  • Accessing gas infrastructure data requires shared not open data since it is critical infrastructure; the REACT team have discussed creating different access levels for different target users to mitigate against such data sensitivity issues.
  • The Stream project, centred on publishing water data, could be highly relevant to REACT.
  • There are data sensitivity issues around mapping data e.g. address data, street geometries, though the situation has evolved rapidly in recent years.
  • Council planners would welcome early access to information about projects that are applying for network connections.
  • More affordable/accessible network connection process could benefit community energy projects, though this raises issues of data sensitivity, e.g. what criteria determines access to shared, non-open data?
  • More effective data sharing between electricity companies and other area-focused stakeholders, such as councils, water companies, via REACT could provide more effective, joined-up thinking to achieve Net Zero e.g. helping councils co-create decarbonisation plans could encourage councils to invest in network upgrades.
  • Technology innovators could potentially assist with complex and time-critical elements of the network connection process through safe and secure data sharing within a Trust Framework.

Diagram showing possible datasets created prior to and during the Network Connection Request pipeline of a Transmission Owner; created using information from ESO Connections Offers Process

• With regard to interoperability and standards, it was discussed that:
  • For publicly funded projects like REACT, better data reliability and consistency within datasets, and better interoperability across datasets would deliver better value-for-money for taxpayers.
  • Regulatory bodies and trade organisations could provide an invaluable role in defining standards, though this could take time – are there faster ways to get there?
  • Within the local government, there has been useful work trying to achieve standards in underground infrastructure data (MUDDI/VAULT).

Starting is, as it always is, the most important part of the journey and this helped us steer clear of decision inertia. And so, with our advisory group members as our guides, we began to refine the focus of our work, finding a point of leverage that would provide both environmental and financial impact.

The Global Impact Investing Network (GIIN), estimates the size of the impact investing market to be around $1.164 trillion in assets under management. This underscores just how substantial the market is and how instrumental it could be in mobilising finance towards net-zero. 

Now, with our Impact Investing project drawing to a close, we have drafted our recommendations for COP28. Looking at how to develop environmental data in ESG to better enable impact investment decisions in the commercial built environment.

Our recommendations: 

1. Organisations must produce discoverable and usable digital environmental ESG reports of their transition to net zero.
2. Organisations must publish the data behind environmental ESG reports in machine-readable formats.
3. The granularity of environmental data in ESG reports must be improved.
4. Organisations must demand data-backed standardised environmental reporting from their supply chains.
5. Regulators and reporting bodies must mandate and finance a trusted data sharing ecosystem.

These recommendations have been shaped and refined through collaborative efforts with our advisory group members. The outcome is five data-centred points of leverage that we believe could accelerate the impact investing market’s transition to net-zero. 

Now, as we look to the future, governments and regulators will undoubtedly play a central role, with uncertainties looming up ahead in the form of a new election cycle in the UK. Equally, there is promising legislation on the horizon with the Corporate Sustainability Reporting Directive (CSRD) creating a common framework for sustainability reporting. Either way, we have, and will continue to encounter tough terrain on this journey. But, with data as our rope and harness, our sights are fixed firmly on the summit that is net-zero.

We’re asking organisations and experts to endorse our approach.

There are three key parts to our approach:

1. The development of open standards that enable open marketplaces for data-sharing of both Open data and non-Open data
2. Laying the foundations for interoperable and cohesive energy data infrastructure
3. Building on existing work and the sunk costs invested in existing initiatives

Click here to endorse our approach as an individual expert or on behalf of your organisation. 

We believe we’re the best team to take on this work because: 

• Open Energy is the leading solution and has already received investment from government 
  • The UK Government has already invested in our approach, helping make Open Energy a leading solution to the needs articulated by the ‘digital spine’ idea.  
• Icebreaker One is independent and trusted
  • As a non-profit and non-partisan organisation, our approach will always be led by the needs of the stakeholders who have and need net-zero data
• Open Energy works
  • Open Energy is working: new data is being shared regularly and support is widespread across the sector.  
• Icebreaker One is set up for maximum impact
  • Icebreaker One is focused on our mission to help the sector achieve its net-zero goals – meaning that our solution is set up to have the most positive long-term impact.   
• We’ve been endorsed by key players
  • A recent report by Energy Systems Catapult, who authored the Digital Spine report, said: “The regulator should mandate Open Energy as an industry wide data sharing mechanism. Open Energy has, via a competition run by government, created a service that enables trusted actors to share data in a consistent way across the energy value chain. Mandating this solution would accelerate its adoption and make consistent an approach, reducing costs and barriers to entry.”

Click here to endorse our approach as an individual expert or on behalf of your organisation. 

The research study will build on the Energy Systems Catapult’s Energy Digitalisation Taskforce report.

Read more here about how Icebreaker One supports the delivery of the recommendations made by the taskforce.

“Icebreaker One are developing our national data infrastructure. It’s as important as our roads, rail, water and broadband networks”

Lord Maude of Horsham

Photo credit: Spiky fireworks by Sheila Sund on Flickr, CC BY 2.0

A panel of experts gathered to discuss the emerging pressures and priorities for DNOs and the wider energy system, in Icebreaker One’s January webinar hosted by Open Engagement Manager, Vichi Chandra.

“We can’t talk about anything happening in the energy market without thinking about the current context of rising gas prices, the current cost of living crisis, and what that means to people” says Dhara Vyas, Deputy Director, Energy UK. “High prices are – rightly – driving the media narrative right now and that has meant a significant shift away from the UK leading the way on decarbonisation and net zero, to the current cost of living crisis which impacts on everyone. 

“However, I think there is a significant, real concern that this should not mean we put the brakes on our journey to achieve a net zero system. It’s really important that we think about this in the context of the consumer.”

Matt Webb, Head of Enterprise Data Management, UK Power Networks highlighted the role of DNOs in making this happen: 

“We need to accelerate the connection of low carbon technologies and maximise their use in order to contribute to net zero ambitions. At the same time, we must maintain our core role of ensuring the continuity and quality of energy supply. We cannot lose sight of the fact that we need to keep the lights on”.

Matt Webb, UK Power Networks

A period of transformation

January’s Energy Digitalisation Taskforce report made a number of key recommendations detailing what is required to deliver a digitalised and decarbonised energy system.

“One that stood out to me was the call to embed a culture of digitalisation and I think that’s really important”, said Dhara.

“It’s essential that companies across the market are planning for a digital system when it comes to building the right skills and investing in digital assets and activities. DNOs are of course a vital part of that infrastructure, and the networks in fact have a much better understanding of the state of the system than perhaps a lot of other parts of the sector; so it’s vital that they share that across the market in order to help us build the system of the future”

Dhara Vyas, Energy UK

It’s a viewpoint shared by Matt. “Digital transformation is as much about culture, behaviours and ways of working. And that’s where we as a sector need to shift to be more open and collaborative. We talk about interoperability a great deal; and that’s about how we align and standardise and facilitate communication and interaction between the different players in this ecosystem. 

“The RIIO ED2 business plans that we as DNOs have published in recent months, go into significant detail about how we plan to invest and develop our digital capabilities over the coming years, right the way through until 2028. We find ourselves at a really pivotal and important point in terms of how we meet this ongoing challenge, and ultimately deliver the interoperable energy system of the future that we are all aiming for”.

The shift that is required of DNOs, and the wider energy system as a whole, is significant. As Matt explains, “in normal terms, what a DNO is and does, is quite monolithic. And all of a sudden, to find yourself in a central, facilitating role is a big change to make. Traditional network operation entails fairly passive and predictable systems, and we’re now moving into – and are in the midst of – a far more dynamic environment. We need to help facilitate new forms of service, service providers and business models; increasing competition and consumer choice as well as supporting a flexibility first approach”.

How Open Energy can help

Open Energy is a service that makes it easy to search, access and securely share energy data. It covers the full spectrum of data; all the way from open data to really hard to access, commercially sensitive shared data, where access control is important. The Open Energy service currently includes search and access control, co-designed over the last 18+ months by industry, for industry, with support from and engagement with BEIS, InnovateUK and Ofgem (who sit as an observer on the Open Energy Steering Board).

Gavin Starks, Founder and CEO of Icebreaker One, states:

“The approach that we’ve taken with IB1 and the development of Open Energy has been to ask what are the market design principles for data sharing that can scale to whole markets, and across sectors? This has led the teams to understand how to reduce the friction, and connect data between organisations, without insisting that anyone has to put their data in a particular place. Secure data exchanges are made possible by the adoption of open standards and a shared data infrastructure that underpins cohesion and interoperability across the market.

Gavin Starks, Icebreaker One

“What we’ve been focussing on is the really valuable information that tends not to be Open – and in many cases can’t be Open. As soon as you need a set of rules around that, there needs to be a set of legal contracts and a set of processes whereby the control around who can access what recommendations, when, and so on, can be codified. There’s a lot of work there on how we can give that Access Control to the people who hold the data. 

“Whether or not that’s a business-to-business context or whether it’s a consumer context; the mode of consent, the process of consent management, and rights assignment to the data are all miles away from what organisations are used to thinking about and dealing with. So there’s a massive amount of work to be done in helping to understand the problems that everybody’s trying to solve, both in terms of infrastructure, but also in understanding what the rules are and how we can bring people together so that we end up with an open marketplace”.

What are the opportunities here for DNOs?

Matt says: “When it comes to data, commerciality is certainly one of those factors we need to think about, and we need to be cognisant of the fact that we work in an increasingly competitive market. However, we need to recognize that we are part of an ecosystem now where that commercial data is key. The key to that is us working collaboratively and trying to establish the common processes and practices that make sure that we’re making consistent decisions.” 

Dhara agrees that a whole-system approach is needed: “we have identified all the pieces of the puzzle but now we need to put them together”.

“It’s not just about DNOs but everyone in the sector; the challenge is manifold” adds Gavin. “Leadership needs to come from various different points of the system – government and market leaders – and a lot of the innovation will come naturally from large organisations and smaller start-ups. The question is: how can we do all that together? 

“What we’ve tried to create here with the Open Energy programme is space for that to happen. So ultimately we’re here to help bring people together, have the right conversations and really focus on where that business value is and how that interlinks with the overall data strategy; both for individual organisations and for the sector as a whole”.

Get involved

• Become a member of Open Energy to use our pilot service
• Join Icebreaker One, which develops and operates Open Energy, as a supporter
• Sign up to the Open Energy newsletter

Archive video:

What:

Our January Open Energy webinar will explore what a DNO could look like by 2030, as the UK strives to digitalise its energy networks and cut emissions by 68% as part of the Paris Agreement.

Considering the decade ahead, our panelists will discuss imminent questions such as the challenges and opportunities that digitalisation and net zero bring for the energy sector and the role of DNOs in the transition process. They will offer their unique perspectives on how demands on DNOs are likely to change, including from other energy system actors as well as Government and regulators, and the cultural shifts required inside the energy ecosystem over the next few years.

Speakers:

• Vichi Chandra, Open Engagement Manager, Icebreaker One (Chair)
• Gavin Starks, Founder, Icebreaker One
• Matt Webb, Head of Enterprise Data, UK Power Networks
• Dhara Vyas, Deputy Director, Energy UK

If you think a colleague or sector expert would be interested in joining this event, please share it with them.

Open Energy has been supported in-part with UK Government funding from UK Research and Innovation (UKRI) and BEIS.

Archive video:

What:

Our January Open Energy webinar will explore what a DNO could look like by 2030, as the UK strives to digitalise its energy networks and cut emissions by 68% as part of the Paris Agreement.

Considering the decade ahead, our panelists will discuss imminent questions such as the challenges and opportunities that digitalisation and net zero bring for the energy sector and the role of DNOs in the transition process. They will offer their unique perspectives on how demands on DNOs are likely to change, including from other energy system actors as well as Government and regulators, and the cultural shifts required inside the energy ecosystem over the next few years.

Speakers:

• Vichi Chandra, Open Engagement Manager, Icebreaker One (Chair)
• Gavin Starks, Founder, Icebreaker One
• Matt Webb, Head of Enterprise Data, UK Power Networks
• Dhara Vyas, Deputy Director, Energy UK

If you think a colleague or sector expert would be interested in joining this event, please share it with them.

Open Energy has been supported in-part with UK Government funding from UK Research and Innovation (UKRI) and BEIS.

1. A web of energy data for everyone that unlocks an open market for existing players, innovators and investors to create benefits for industry, consumers and society.

2. Easy access to authenticated and reliable energy data that maximises value and minimises barriers to competition across the energy sector and beyond.

3. Market-wide cohesion and interoperability across the energy and related sectors, supported by open standards and data infrastructure that underpin and enable downstream markets.

4. Material impact to accelerate innovation and decarbonisation, delivered by industry participation, regulatory support and growth of a thriving ecosystem.

We believe this will: 

• unlock a web of energy data for everyone
• accelerate the transition to net zero
• help unlock innovation and finance across energy and connected markets
• democratise rights to access and use of data
• enable engagements for discourse and decision-making
• provide common solutions for interoperable technology
• take close, collegiate collaboration between industry, Government, regulators and other stakeholders to address societal shared challenges
• empower businesses and consumers to reduce costs and deliver net zero

For more detail about the definitions of terms, including cohesion and interoperability, see https://ib1.org/the-icebreaker-one-trust-framework/