Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GB Renewables Map

renewables-map.robinhawkes.com

Post reply on HN
Print view View original

31–40 of 52 posts

Re: GB Renewables Map

#31

Post by robhawkes »

albumen wrote: post #30
robhawkes wrote: post #25

Earlier quoted context omitted.

The lines are sort of arbitrary in a geographic sense as in reality they are defined based on the intersection with the schematic version of the transmission network [0]. Though yeah, that specific example is an odd one and I'd be interested to understand more about why it was placed in one boundary and not the other. [0] https://www.neso.energy/data-portal/day-ahead-constraint-flo...

Lovely site. As a wind energy ignoramus, it would be great to add descriptions to your FAQ for the red lines, and curtailment.

I'll make sure to get the about page updated soon, it's been a bit neglected with being so focussed on the recent upgrades. Definitely a lot I can explain better, and also ways that I can solve that with better UX in general.

Re: GB Renewables Map

#32

Post by donalhunt »

Nice job dodging the awkwardness of whether to include Ireland, Northern Ireland, etc (IE and NI operate as a single, all-island wholesale electricity market). :)

Re: GB Renewables Map

#33

Post by robhawkes »

donalhunt wrote: post #32

Nice job dodging the awkwardness of whether to include Ireland, Northern Ireland, etc (IE and NI operate as a single, all-island wholesale electricity market). :)

I actually have plans to include Ireland and Northern Ireland once I get the GB side nailed down. The data seems to be mostly available though I'd have to really think about how to make it work well on the app as it'd be a pretty fundamental change to how things currently work (assumes a single market).

Re: GB Renewables Map

#34

Post by jacquesm »

robhawkes wrote: post #26
ksec wrote: post #20

Earlier quoted context omitted.

Tech Stack used? Any specific non-technical difficulty getting this done ?

Tech stack is a mix of things, but the big-ticket items: - Dagster for data pipeline - Parquet files for data format - Cloudflare R2 for data storage - DuckDB for data processing - NodeJS for API - NextJS + React for the app - MapLibre for the base map functionality - Deck.gl for the complex map layer (eg. wind particles) - WeatherLayers (+ GFS) for the wind particles - Cloudflare as a caching layer The main difficul…

It's a beautiful piece of work, thank you very much.

It would be amazing if this was extensible and wind farms and solar farms outside of GB could contribute their data as well.

Re: GB Renewables Map

#35

Post by martinald »

robhawkes wrote: post #24
pjc50 wrote: post #22

Earlier quoted context omitted.

> "Please don't tell me that we are paying batteries to _not_ export" – it's actually the opposite, the batteries paid to not export (at least today). Unfortunately you've got at least one negative wrong in this sentence and I'm still confused, and the linked dataset is currently blank? Sorry for complaining, this is a great website!

No worries. The Detailed System Prices dataset is lagged by a couple hours so try going back in time. The simplest answer I can give is that assets place bids and a volume of energy that they are willing to turn down if the system operator needs to. Those bids are either positive or negative in value and this depends a lot on the type of asset, for example wind assets usually bid negative (ie. we pay them to turn dow…

Ok, got it I think.

So actually the battery operator is paying _the grid_ to turn down output from whatever was previously agreed (because they think they'd get more money for it later?).

And this shows as curtailment on the map?

Let me know if I'm directionally right here. If I am, it would be good to see 'bad curtailment' vs 'good curtailment' (i assume if bids are negative/positive?)

Re: GB Renewables Map

#36

Post by addedlovely »

robhawkes wrote: post #12
parkersweb wrote: post #4

This has just had a major update to include other renewables (eg hydro, solar) as well as non-renewable energy sources (gas). It’s also added grid boundaries and cabling recently - and I think there’s also wind roses planned? My one UI wish - the energy sources filters are currently displayed as options on the map - rather than controls for the entire UI - which meant I missed them entirely at first. Would be great i…

Definitely wind roses planned, I posted about them on my LinkedIn page if anyone is curious (linked on the main map). That's a great point about the controls. Originally the map only showed wind farms and as I've expanded the features the control system (and really the entire UX) hasn't kept up. I need to sit down and have a proper think about how best to design the controls and documentation.

FAQ also mentions it's only wind, so took me a while to notice :)

Would be nice to have a definition of 'Turn-up' and 'Curtailment' in that FAQ for us non grid savvy visitors.

Works great though, well done.

Re: GB Renewables Map

#37

Post by addedlovely »

Just noticed the wind farms even have the individual units ( I assume ) and their interconnections mapped?!

Would show that off and zoom into them when selecting them from the list view!

Re: GB Renewables Map

#39

Post by robhawkes »

jacquesm wrote: post #34
robhawkes wrote: post #26

Earlier quoted context omitted.

Tech stack is a mix of things, but the big-ticket items: - Dagster for data pipeline - Parquet files for data format - Cloudflare R2 for data storage - DuckDB for data processing - NodeJS for API - NextJS + React for the app - MapLibre for the base map functionality - Deck.gl for the complex map layer (eg. wind particles) - WeatherLayers (+ GFS) for the wind particles - Cloudflare as a caching layer The main difficul…

It's a beautiful piece of work, thank you very much. It would be amazing if this was extensible and wind farms and solar farms outside of GB could contribute their data as well.

Thanks! I would love to make this something that works beyond GB though right now that would require a fundamental change to the way things are set up. It's on my list though, so one day.

Re: GB Renewables Map

#40

Post by robhawkes »

addedlovely wrote: post #36
robhawkes wrote: post #12

Earlier quoted context omitted.

Definitely wind roses planned, I posted about them on my LinkedIn page if anyone is curious (linked on the main map). That's a great point about the controls. Originally the map only showed wind farms and as I've expanded the features the control system (and really the entire UX) hasn't kept up. I need to sit down and have a proper think about how best to design the controls and documentation.

FAQ also mentions it's only wind, so took me a while to notice :) Would be nice to have a definition of 'Turn-up' and 'Curtailment' in that FAQ for us non grid savvy visitors. Works great though, well done.

Ah yeah the FAQ is very out of date and in need of a full rewrite. I'll get to that eventually. And you're right, I'll make sure to add some sort of glossary and perhaps also explain things better in-situ.
Post reply on HN