Live data from Hacker News

300 meters resolution SF Bay Area Forecast

sf.atmo.ai

101–110 of 119 posts

Re: 300 meters resolution SF Bay Area Forecast

#101

The secret sauce to making accurate forecasts at 300 meter resolution has to be something more than “AI” right? I mean, there’s little reason to think AI should be meaningfully better at filling in details at 300m resolution than it would be at picking lottery numbers, no? Am I thinking about this wrong?

Nah, just run the WRF model at a 300m horizontal resolution and use a regional model or GCM for the boundary conditions. No AI necessary.

Re: 300 meters resolution SF Bay Area Forecast

#102
post #75

Earlier quoted context omitted.

One of the interesting things the model captures at this resolution is the dynamics of the wind going in the bay through the golden gate. See for instance: https://sf.atmo.ai/wind@37.80911,-122.44543,11.68,36,0,16669...

The Global Forecast System (GFS), i.e. the model presently used at NCEP, has a grid resolution of 18 miles (28 km). It is (has been, for years, actually), the second best global forecast system, right behind the European ECMWF (sometimes outperforming it, but on average slightly underperforming it, in terms of accuracy). I don't know how the ECMWF model works, but even as someone who did not study meteorology (but st…

I would be curious how far DeepMind could get if they moved into this field. Would perfectly fit into the list of fields they turned upside down (or at least 45 degrees) in the recent years.

Re: 300 meters resolution SF Bay Area Forecast

#103
post #75

Earlier quoted context omitted.

The Global Forecast System (GFS), i.e. the model presently used at NCEP, has a grid resolution of 18 miles (28 km). It is (has been, for years, actually), the second best global forecast system, right behind the European ECMWF (sometimes outperforming it, but on average slightly underperforming it, in terms of accuracy). I don't know how the ECMWF model works, but even as someone who did not study meteorology (but st…

I would be curious how far DeepMind could get if they moved into this field. Would perfectly fit into the list of fields they turned upside down (or at least 45 degrees) in the recent years.

They already did begin exploring this field, starting with precipitation nowcasting - like every other AI shop out there (see https://www.deepmind.com/blog/nowcasting-the-next-hour-of-ra...).

Numerical weather prediction is a _very_ well established field. In fact, large tranches of modern computer science and computing in general owe their existence in direct ways to the importance of numerical weather prediction, since this was one of the original applications of digital computers! Modern weather forecasting models are extraordinarily sophisticated scientific and engineering achievements. It's not obvious that AI actually offers any significant, immediate benefit over these tools save for niche, simplified forecasts (e.g. precipitation nowcasts) - certainly, given the prowess of modern NWP, the ROI is likely to be very low for research investments into general purpose AI weather forecasts.

One might then argue that perhaps AI can be useful to help refine or post-process these existing forecast systems? But of course - we've been doing just that since the 1970's. In fact, even the basic weather forecast that you might get from your national weather service these days is based on a sophisticated statistically post-processed machinery applied to not one but dozens of weather forecasts.

Weather prediction is unlikely to be a field where AI practitioners stumble across a significant improvement to the status quo. It would be far wiser to work closely with meteorology experts to solve practical and _useful_ weather forecast problems - like, is that thunderstorm I see on radar likely to produce a tornado in the next 45 minutes?

Re: 300 meters resolution SF Bay Area Forecast

#104
post #64
post #57

Earlier quoted context omitted.

Another anecdote: In the South of Germany at least, long stretches of sunny days are often followed by sudden thunderstorms with equally sudden bursts of rain. That "fact" had been so deeply ingrained in me that it was subconscious. You'd have a careful feeling if it was hot for too long, suddenly you might find yourself running for the next awning to escape the torrential rain. Sunny weather was a bit like building…

Midwestern USA has similar stretch of hot summer followed by thunderstorms.

May (followed by April and June) are the most active months for storms, especially tornado producing ones in virtually every state in the Midwest USA, well before “hot summer” days.

Re: 300 meters resolution SF Bay Area Forecast

#105

Earlier quoted context omitted.

All fixed up and deployed.

<3 thank you for the quick fix! no unit switch yet right, or am I missing it?

It will come within the next few days - please stay tuned. Being from Europe I am more used to Celsius myself :)

Re: 300 meters resolution SF Bay Area Forecast

#106
post #15

How do you switch to normal (for 97% of humans) units for temperature and wind?

We will be adding the Celsius switch shortly. We started with F since we expected most users of the forecast to be in the bay area but it is great to see interest from non Fahrenheit users :)

Re: 300 meters resolution SF Bay Area Forecast

#107
post #35

Earlier quoted context omitted.

Given this is in the SF bay there a number of high quality observations that you can use to validate the forecast skill (unlike India and Africa). I have not bothered doing this here since… well that’s too much like my day job. I’m always excited to see new forecast products, generally. If I were to guess (as an above comment did) it looks like they are applying some dynamic downscaling on top of either a custom WRF…

The website claims to be using DL which may mean less of a model-centric approach? The expertise of the people at the top of the organization, on this problem, seems a little thin, TBH. And, no stated validation results at all? Without such details, this is just marketing. It would be interesting to see how this behaves for longer prediction times and across a range of difficult forcing conditions off the ocean in th…

We are currently integrating with Forecast Watch a 3rd party that analyses and compare various forecasting systems [1]. Please stay tuned until we integrate our APIs. I will be updating this thread when it is ready.

[1] https://www.forecastwatch.com/

Re: 300 meters resolution SF Bay Area Forecast

#109
post #57
post #55

Growing up in Germany, before I moved to the Bay Area, I was wondering why weather apps and widgets were so prolific. Sure, knowing the forecast for next weekend was nice, but for anything closer I'd just get out of bed and look out of the window. That would pretty much tell me what weather it is, and it would usually change just slowly over a few days or so. Then I moved to the Bay Area, and weather does not only ch…

Another anecdote: In the South of Germany at least, long stretches of sunny days are often followed by sudden thunderstorms with equally sudden bursts of rain. That "fact" had been so deeply ingrained in me that it was subconscious. You'd have a careful feeling if it was hot for too long, suddenly you might find yourself running for the next awning to escape the torrential rain. Sunny weather was a bit like building…

Thats what we used to have in Australia, and now it just rains. It's killing my morale atm.
Post reply on HN