Live data from Hacker News

Build yourself a weather station

blog.kdubovikov.ml

111–120 of 127 posts

Re: Build yourself a weather station

#111
post #19

Earlier quoted context omitted.

Well, I think the most important metric you can measure on the surface is atmospheric pressure. Simple temperature and humidity is generally insufficient to make good predictions - but pressure at the surface, measured across a geography, can tell you about conditions in the upper atmosphere. I use barometers in phones for this kind of purpose. I think that a minimum of 1 quality reading per 4 sq km would represent s…

Howdy, seen you posting before. I would be warey of any crowd sourced data. So now we have average american Joe running a weather station that feeds directly into our state of the art GFS model? What if joe forgets to maintain his station? How do you assert quality control? I just am skeptical about this all. cant trust users phones to provide input for mission critical weather forecast models (GFS). Peoples lives de…

> So now we have average american Joe running a weather station that feeds directly into our state of the art GFS model?

No way. The data is quality-controlled and bias-corrected before assimilation. Any bad data is thrown out. The papers I linked above do a good job describing how this is done.

> What if joe forgets to maintain his station?

No maintenance required. Individual data points are irrelevant, this idea only works if you can throw out bad data without caring. So throw out any suspicious data.

> How do you assert quality control?

Sorry to keep directing you to the papers above, but a team of really smart people spent years on this topic and they do a better job of describing it than I could. Cliff Mass et al.

> I just am skeptical about this all.

AFAIK the Weather Channel has been providing your forecasts for some years now in Apple and Google products with all of this barometer data from phones and weather stations in backyards. If you didn't notice a strong quality decline since some years ago, then I would say it's fine. You've probably noticed a forecast quality increase during this time I'd guess.

> cant trust users phones to provide input for mission critical weather forecast models (GFS).

Why not though? What is wrong with any of this method? It is all scientifically tested, researched, peer-reviewed, published, analyzed, post-event-analysis, the whole deal.

> Peoples lives depend on this information!

Well yeah, that's why we need more data! We have so little data now that people are dying from preventable cases like a lack of storm warning or good communication about incoming weather events.

This all matters so much. Ignoring billions of deployed, internet-connected barometers is costing lives that could be saved if we used all the data available to us to make accurate weather predictions.

Re: Build yourself a weather station

#112
post #80

Earlier quoted context omitted.

This is awesome. Thanks for posting this. Question for you do you happen to have a soldering iron you recommend for the build out?

I should technically solder more of this, as it's mostly together with prototype cables at the moment. Any soldering iron should work, but I am partial to Weller Soldering Stations. I have one from ~10 years ago that has an analog adjustment, though now I see they look to be mostly digital. Their website has them around $300 for some reason but they are on amazon for closer to $100 (which is what I got mine for). htt…

Just a warning, amazon has been pretty bad with fake soldering irons.

Re: Build yourself a weather station

#113

Earlier quoted context omitted.

From talking with meteorologists, it seems forecasting actual rain is not very hard if you have enough current data on the state of the atmosphere. What can be difficult is mistiness that is just on the borderline between falling droplets and moisture just hanging in the air. Differences can be extremely local in nature. [I'm not a meteorologist, I program computers, but I'm a pilot so I have a pilot's appreciation o…

Hi geoff - seems like you are pretty knowledgeable here. I have to disagree with "seems forecasting actual rain is not very hard if you have enough current data on the state of the atmosphere" ... Who told you that? accuweather meteologists? Rain is not easy predict, especially long in advance. Just taking things with a grain of salt here. If you truly believe that forecasting actual rain is not very hard, please sta…

No, I'm not especially knowledgeable, not more than others here. As a pilot, I have 42 years of experience flying through weather and helping get the word out w/r/t hurricanes, e.g., relaying info via ham radio in the West Indies from relays in Florida before getting hit by the storms, back in the 1970s when that was the way, so I have long interest in and appreciation of weather. But I do also have appreciation for my colleagues and their meteorological expertise. They have something called MinuteCast which in my experience has been very accurate in telling me when precipitation will begin or end (except when it is misty). Regarding my "forecasting actual rain is not very hard" remark, you are right that a "long in advance" forecast is hard, but I was talking about the short term. Specifically, a commenter had wanted to know if it was going to rain before going out to exercise, and for that example, I meant a forecast of precipitation was easy.

Re: Build yourself a weather station

#114

Earlier quoted context omitted.

Perhaps this is too off-topic but I was just looking into home automation and perhaps someone might have good advice: I have an old (~25-30 years) radiant ceiling heating system with 15 thermostats that are starting to malfunction and I need to replace. I don't want to break the bank just doing this, but I'd love to have the ability to read temperature and command on/off on each of one. I'm going through ESPHome righ…

If you need to control mains AC loads, I highly recommend something like the Sonoff Wifi switches. They're similar to the wifi "Smart plugs" you can get these days but are aimed at fixed wiring installations and they're safety tested. You can also get versions with built in temp\humidity sensors in the switch, then re-flash the Sonoff firmware with esphome and control all 15 from a single raspberry pi running home as…

Do the new models still make it easy to reflash? I thought I saw something about them being somehow locked down.

Re: Build yourself a weather station

#115
post #86
post #3

I already have a setup with a Raspberry PI so I’m only looking for a temperature sensor that: - Is rain proof - Transmits over BLE or WiFi - Can be battery powered

The way I solved this was by buying cheap weather stations from AliExpress. Many of them come with multiple temperature/humidity sensors powered by batteries - for as low as 70$ for a station with 4 sensors. Those sensors transmit on 433 MH or 838MHz radio which has excellent range (20m+ through walls) and long (months+) battery life. On RPi side I only had to get an RTL-SDR receiver and run https://github.com/merban…

Just saw some of the references to RTL-SDR in the thread comments and started down the rabbit hole, and it looks like a fascinating area for hobbyists.

Can you provide some links to temperature sensors you've tried that work well with an RTL-SDR receiver? I'm also interested in setting something up with a Raspberry Pi.

Re: Build yourself a weather station

#116
post #32

I get that people like to play with hardware but for practical purposes, there are public APIs with airport weather station data that anyone can use, published at 5 minute intervals (typically). Considering the data they output must conform to aircraft avionics parsers that are sometimes decades old, they are unlikely to ever change or go away. Since the weather observations are required for IFR flight, the FAA is qu…

My understanding is that the FAA sites aren't as useful as they could be for weather forecasting. Apparently many sites are too close to the ground, so the temperature data and dewpoint data is unusable for mesoscale analysis. Sometimes the dewpoint is above the air temperature, for example, which is impossible. It doesn't really matter for air traffic, but it does matter for forecasting storms. If you are interested…

Don't know where this criticism comes from but temp and dewpoint data absolutely matter for air traffic, because it determines cloud bases. If cloud bases are below the decision height for the instrument approaches into an airport, it's illegal for a commercial operator to depart from there (because they could not reliably return to the field in case of emergency after takeoff).

The standard data output of an FAA weather station is in degrees Celsius, however, there is no accuracy more than that.

Re: Build yourself a weather station

#117
post #80

Nice. I love weather station builds. Here is mine. I added a pm air quality sensor, a infrared rain sensor, some light sensors, a CO2 sensor, an accelerometer, and a loudness sensor. There's a spot for my Geiger counter too but that installation is not done yet. https://partofthething.com/thoughts/weather-and-air-quality-...

This is awesome. Thanks for posting this. Question for you do you happen to have a soldering iron you recommend for the build out?

If you don't want to spend much, the TS-100 or TS-80 are both very good choices under $100.

Re: Build yourself a weather station

#118
post #25

I'm using weewx for my weather station. I pulled the weather station out of a bin at my former place of employment, which is an airmar 200wx, ultrasonic wind sensor that's typically used on boats. The humidity sensor doesn't work, so I wrote a python script, that acts as man in the middle, that reads in the data, and when it gets to the humidity values, it replaces them with numbers from a DHT22 humidity sensor inste…

Thanks for the tip on weewx! Hadn't heard of it, and got my Davis Vantage 2 Pro I just inherited working and posting to weather underground with a raspberry pi + weewx. Real easy

Re: Build yourself a weather station

#119

Earlier quoted context omitted.

So are you saying that they are only good at sales? Out of curiosity where do you normally obtain the raw sensor data?

Hi. first i'm asking you a question about why you posted climacell, not sure you answered it? Feel free to answer it or not. To answer your question, if you want to obtain raw sensor data our government (and some volunteers) maintains a network of thousands of weather stations. Many are automated, many are people doing manual obs. If you know how to write code you can programmatically obtain these data. However you m…

I thought when they said they use existing wireless communication technology, they meant something like Microsoft's distributed signal processing arrays:

https://www.microsoft.com/en-us/research/publication/meeting...

Perhaps using 4G and GSM signal quality as an ad-hoc doppler or metric for precipitation. Is their landing page inaccurate? Are they no different from other companies (besides the good at sales and marketing bit)? They seem to have a lot of big names on their customer list.

Re: Build yourself a weather station

#120

HN ML practitioners would probably find the Climacell method of weather forecasting to be relevant. https://www.climacell.co/

Why is it relevant? Do you know what they use for forecasts? I work in industry and have built weather applications for 5+ years now. Let me tell you, everyone uses the same source data. Machine learning is not going to help predict weather. If it was that simple, someone would have machine learned the weather already and they would be making zillions of dollars with their accurate AI weather predictions. Do you post…

One thing ClimaCell seems to advertise is that they have access to, "Millions of data points from proprietary sources such as IoT, Drones, Airplanes, Cellular Signals, Sat Com Signals, Cameras, and more, combined with traditional data sources."[1] Another of their pages[2] claims they use signal strength on wireless networks as one of their sensor methods, which is where I assume the "cell" might come from in their name. [3] says, "Instead of relying exclusively on NOAA radar data, as other forecasting services do, ClimaCell also gathers information from closer-to-the-ground sources: cell towers, street cameras, connected vehicles, and internet of things devices such as smart garbage cans situated throughout a city."

I'm not familiar with the industry. Are other providers doing this?

(I assume that the question of whether these sensors are at all useful is another matter entirely.)

[1]: https://www.climacell.co/company/

[2]: https://www.climacell.co/blog/virtual-sensing/

[3]: https://www.fastcompany.com/90411326/how-cities-are-using-hy...

Post reply on HN