Why the Sunshine app won’t change weather prediction

With $2 million in funding behind it, the Sunshine app hit the iOS App Store on Wednesday. Sunshine promises to disrupt weather forecasting by using crowd-sourced data and providing custom point forecasts. Sadly, that promise will fall flat.

First, I’m pretty wary of weather companies that don’t have a meteorologist on staff. If Sunshine has one, they’re doing a good job of hiding that fact. It’s not that amateurs can’t be good forecasters, but the atmosphere is more complicated than it is often given credit for. The Sunshine team seems to know just enough to say things that sound reasonable but aren’t really. For example, this quote from CEO Katerina Stroponiati.

The more users we have, with phones offering up sensor data and users submitting weather reports, the more accurate we will get. Like an almanac.

Except that almanacs aren’t accurate. Then there’s this quote from their first Medium post.

The reason weather forecasts are inaccurate and imprecise is because traditional weather companies use satellites that can only see the big picture while weather stations are few and far between.

That’s fairly accurate (though it oversimplifies), but they point to a particularly noteworthy busted blizzard forecast as an example of the inaccuracy of traditional forecasts. Snowfall can be impacted greatly by small differences, but blizzards are fairly large-scale systems, and I’m skeptical that Sunshine would have done any better, especially considering that it has no “experience” outside of the Bay Area.

It sounds like Sunshine’s approach is basically a statistical model. That is a valid and often valuable forecast tool, but it has its limits. Sunshine claims a 36% improvement over “weather incumbents” in its trial period (where’s the published study?), but that involved only 200 testers in the San Francisco area. While definite microclimates exist in that region, it’s not exactly known for wild changes in weather. I doubt such an improvement could be sustained across a wider area.

Sunshine relies on crowdsourced reports and the pressure sensor in new iPhones to collect data. Unlike many other parameters, reasonably accurate pressure measurements are not sensitive to placement. A large, dense network of pressure sensors would be of considerable benefit to forecasters, provided the data is made available. However, wind, temperature, and humidity measurements — both at the surface and aloft — are important as well. This is particularly true for severe weather events.\

Crowdsourcing weather observations is nothing new. Projects like CoCoRaHS and mPing have been collecting weather data from the general public for years. The Weather Underground app has crowdsourced observations, and Weather Underground — along with other sites like Weatherbug — has developed a network of privately-owned weather observation stations across the country. The challenge, as it will be with Sunshine’s reports, lies in quality assurance and making the data available to the numerical weahther prediction models.

I hope Sunshine does well. I hope it makes a valuable contribution to the science of weather forecasting. I hope it gets people asking their Congressional delegation why we can’t fund denser surface and upper-air observations. I just don’t expect it will have much of an impact on its own.

My thoughts on the Mac App Store

This post proves that this is not a newsy blog.

A few weeks ago, I upgraded my MacBook Pro to Mac OS 10.6.6. With this upgrade, came AppStore.app, the desktop equivalent to the App Store that’s been a large part of the success of iOS. My first impression was “this looks like Novia’s Ovi Store” — it shows a lot of applications and very little information. Looking around, it seems pretty easy to use, but I can’t see myself ever using it.

After years of installing software via `yum install $package`. I got some flak on Twitter for saying this, but the flak was crap. First, I wouldn’t expect anyone to read the man pages for a GUI app on any platform. That’s what the built-in documentation is for (and if it doesn’t exist, that’s a serious bug in the program). Secondly, I wasn’t even talking about the interface. It’s more the idea of paying for the software. Not out of greed, but out of the philosophical feelings about FLOSS.

That having been said, I think the App Store is pretty great overall. My big complaint about Mac OS X is the lack of a package management system. The ability to easily keep packages up to date is a serious strength of Linux distributions, and things like MacPorts and Fink don’t really cut it for casual users. I hope that Apple does the un-Apple thing and makes it more accessible to developers. In the meantime, it’s a great and overdue addition.