Weather Notes:
More to come, this page is still a little young yet.
Weather Notes:
Slacker Weather
Scripts used to process weather data
Raw data used by weather programs
Weather Station (Xmas present)
Open prog to use weather station
Everyone's favorite gnuplot
command to get freebsd's date with the -v switch:
cvs -d freebsdanoncvs@anoncvs.FreeBSD.org:/cvs co src/bin/date/
this is a dependency that i need to remove
Notes:
- The outdoor temperature sensor is located on a patio on the East side of an apartment building. It's shielded from direct sunlight but we still tend to see a temperature drop on bright sunny days when the sun goes behind the overhang of the roof. I suspect this suggests we might get better ambient air temperature readings on sunny days if the sensor were better shielded.
- The brown trace on the second graph on the weather page labeled ET-DP is the difference of the dew point from the external temperature. During steep changes in ET and DP it became difficult to tell graphically just how close together these actually were, so this trace was started. We tend to just start seeing fog or frost when this trace gets around 2 C or lower. Around 1.5 C we tend to observe much more pronounced fog and/or frost. I'm not sure that these effects being observed a couple degrees above a difference of 0 is normal, or an artifact of these instruments and/or their setup.
- Our wind speed setup provides some very noisy raw data. Worse, its location a couple of feet off the roof of an apt complex on a bit of a hillside doesn't help it reflect actual winds in this area of Seattle much at all. The noisy data problem was largely dealt with by filtering out many common bogus values I suspect are caused by 60Hz power inducing noise on the instrument's long, unshielded, Cat 3 cable. However the data still looks pretty noisy even after this filtering as the wind speed is rarely ever consistent from one sample to the next. So we graph a 16 point running average of the wind speed instead of the actual raw data, and this makes things appear much more consistent and clean.
- Wind direction also tends to reflect the somewhat shielded nature of this instrument's location. We do however tend to see directional trends that seem to indicate the instrument is doing more than just whirling around in local eddies.
- Pressure seems to correlate very well to weather.com's readings, and generally seems to be a well behaved system. Spikes we used to see are now being filtered out quite successfully.
System Weather Notes:
Slacker System Temps
Scripts used to process system temp data
Raw data used by system temp programs
Pictures of local one wire setup
DS9097U: 1-wire serial port adapter
DS2480B: chip used in 1-wire serial port adapter
DS18S20: 1-wire temp sensor
DS18S20 Data Sheet
DS2480B Data Sheet
DS0907U Data Sheet
1-wire example source code (public domain kit)
Hobby Boards Where I bought all the 1-wire stuff
Notes:
- To construct the sensor "units" I have just been crimping the one wire temperature sensors directly into RJ11 connectors. Given the nature of the 1-wire bus design, this allows me to connect many of them together in a random haphazard fashion with standard telephone cables, splitters and couplers while still expecting the whole thing to just work.
- This system has proved surprisingly robust, and produces far fewer data anomalies than the weather setup.
- I am somewhat unhappy with the software available for working with these things. For what I am doing I'm pretty sure I could use a much simpler program utilizing orders of magnitude less code. Work on this is underway, I just need to work out a few kinks.
Particle Weather Notes:
Slacker Particle Weather
Scripts used to process particle weather data
Raw data used by particle weather programs
Aware Electronics Corp Where I got the RM-60 Geiger counter
Aware Electronics Corp RM-60 Specs Geiger counter manufacturer specs
GM Tube used by the RM-60 GM Tube manufacturer specs
Notes:
- Activity seems to correlate to rain more than anything else at the moment (and only weakly).
Power Weather Notes:
Power Weather
Power scripts, Arduino code, plots, data, etc.
Ethernet interface used
Freeduino used (Arduino clone)
Current transformers used
Temperature sensor used
Temperature sensor example page
Tweetawatt software page
Arduino Ethernet shield page
Notes:
- In order to not drive the analog inputs on my uC negative (or suffer voltage drop from a diode), i'm floating the current transformers at a little over a volt. I then set the AREF to about twice that. With the oven set to broil and the hot water heater going this provides enough range that i don't hit the aref, or drive my inputs negative.
- I'm assuming the outputs from the current transformers are linearly proportional to current in our power feeds. I'm also assuming that i can then just sample the AC output of the CTs over a couple cycles, look for the max, and call that 1/2 the PP voltage. I then assume our house supply voltage is fixed. I then further assume (hope) that given all the previous assumptions, the CT output is linearly related to our power usage, and i can just convert from one to the other. aaaaannnnnnnnddddd i'm ignoring power factor for the time being. obviously there are some places where this can fall down. if only i got that bsee...
- Once i'm sure everything is as linear as i hope, i'll compare the output of the current transformers with some known load changes and try to get the graphs in watts, and then make sure everything agrees with our power meter.
Logs:
2010-05-27: Am now monitoring power usage in our apartment, yay! NOT calibrated yet, am just graphing output of the current transformers for the moment.
2008-07-08: Moved external weather stuff from pixel to violet.
2008-06-25: Violet now has a working "NetMos Nm9835" serial port card in her, this gives her two proper RS-232 serial ports. Thus I've been able get the system weather stuff back up and functioning properly. I hope to move the external weather stuff to violet from pixel here very shortly, since violet still has one more free RS-232 port and would be the proper box to run the external weather instruments on.
2008-05-27: Esra is being shut down to reduce the heat, noise, and power consumption going on in my apartment. Particle weather has been successfully moved to violet, however the DS9097U used for the system temperatures doesn't seem to want to work on a USB <-> serial adapter. Work on a fix is ongoing.
2007-07-06: The rain gauge has now been observed to produce a considerable number of both false positives and false negatives. The data produced thereby should be regarded as questionable until further notice.
2007-04-04: The rain gauge is starting to produce readings again. This is consistent with the theory that the little magnetic reed switch only wants to work when it's warm out. Unfortunately, I'm not real sure about some of the readings it's producing. I haven't had the chance to correlate a lot of its data with actual rain yet. I also have to wonder if the readings about the same time every morning aren't due to morning dew or similar.
2007-04-04: It would appear that the elevated radiation readings are persisting. The box has undergone another reboot w.o. any apparent change, suggesting the Geiger counter and software is probably reading slightly higher as an effect of the last update. Or for some reason, coincidentally, the background radiation hopped up the moment I performed the last update and stayed that way. I'm guessing not. Better software is a couple steps closer to being put into production, shouldn't be too long now. Also a known test source is on order so hopefully some calibration and the use of some standard units can happen soon in the future.
2007-03-08: Recent radiation readings are a wee higher than we've normally been seeing, while all the data looks consistent I have to wonder whether this is due to actual increased background radiation or one of our recent setup changes. While I doubt the later I wouldn't completely rule it out either.
2007-03-07: With the switch to UTC I also switched Esra over to OpenNTPd, instead of using an hourly cronjob to set the time against a local NTP server. A cursory glance suggests this clock is pretty damn drifty. The temperature oscillations caused by our thermostatically controlled "cooling system" in that room probably don't help. The NTP daemon has kept the time much closer to reality now, but it looks like the clock frequency is swinging around by as much ~300ppm. It is still doing much better than our old method which sometimes saw time jump by as much as 4 seconds an hour.
2007-03-07: Spike filters have been modified to better deal with gaps in data sets. Now it's much easier to keep graphs from disappearing when a script can't find a start point for a block of data to graph.
2007-03-06: Esra has been updated and all the graphs have been switched over to UTC. Some of the filters don't handle large gaps in data well, as is readily evident if you've looked at the particle weather page recently. As the gaps fall out all the graphs will get back to normal. Meanwhile I mean to work on a better way of handling much of that.
2007-03-05: OH NOES! The machine that does much of the recording and serving of data (Esra) is down! I'm away from it right now, and of course it's an x86 machine so I have no useful serial console to the thing unlike all my sparc64, sgi and alpha kit :( This means it will probably be down until ~6:30pm PST. Since it's already down I will take this chance to upgrade it, test the startup scripts that are supposed to launch all this stuff automatically, and switch all the times over to UTC. The UTC switch will prevent us from having to deal with our time bases changing at random twice a year due to NA DST jumps. This will mean there will be an 8 hour jump in the weather data, which is still being recorded, and at least a 12 hour jump in all the other data, which will have to wait for me to get home before it will start recording again ON TOP of the UTC jump. This also means that the timestamps on all our data here will now match those of all the diff .gov and weather agencies around the world that also use UTC, yay! With any luck all this being done at once should consolidate our downtime for some time to come.
2007-01-09: Rain gage not working again, it got some snow melt, but is still not recording rainfall. Somehow the magnetic reed switches in them keep failing. I have no idea how a magnetic reed switch of all things fails. Doesn't like the cold perhaps?
2007-01-05: Rain gage has been repaired and is back on the roof, it _seems_ to be working.
2007-01-01: Rain gage parts have been ordered, should be here shortly.
2006-12-30: Failure with rain gage identified, fix coming.
2006-12-30: Increased UPS capacity from 4.5kVA to 6.0kVA, assuming I get all my loads balanced well we should hopefully see a corresponding 33% increase in run times during power failure.
2006-12-18: Basic code is in place for the particle weather bits, now to make it clean.
2006-12-15: RM-60 (Geiger Counter) arrived, now to write code.
2006-12-13: Rain gauge seems to be officially dead, working on repairs :(
2006-12-12: Spike filter written and applied to weather data graphing process, eliminates spikes in data from bogus WS2315 reads.
2006-12-11: Running average filter written and applied to wind data - which makes much more sense now.
2006-10-05: Wind and Rain gauges are on the roof now, thanks to my awesome apartment managers, yay!
2006-09-17: Moved all the system weather stuff over to esra, which is anticipated to be a good, stable, permanent home for quite some time to come.
2006-04-14: First system weather graphs are now online!
2006-04-05: Changed plot resolution from 640x480px to 1235x480px. This accommodates the increased amount of data from the 24->48 hour switch, increases readability, yet still fits on many displays.
2006-04-04: Switched units from their defaults to real units.
2006-01-02: Weather plot x-axis has been expanded from 24 to 48 hours.
2005-12-26: First weather graphs are now online!
Last Updated: Fri May 28 15:31:02 UTC 2010