Re: LUG Mirror Stats

[Peter Marheine <phmarhei@xxxxxxx>]

> I wonder how hard it would be to turn that map into a heat map.
> With the current map, we could have dozens of points right on top of
> each other and we'd never know.
That proposal interests me. Also useful could be a heatmap of total data transferred, which might be more useful as far as seeing where our users are under normal conditions (Ubuntu releases notwithstanding), given that we might consider total data transferred to be a function of user count and composite user interest.

If so inclined, you could also pull the data points out of the source of our map page (var map_points) and muck about with them yourself.

> Without violating the privacy of the people being served.
I don't think the geographic data is sensitive privacy-wise, and that (combined with which mirror got hit) is the only public part of our data.  All IP addresses are filtered on the server-side and run through a Geo-IP database (the gratis one provided by MaxMind specifically, so it's not so accurate as to be a concern, I think).

Thus, as long as any additional visualization work is still only working with the present data points, I don't think it's an issue.

I looked a little into what a heatmap would take to implement, and it looks like either matplotlib or numpy + gnuplot could be pretty easily hooked into the existing scripts.  I think I'll see about hacking something up this evening.

--
Peter Marheine
LUG Server Adminstrator
Don't Panic

On Fri, Oct 14, 2011 at 10:26 AM, Josh Knight <jgknight@xxxxxxx> wrote:

Bryan,

That is something we could look at. Currently if you click on a point on the map you can see multiple users from the same location. A heat map would be more intuitive and easier to see where our users are concentrated.

--
Josh Knight
Undergraduate, Michigan Technological University

  Major, Computer Network & Systems Administration

  Minor, Electrical Engineering
President, Linux/Unix Users Group
Operations Team Member, ITOxygen Enterprise

----- Original Message -----
From: "Bryan Laur" <bjlaur@xxxxxxx>
To: lug-l@xxxxxxx
Cc: "Josh Knight" <jgknight@xxxxxxx>
Sent: Friday, October 14, 2011 10:18:26 AM GMT -05:00 US/Canada Eastern
Subject: Re: LUG Mirror Stats

I wonder how hard it would be to turn that map into a heat map.
With the current map, we could have dozens of points right on top of
each other and we'd never know.

On 10/14/2011 10:11 AM, Josh Knight wrote:
> Good morning,
>
> I was looking at our server stats for yesterday's Ubuntu release, thought you may be interested in seeing the data.
>
> http://lug.mtu.edu/map/stats.php
> http://lug.mtu.edu/map/map.html
> http://agentc.tc.mtu.edu/cricket/grapher.cgi?target=/sw_edge/FES/fes-28-008;view=Octets;inst=20;ranges=d:w:m:y (nan bits/sec means at least 100 Mb/s)
>
> tl;dr 4814 unique IP addresses used our Mirror yesterday. That's a lot of users.
>
>
> (Note that these stats are regenerated daily, so after Friday 10/14 those pages won't reflect the same information.)
>
>
> --
> Josh Knight
> Undergraduate, Michigan Technological University
>     Major, Computer Network&  Systems Administration
>     Minor, Electrical Engineering
> President, Linux/Unix Users Group
> Operations Team Member, ITOxygen Enterprise