Statistics page for airtime. custom built. - Airtime Development Discussions on Sourcefabric Forum

Romeo

Hi, DevTeam.

I've built my custom statistics page for monitoring efficiency of the station. It looks like that (second day after radio is up):

The different channels can be monitored, you can see different time intervals, averages, peaks, etc. I think it's possible to built-in this statistics in future airtime releases.

Feel free to ask any questions about that app.

If you need to check live example I can give an access to you.

Romeo

Reply to @Albert+FR: I'll work on text labels a bit later. Now i'm trying to integrate it into airtime interface:

That's what i have at the moment:

Albert FR

really useful ;)

do you integrate it in the next releases ?
or give us an howto for doing the same ?
:D

Andrey Podshivalov

look at Munin poject. It's a brilliant, plugins based monitoring (statistics collection) tool. To start airtime statistics collection you need just to implement simple plugin: http://munin-monitoring.org/wiki/HowToWritePlugins

Here are some examples of installed munin: http://munin.ping.uio.no/

Romeo

Reply to @Albert+FR:

I'm not in the development team of sourcefabric, so i cannot integrate it in the future releases on my own.

Concerning howto's: shure, I can post it somewhere, but the solution isn't brilliant - it's hardly scalable and needs refactoring. It's Better port this scripts to ZF and pgsql in order to seamlesly integrate it with Airtime. (maybe as a plugin?)

Romeo

Reply to @Andrey+Podshivalov:

Munin is very interesting project, but it's not interactive. My solution uses OFC2 for plotting with asynchronous data polling. so you can monitor activity in realtime

Check OFC2 capabilities here http://teethgrinder.co.uk/open-flash-chart-2/area-hollow.php

Andrey Podshivalov

heh, statistics means history. It doesn't require real time monitoring.

Munin is not only plotting software. It's based on
- RRD - round-robin database
- RRDTool - plotting system based on RRD data: http://oss.oetiker.ch/rrdtool/gallery/index.en.html
- plugins
- network agent implementation

Romeo

Reply to @Andrey+Podshivalov:

Isn't it cool to see current status together with history in the same place and have interactive UI?

Munin is very powerful library, but php+db+simple user front end is enough to implement this feature. And all the components are already installed in the system. So, it can be easily integrated into Airtime UI.

give it a try

Andrey Podshivalov · Post edited by Andrey Podshivalov at 2011-12-04 04:00:38

Romeo said:
Isn't it cool to see current status together with history in the same place and have interactive UI?

actually it depends on data source. F.e. if you'd like to see office temperature statistics you don't need to update each second, agree? By default munin polls remote agents each 5 mins. It's enough for most tasks like cpu utilizing, apache connections, etc. You can change an interval to 30 sec to see what happens more quickly but it I don't see any reason for smaller interval in case airtime processes.

Romeo said:
Munin is very powerful library, but php+db+simple user front end is enough to implement this feature. And all the components are already installed in the system. So, it can be easily integrated into Airtime UI.

most of munin plugins could be implemented in 3 strings (php, python, whatever) - I guess it's much simpler than statistics implementation from scratch.

But may be, we are talking about different statistics :) I guess munin could be useful for monitoring of server resources and processes (cpu, hard disks, network, postgres, icecast etc). It's useful for admin staff. In the same time some simple statistics could be useful on airtime side.

Albert FR

can you publish your munin plugin ?
I've installed munin ;)

Andrey Podshivalov

try this: http://exchange.munin-monitoring.org/plugins/icecast2/details

Paul Baranowski

@Romeo: This looks fantastic! It's much appreciated, we could really use something like this for Airtime. Thank you very much for doing this. Could we get access to the code?

In regards to the Munin discussion: While Munin looks good for someone on the sys admin side, it is way too ugly for what we want. Perhaps if the graphs could be made nicer and more interactive it would be useful.

Romeo

@Paul+Baranowski: Shure you can! What is the best way to share it for you?

I have an idea about how to integrate it into future 2.x releases using ZF + pgsql (now it uses mysql + simple PHP scripts). Can we disscuss this process somewhere?

Andrey Podshivalov

Paul Baranowski said:
we could really use something like this for Airtime.

Paul, flash is wrong way (think about iPad users). We can not use it. Think about js/svg instead. There are enough useful frameworks: https://www.google.com/search?hl=ru&q=svg+plot+framework

Paul Baranowski said:
In regards to the Munin discussion: While Munin looks good for someone on the sys admin side, it is way too ugly for what we want. Perhaps if the graphs could be made nicer and more interactive it would be useful.

I've explained about munin because it's ready to use solution for airtime users. They shouldn't wait for future version to get statistics.

Romeo

@Andrey+Podshivalov: I agree with you about iPad users (yes, i'm an owner too). I can try to built a JS version. Let's choose appropriate framework?

Andrey Podshivalov

any suitable from this list?
http://webdesigneraid.com/html5-canvas-graphing-solutions-every-web-developers-must-know/

Romeo

Reply to @Andrey+Podshivalov: maybe. I've read this research about chosing a framework for server backend. I think it's better to do some research about JS graph libraries too before choosing one.

Albert FR

this one is really good and easy to integrate :

http://thejit.org/demos/

Romeo

Reply to @Albert+FR: I think that http://www.rgraph.net/ is more suitable for that purpose, isn't it?

Martin Konecny

rgraph looks cool!! Canvas is defn the way to go.

Romeo

@Martin+Konecny: What about licence? Can we use it in Airtime? More info here: http://www.rgraph.net/docs/licensing.html#license.free

Albert FR · Post edited by Albert FR at 2011-12-05 04:52:28

@Romeo they are really good, but rgraph have a restrictive licence, and can't be used in a free project for now
Jit have a special licence (but apparented to gpl) :
https://github.com/philogb/jit

/*Copyright (c) 2011 Sencha Inc. - Author: Nicolas Garcia Belmonte 
(http://philogb.github.com/)Permission is hereby granted, free of charge, to any person
 obtaining a copy of this software and associated documentation
 files (the "Software"), to deal in the Software without restriction,
 including without limitation the rights to use, copy, modify, merge,
 publish, distribute, sublicense, and/or sell copies of the Software,
 and to permit persons to whom the Software is furnished to do so,
 subject to the following conditions:
The above copyright notice and this permission notice shall be included in
all copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR

IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,

FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE

AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHERLIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,

OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN

THE SOFTWARE. */



And they do the same thing...

Andrey Podshivalov

since we are using jquery on client side so we need some jquery-based graph frameworks: http://www.1stwebdesigner.com/css/top-jquery-chart-libraries-interactive-charts/

Seems #1 and #5 are quite well and both under GPL

Albert FR

jit have a licence apparented to gpl, but graphup and jqplot are tow good solutions too ;)

Romeo

Highcharts are cool, but it seems we cannot use it either http://www.highcharts.com/license am I right?

Albert FR · Post edited by Albert FR at 2011-12-05 09:34:58

@Romeo, it's also a free license (creatives commons are free licenses), airtime can have more than one license or have parts with differents licenses (but they must be open source)

And also that's a choice of the team ;)

Romeo

@Albert+FR: Good news! Highcharts looks much better than jqPlot to me. I'll try to dig both libraries, but it seems that i choose highcharts finally

Douglas Arellanes

@Romeo, this is excellent! I'll be sure to share this with others as well. Looking forward to seeing it in action on one of the development branches!

Romeo

Here's a first try to plot statistics using Highstock http://nfem.ru/jstat/

It's a quite primitive yet, but lets to see an activity of listeners of the station.

Albert FR

that's seem good ;)
perhaps a textual addendum with listeners average, numbers of listeners (between two dates ?) would be a great feature ;)

YounesDesign

pfff Romeo YOU ROCK!!!

Hope this feature will be implemented for the 2.0 of AirTime

Good Job mate!

Romeo

Thank you @YounesDesign.

2.0 is now at beta state. This means that feature set is already approved, and now developers are looking for the bugs and testing the software for stability. So, this feature can enter the future releases after 2.0.

And I need to talk with dev team first. I have some questions about architecture, data storage, cron tasks, caching, etc...

Albert FR

Reply to @Romeo: only one question ;)
how do you receive datas ?
by status.xsl or with another page (doing yourself) ?

Romeo

Reply to @Albert+FR:

There're two stages for recieving data: First is a cron task that connects to status2.xsl, fetches channel listeners count and puts that data to DB (used to be MySQL, postgres at the moment). This stage is fired every minute, so we have per-minure statistics for each channel. The second stage is a view for plotting the stored data from DB (ZF-based MVC + Highcharts/JQuery frontend).

Albert FR

Reply to @Romeo:that's seem to be the good way ;)
using postgres would be mandatory (for airtime compliance)

have you some news from the dev team ?

Romeo

Reply to @Albert+FR:

Nope, I guess they are on vacations at the moment. And can you tell me, who can I talk to about integration into future release of this feature?

By the way, I've made a performance comparison of postgres and mysql. I Found mysql much faster than postgres.

Albert FR · Post edited by Albert FR at 2012-01-06 06:26:28

I think Jakub or Paul or Andrey ;)

perhaps in this case mysql is more efficiant than postgres (but i've found that really strange...)
But for integration into airtime postgres must be the one ;)
But it's my opinion
have 2 databases is not a good idea, i think...

Paul Baranowski

Hi Romeo -
That looks fantastic. We would love to integrate it into 2.1 (2.0 is going to be released shortly).

Please see this wiki page on submitting patches to us and let me know if you have any questions about it:
https://wiki.sourcefabric.org/x/kAKD

- Paul

Albert FR

Reply to @Romeo: Have you uploaded yours features ?
what is your final choise for the database ?

And I'm think you're right, the team is in vacation ;)

Romeo

Reply to @Albert+FR:

I'm getting ready for development. I has forked devel branch on github and prepared a server for integration.

It will take me some more time to integrate this feature to 2.0. The branch with new features will be available on github soon

Albert FR

cool :D

and then, for the database ? mysql/postgresQL ?

Romeo

I will use postgres

Albert FR

;)

Naomi

Hey Romeo, I just wanted to check in on how this statistics feature is going. Are you having any luck integrating this in your forked Airtime 2.0 branch? We'd like to take a look at what you've come up with!

Romeo

Hi, @Naomi and everybody in the community. I had a very busy January, so the development of this feature has been delayed. I'll try to integrate it during february. Or I can pass my scripts to somebody from the dev team to integrate it more faster.

Naomi

hey yeah maybe just pass along the scripts you have now so we can take a look at them. I'm not sure if we'll have time to integrate them before March so if you're still available in February that would be very appreciated!

my work email is here: naomi.aro@sourcefabric.org

Martin Konecny

Romeo, why don't you post your work on github? The community will defn benefit from this, and we would love to integrate this into Airtime ASAP.

Albert FR · Post edited by Albert FR at 2012-02-16 08:51:17

Yes ;)
we miss you @Romeo ;)

in the same idea, i've found this : http://www.humblesoftware.com/flotr2/
as graphic chart library

YounesDesign

raaaaaaaaaa Albert... you are SOOO french!

"We are missing you"

And yea! that's true I'm dying to see this feature on Airtime 2.1

Albert FR

some people ask me to work a lot ;)

Howdy, Stranger!

Categories

Poll

Top Posters