Scheduled play unexpextedly switches off
  • Vote Up0Vote Down Marcin TymMarcin Tym
    Posts: 75Member
    Hi,

    Since 2.1.0 we're dealing with a severe problem. Nearly everyday our scheduled play switches off unexpectedly. It almost always happens on a start of a quite random playlist. On UI on-air light switches off and scheduled play switches off.

    You can find log and schedule attached. Last time we had such a problem was around 23:00 on 2012-06-22. We use airtime 2.1.2 on ubuntu server 10.04.

    It's really critical since it criples our playout randomly.
    sched.png
    255 x 184 - 6K
    airtime-log-playout-2012-06-23-07-41-07.tgz
    2M
    Post edited by Marcin Tym at 2012-06-23 04:06:09
  • 19 Comments sorted by
  • Vote Up0Vote Down Alex StanleyAlex Stanley
    Posts: 41Member
    I was getting this too after upgrading recently.  

    Firstly, check your clock is showing the correct time - if it isn't, reset it to be the correct time.

    Also, as root try doing /etc/init.d/airtime-playout restart  - this kicked it back into life for me

    It's happened a couple of times now, but not since I upgraded to 2.1.2

    Hope that helps
  • Vote Up0Vote Down Marcin TymMarcin Tym
    Posts: 75Member
    Reply to @Alex+Stanley:

    Thanks Stanley. Yes, playout restart always helped. Sometimes with little help of switching scheduled play off and on again. Upgrade to 2.1.2 didn't do the trick. It still happens quite often and is really messing with our karma. :)
  • Vote Up0Vote Down Martin KonecnyMartin Konecny
    Posts: 1,860Member
    Hi,

    Please post the logs and we'll take a look.
    Airtime Pro Hosting: http://airtime.pro
  • Vote Up0Vote Down Marcin TymMarcin Tym
    Posts: 75Member
    Reply to @Martin+Konecny:

    Here they are. Thanks.
    airtime-log-all-2012-06-25-05-43-43.tgz
    4M
  • Vote Up0Vote Down Martin KonecnyMartin Konecny
    Posts: 1,860Member
    Hey I took a look, but nothing popped out at me as suspicious. Please post the date/time your outage occurred to spare me looking through thousands of lines of logs :)

    Airtime Pro Hosting: http://airtime.pro
  • Vote Up0Vote Down Marcin TymMarcin Tym
    Posts: 75Member
    Reply to @Martin+Konecny:

    As mentioned in the first post:
    23:00 on 2012-06-22.
  • Vote Up0Vote Down James DunnJames Dunn
    Posts: 226Member
    Yes we've also had a problem with the stream going silent after some time. We're using airtime 2.1.2 on Ubuntu Desktop 12.04. I checked the stream at 18:43 GMT and it was silent so I ran:

    sudo service airtime-playout restart

    and then the random playout reappeared.

    logs attached

    James
    airtime-log-all-2012-06-27-21-46-15.tgz
    224K
  • Vote Up0Vote Down Martin KonecnyMartin Konecny
    Posts: 1,860Member
    Reply to @James+Dunn:

    According to your logs, even after you restart airtime-playout, I see that nothing started playing. It appears nothing is scheduled?

    Do you have a modified liquidsoap script?
    Airtime Pro Hosting: http://airtime.pro
  • Vote Up0Vote Down Martin KonecnyMartin Konecny
    Posts: 1,860Member
    Reply to @Marcin+Tym:

    Sorry for missing that. I'm taking a look at the logs and have found something interesting. Stay tuned.
    Airtime Pro Hosting: http://airtime.pro
  • Vote Up0Vote Down James DunnJames Dunn
    Posts: 226Member
    Reply to @Martin+Konecny:

    Ah yes sorry we do have a custom liquidsoap script with random playout. It's as follows:

    #default = amplify(id="silence_src", 0.00001, noise())
    #default = rewrite_metadata([("artist","Airtime"), ("title", "offline")],default)
    default = mksafe(playlist(reload=3600,mode='random', "/srv/airtime/stor"))
    default = rewrite_metadata([("artist","Summer Club Radio"), ("title", "random playout")],default)

    James
  • Vote Up0Vote Down Albert FRAlbert FR
    Posts: 1,978Member, Airtime Moderator
    I've sometimes the same problem... but only on empty shows (repeated shows not always filled)
    ----
    Je peux le faire ;) [Pour vous] / I can do it [For You] Gnu/Linux & Media Architect
    Co-founder NessRadio.com
  • Vote Up0Vote Down Martin KonecnyMartin Konecny
    Posts: 1,860Member
    Reply to @Marcin+Tym:

    HI Marcin,

    We spent a lot of time looking into this, and are curious about a few things about your system. We're not sure if this is a bug or something else.

    When you get a chance, please contact me with a private message.
    Airtime Pro Hosting: http://airtime.pro
  • Vote Up0Vote Down Martin KonecnyMartin Konecny
    Posts: 1,860Member
    Reply to @Albert+FR:

    Now I see what you mean when you say "empty show". A show that is not full :). 

    If you know the specific time your show failed, please post the log for it. We haven't found any conclusive evidence that a bug exists, but are very willing to chase if it exists :) 
    Post edited by Martin Konecny at 2012-06-28 12:31:35
    Airtime Pro Hosting: http://airtime.pro
  • Vote Up0Vote Down Marcin TymMarcin Tym
    Posts: 75Member
    Reply to @Martin+Konecny:

    I'm monitoring playout and for now everything seems fine. I'll let you now in few days if the problem is fixed. Thanks a lot! :)
  • Vote Up0Vote Down Marcin TymMarcin Tym
    Posts: 75Member
    Reply to @Martin+Konecny:

    OK, there are still some problems. Since your fix playout switched off unexpectedly 2 times. I will post the details in the evening.
  • Vote Up0Vote Down Martin KonecnyMartin Konecny
    Posts: 1,860Member
    Reply to @Marcin+Tym:

    Marcin, the bug we found on your system will be fixed in 2.1.3 which we are releasing this Friday.
    Airtime Pro Hosting: http://airtime.pro
  • Vote Up0Vote Down Marcin TymMarcin Tym
    Posts: 75Member
    Reply to @Martin+Konecny:


    Thanks, that's very good news!

    I'm sorry for posting it so
    late, but as i mentioned there have been 2-3 more crashes since your
    fix. I attached logs. I made the tgz right after the playout restart
    (about 7:30 CEST). The problem occured during the night I suppose... It
    is identical as mentioned earlier. The on-air was off. The switch for
    scheduled play was on but the scheduled play 'line' was off (greyed). No
    sound streamed.

    airtime-log-all-2012-07-02-05-43-47.tgz
    5M
  • Vote Up0Vote Down James MoonJames Moon
    Posts: 197Member
    Hi Marcin,

    We fixed couple bugs on playout engine for 2.1.3 and it should fix your problem. But the release date has been postponed to next Tuesday.

    Thank you.
  • Vote Up0Vote Down Marcin TymMarcin Tym
    Posts: 75Member
    Reply to @James+Moon:

    Ok. Then I'm waiting for an upgrade and will monitor the playout. I posted the logs just in case you would like to check if it's nothing new.
Add a Comment