Scheduled play unexpextedly switches off
  • Hi,

    Since 2.1.0 we're dealing with a severe problem. Nearly everyday our scheduled play switches off unexpectedly. It almost always happens on a start of a quite random playlist. On UI on-air light switches off and scheduled play switches off.

    You can find log and schedule attached. Last time we had such a problem was around 23:00 on 2012-06-22. We use airtime 2.1.2 on ubuntu server 10.04.

    It's really critical since it criples our playout randomly.
    Post edited by Marcin Tym at 2012-06-23 04:06:09
  • 19 Comments sorted by
  • I was getting this too after upgrading recently.  

    Firstly, check your clock is showing the correct time - if it isn't, reset it to be the correct time.

    Also, as root try doing /etc/init.d/airtime-playout restart  - this kicked it back into life for me

    It's happened a couple of times now, but not since I upgraded to 2.1.2

    Hope that helps
  • Reply to @Alex+Stanley:

    Thanks Stanley. Yes, playout restart always helped. Sometimes with little help of switching scheduled play off and on again. Upgrade to 2.1.2 didn't do the trick. It still happens quite often and is really messing with our karma. :)
  • Hi,

    Please post the logs and we'll take a look.
    Airtime Pro Hosting: http://airtime.pro
  • Reply to @Martin+Konecny:

    Here they are. Thanks.
  • Hey I took a look, but nothing popped out at me as suspicious. Please post the date/time your outage occurred to spare me looking through thousands of lines of logs :)

    Airtime Pro Hosting: http://airtime.pro
  • Reply to @Martin+Konecny:

    As mentioned in the first post:
    23:00 on 2012-06-22.
  • Yes we've also had a problem with the stream going silent after some time. We're using airtime 2.1.2 on Ubuntu Desktop 12.04. I checked the stream at 18:43 GMT and it was silent so I ran:

    sudo service airtime-playout restart

    and then the random playout reappeared.

    logs attached

    James
  • Reply to @James+Dunn:

    According to your logs, even after you restart airtime-playout, I see that nothing started playing. It appears nothing is scheduled?

    Do you have a modified liquidsoap script?
    Airtime Pro Hosting: http://airtime.pro
  • Reply to @Marcin+Tym:

    Sorry for missing that. I'm taking a look at the logs and have found something interesting. Stay tuned.
    Airtime Pro Hosting: http://airtime.pro
  • Reply to @Martin+Konecny:

    Ah yes sorry we do have a custom liquidsoap script with random playout. It's as follows:

    #default = amplify(id="silence_src", 0.00001, noise())
    #default = rewrite_metadata([("artist","Airtime"), ("title", "offline")],default)
    default = mksafe(playlist(reload=3600,mode='random', "/srv/airtime/stor"))
    default = rewrite_metadata([("artist","Summer Club Radio"), ("title", "random playout")],default)

    James
  • Vote Up0Vote Down Albert FRAlbert FR
    Posts: 1,978Member, Airtime Moderator
    I've sometimes the same problem... but only on empty shows (repeated shows not always filled)
  • Reply to @Marcin+Tym:

    HI Marcin,

    We spent a lot of time looking into this, and are curious about a few things about your system. We're not sure if this is a bug or something else.

    When you get a chance, please contact me with a private message.
    Airtime Pro Hosting: http://airtime.pro
  • Reply to @Albert+FR:

    Now I see what you mean when you say "empty show". A show that is not full :)

    If you know the specific time your show failed, please post the log for it. We haven't found any conclusive evidence that a bug exists, but are very willing to chase if it exists :) 
    Post edited by Martin Konecny at 2012-06-28 12:31:35
    Airtime Pro Hosting: http://airtime.pro
  • Reply to @Martin+Konecny:

    I'm monitoring playout and for now everything seems fine. I'll let you now in few days if the problem is fixed. Thanks a lot! :)
  • Reply to @Martin+Konecny:

    OK, there are still some problems. Since your fix playout switched off unexpectedly 2 times. I will post the details in the evening.
  • Reply to @Marcin+Tym:

    Marcin, the bug we found on your system will be fixed in 2.1.3 which we are releasing this Friday.
    Airtime Pro Hosting: http://airtime.pro
  • Reply to @Martin+Konecny:


    Thanks, that's very good news!

    I'm sorry for posting it so
    late, but as i mentioned there have been 2-3 more crashes since your
    fix. I attached logs. I made the tgz right after the playout restart
    (about 7:30 CEST). The problem occured during the night I suppose... It
    is identical as mentioned earlier. The on-air was off. The switch for
    scheduled play was on but the scheduled play 'line' was off (greyed). No
    sound streamed.

  • Hi Marcin,

    We fixed couple bugs on playout engine for 2.1.3 and it should fix your problem. But the release date has been postponed to next Tuesday.

    Thank you.
  • Reply to @James+Moon:

    Ok. Then I'm waiting for an upgrade and will monitor the playout. I posted the logs just in case you would like to check if it's nothing new.