Ingest works agency by agency
  • Vote Up0Vote Down Hamed AhmedHamed Ahmed
    Posts: 3Member

    Hi all,

    I installed Superdesk and start work with it. However, I have a problem.

    The ingest work in a sequential mode regarding various providers.

    When system start to ingest a certain provider for example provider X, all other providers wait until provider X finished.

    In the wait time, other providers collect many news items and when anyone of them start ingesting, it block the other provider until it finish … and so on.

    How can I avoid this scenario and make all providers work at the same time (parallel).

    Thanks in advanced

    HA

    Post edited by Hamed Ahmed at 2018-09-28 07:20:00
  • 2 Comments sorted by
  • Vote Up0Vote Down Hamed AhmedHamed Ahmed
    Posts: 3Member
    Hi all,

    I'm really need help on this issue.

    Anyone can help.


  • Vote Up0Vote Down Petr JasekPetr Jasek
    Posts: 144Member
    hi, you should be able to add more celery workers to handle it, it should generate a task for each provider. in procfile there is single worker process started, you can start more using honcho or copy&pasting the line in the Procfile https://github.com/superdesk/superdesk/blob/master/server/Procfile#L3
    Post edited by Petr Jasek at 2018-10-01 03:02:36
Add a Comment