My thing for scraping links off Twitter appeared to have stopped doing so around half eleven last night. I dug around checking various things, and in the end it seemed to be something to do with the interaction between Celery and RabbitMQ: both were reporting that they were running OK, but it seemed Celery wasn't actually getting stuff from the queue, even after I restarted its service.
So I restarted both services, and it all started working again.
And best of all: every task request posted since last night was still sitting in the queue and Celery immediately started working its way through all 3000+ of them, so everything was back up to date within a couple of minutes
One task failed, but that turned out to be a shortened-URL-resolution request that led to a LinkedIn page that you have to be logged in to LinkedIn to view, so who cares if it never gets resolved
So I restarted both services, and it all started working again.
And best of all: every task request posted since last night was still sitting in the queue and Celery immediately started working its way through all 3000+ of them, so everything was back up to date within a couple of minutes
One task failed, but that turned out to be a shortened-URL-resolution request that led to a LinkedIn page that you have to be logged in to LinkedIn to view, so who cares if it never gets resolved
Comment