My thing for scraping links off Twitter appeared to have stopped doing so around half eleven last night. I dug around checking various things, and in the end it seemed to be something to do with the interaction between Celery and RabbitMQ: both were reporting that they were running OK, but it seemed Celery wasn't actually getting stuff from the queue, even after I restarted its service.
So I restarted both services, and it all started working again.
And best of all: every task request posted since last night was still sitting in the queue and Celery immediately started working its way through all 3000+ of them, so everything was back up to date within a couple of minutes
One task failed, but that turned out to be a shortened-URL-resolution request that led to a LinkedIn page that you have to be logged in to LinkedIn to view, so who cares if it never gets resolved 
							
						
					So I restarted both services, and it all started working again.
And best of all: every task request posted since last night was still sitting in the queue and Celery immediately started working its way through all 3000+ of them, so everything was back up to date within a couple of minutes

One task failed, but that turned out to be a shortened-URL-resolution request that led to a LinkedIn page that you have to be logged in to LinkedIn to view, so who cares if it never gets resolved
 
							
						
 murky day spent walking and gardening.
 murky day spent walking and gardening.
							
						


 
							
						 
							
						
 
				 
				 
				 
				
Comment