This sounds like a task agent dying and then restarting. I follow this advice here and run a separate background app server with three task agents processing tasks and have not had issues like this in a very long time.