Fix loadscope scheduler deadlock after a worker crash

[larsoner]

• Make sure to include reasonable tests for your change if necessary
• We use towncrier for changelog management, so please add a news file into the changelog folder ...

I used Claude Fable 5 to look into #1313 (after hitting a very reliable hang in MNE-Python in mne-tools/mne-python#14063 during a ~20m run). With some guidance, Claude was able to boil it down into a minimal repro (now adapted into a unit test) and suggest this fix based on its conclusion:

The bug is that mark_test_complete() never prunes fully-completed work units from assigned_work, so when a worker crashes, remove_node() requeues everything it ever ran. Replacement (or endgame) workers then get assigned an already-completed unit as an empty runtests command, which can never be marked complete — so _reschedule() never fires again and the session deadlocks with idle workers.

I then tested in mne-tools/mne-python#14101 that 1) it still hung in MNE-Python with latest pytest-xdist master (it did), then 2) used this PR and saw it succeed in ending properly after an error rather than hanging. It coming back red allowed me to narrow down the bug to a Qt6<->Cocoa issue (with multiple runs, each ending properly on this branch) and work around it to get to green 🎉 !

Related to #1313 and addressed what I commented on there, but not sure if it actually closes it or not. @clemlesne you could try my branch and check if you have the spare cycles (I pushed upstream tags to git so the dynamic dev version gets resolved correctly, and used pip install "pytest-xdist @ git+https://github.com/larsoner/pytest-xdist.git@lock" in my own testing.)

[larsoner]

A minor status update here / some evidence that it's working -- we've been using this branch for the last month in MNE-Python without issue (and it works correctly when we've had an occasional segfault that previously would have hung).

[larsoner]

Actually I think #1328 is a better fix, I'll close!

[larsoner]

(and #1348 looks still useful, too)