Since bbchallenge has launched it has not been very clear what is the process by which a decider is officially accepted and applied to reduce the size of the index of undecided machines.
We have tried to organise votes on a per-decider basis but it turned out to be tedious as well as loosely defined (what are we voting for?).
Hence the idea, to vote here, once and for all, on the due diligence process to be completed by a candidate decider for it to be officially accepted and applied.
The following process is proposed:
- The candidate decider and associated results (set of decided machines) are published on the forum and follow the principles of our reproducibility and verifiability statement.
- The decider decides >= 10% of the remaining undecided machines.
- The decider is reproduced by someone else than the author, and the results match.
- A formal proof of correctness is given for the decider and is validated by at least one other person than the author of the decider or the author of the proof.
If all those steps are realised, the decider is officially applied and the index of undecided machines.
Vote: you can either vote in favor or against this proposal and/or feel free to suggest modifications to this proposal to be debated.
But I think having a set of core members empowered to do that makes sense to me. De-facto this would at least be the set of folks who can modify the webpage / github.