I spent the last couple days working on a system for scoring and classifying metadictionary terms with reputation based crowd-sourcing. It’s hard to succinctly describe the goals of the system I’m proposing, but I’ll try:
- Each newly proposed term should have an equal chance of succeeding, despite reputation. At the same time, it should be possible debunk bad ones quickly.
- When a term has few votes, reputation should play a critical role. However, as the number of voters on a particular term approach the size of the SeaIce community, votes should become equitable.
- Term stability is required for admittance to the canon.
- There are two conditions for stability: one, the owner can’t modify the term/definition for a certain period of time, and two, the rate of change of the score must be zero.
Please give the attached write-up a read. I also suggest some additions to the interface. Pending approval from my working group, I’ll be ready to start implementing these things tomorrow.
Here you go: scoring.pdf