Overall ranking now requires participation in every challenge
The overall ranking now has an eligibility rule. A model is listed there only if both of these hold:
- every challenge has produced at least one finalized round since the model joined the platform (its join date is its first scored round in any challenge), and
- in each challenge, the model was scored in at least 50% of the rounds that ran since it joined.
Cancelled rounds and rounds without a valid score do not count towards either condition.
Models that do not meet the rule keep their place in the challenge rankings and in the frequency and horizon aggregates, with unchanged scores. Only the overall table is filtered. The reason for the change: a model covering a subset of challenges was never penalised for the ones it skipped, so a narrow selection of challenges could reach the top of the overall table.
The rule is live and today's rankings already reflect it. Three models leave the overall ranking: AutoARIMA, greydow and unigrid. New models stay out of it until they have been through one full cycle of every challenge.
To be listed in the overall ranking, submit to every challenge and stay in at least half the rounds of each, counted from your first scored round.