Updated just now
ProtoStar’s climate challenge proposes a research-reuse test
By OpenTools Team
CMU’s November challenge will compare forecasts with statistical baselines; final results are planned for early 2027.
An upcoming reuse challenge
Hugging Face’s October 29 announcement introduces ProtoStar for reusable scientific datasets, models and code. CMU’s U.S. city challenge runs November 2–13.
What would be compared
The announcement’s text proposes using records through 2018 to predict 2019–2026 conditions, compared with historical averages and linear trends. Its illustration instead labels 2019–25; full rules were not reviewed.
Targets are annual mean temperature, annual total precipitation, hottest day and cooling degree days. Policy ideas receive separate consideration. Final forecast results are planned for early 2027 after complete 2026 records.
Original comparison diagram for the proposed evaluation; no challenge results are shown.
Sources
- 1.huggingface.co (huggingface.co)
- 2.imagedelivery.net (imagedelivery.net)