GitHub · Where software is built

Stuff that needs to be written into the paper
#204 · abhimanyupallavisudhir opened on Sep 11, 2024
4
Make a specification on how one would use our metric to evaluate a forecaster, needs to be a single script
#141 · dpaleka opened on Jul 27, 2024
2

Labels Milestones New issue

Make a standard evaluation setup for consistency evaluation and ground truth scoring

#278

· dpaleka opened

on Oct 22, 2024

evaluation.py recalc no longer works on stuff that never had any stats to begin with

#270

· abhimanyupallavisudhir opened

on Sep 29, 2024

Redundant LFS objects should be removed

#268

· abhimanyupallavisudhir opened

on Sep 29, 2024

generated_related_questions should be more consistent with the project's overall structure

#258

· abhimanyupallavisudhir opened

on Sep 25, 2024

violation should have more tests

#256

· abhimanyupallavisudhir opened

on Sep 25, 2024

Recompute calibration bins in ground truth eval

#252

· dpaleka opened

on Sep 24, 2024

Make `evaluation.py` robust to None violation values

#237

· dpaleka opened

on Sep 23, 2024

Approaching Human-Level Forecasting with Language Models and Gnews retrieved articles

#235

· dpaleka opened

on Sep 23, 2024

Perscache `ignore` param does not really work

#231

· dpaleka opened

on Sep 23, 2024

OpenAI's new structured output mode does not work with Pydantic models that include `datetime`

#219

· dpaleka opened

on Sep 17, 2024

`by July 2024` in NewsAPI generated qs would be better as `during the interval`

#213

· dpaleka opened

on Sep 15, 2024

Caching is not aware of the LLM client setup

#206

· dpaleka opened

on Sep 12, 2024