1 resource

  • Valentin Hofmann, David Heineman, Ian Ma...
    |
    Sep 14th, 2025
    |
    preprint
    Valentin Hofmann, David Heineman, Ian Ma...
    Sep 14th, 2025

    Language model (LM) benchmarking faces several challenges: comprehensive evaluations are costly, benchmarks often fail to measure the intended capabilities, and evaluation quality can degrade due to labeling errors and benchmark saturation. Although various strategies have been proposed to mitigate these issues, they tend to address individual aspects in isolation, neglecting broader questions about overall evaluation quality. Here, we introduce FLUID BENCHMARKING, a new evaluation approach...

Last update from database: 24/10/2025, 16:15 (UTC)
Powered by Zotero and Kerko.