Evaluate Files

What's Changed

• add multilabel f1 eval usage by @fcakyon in https://github.com/huggingface/evaluate/pull/221
• Force get_supported_tasks() to return a list instead of dict keys by @mathemakitten in https://github.com/huggingface/evaluate/pull/227
• Unpin rouge_score by @albertvillanova in https://github.com/huggingface/evaluate/pull/220
• Remove import statement in Measurement Card by @meg-huggingface in https://github.com/huggingface/evaluate/pull/231
• make rouge support multi-ref by @lvwerra in https://github.com/huggingface/evaluate/pull/229
• Fix enforce string by @lvwerra in https://github.com/huggingface/evaluate/pull/230
• Fix examples in perplexity measurement docs by @mathemakitten in https://github.com/huggingface/evaluate/pull/238
• Add Wilcoxon's signed rank test by @douwekiela in https://github.com/huggingface/evaluate/pull/237
• Add support for two input columns for TextClassificationEvaluator by @fxmarty in https://github.com/huggingface/evaluate/pull/205
• fix bug in TEMPLATE_REQUIRE: add comma by @BramVanroy in https://github.com/huggingface/evaluate/pull/248
• Minor quicktour doc suggestions by @stevhliu in https://github.com/huggingface/evaluate/pull/236
• Clarify error message for ChrF no. references by @BramVanroy in https://github.com/huggingface/evaluate/pull/247
• only track unique missing dependencies by @BramVanroy in https://github.com/huggingface/evaluate/pull/246
• Update evaluate in spaces by @lvwerra in https://github.com/huggingface/evaluate/pull/228
• add commit_hash to args by @lvwerra in https://github.com/huggingface/evaluate/pull/253
• Change perplexity to be calculated with base e by @mathemakitten in https://github.com/huggingface/evaluate/pull/242
• Rebase for previous PR by @mathemakitten in https://github.com/huggingface/evaluate/pull/254
• Fix docstrings with new perplexities with base e by @mathemakitten in https://github.com/huggingface/evaluate/pull/255
• add a tokenizer option to rouge by @lvwerra in https://github.com/huggingface/evaluate/pull/258
• Adding list_duplicates=True to example. by @meg-huggingface in https://github.com/huggingface/evaluate/pull/263
• Minor change in describing what this does. by @meg-huggingface in https://github.com/huggingface/evaluate/pull/267
• Mapping example output to returned output. by @meg-huggingface in https://github.com/huggingface/evaluate/pull/268
• Changes "duplicates_list" to "duplicates_dict" (since it's dict) by @meg-huggingface in https://github.com/huggingface/evaluate/pull/265
• Changes "duplicates_list" to "duplicates_dict" in the example. by @meg-huggingface in https://github.com/huggingface/evaluate/pull/264
• Add slow flag to two column parity test by @lvwerra in https://github.com/huggingface/evaluate/pull/273
• Remove handle_impossible_answer from the default PIPELINE_KWARGS in the question answering evaluator by @fxmarty in https://github.com/huggingface/evaluate/pull/272
• Toxicity Measurement by @sashavor in https://github.com/huggingface/evaluate/pull/262
• Automatically choose dataset split if none provided by @mathemakitten in https://github.com/huggingface/evaluate/pull/232
• Fix YAML in Toxicity by @lvwerra in https://github.com/huggingface/evaluate/pull/278
• Added metric Brier Score by @kadirnar in https://github.com/huggingface/evaluate/pull/275
• Check for mismatch in device setup in evaluator by @mathemakitten in https://github.com/huggingface/evaluate/pull/287
• Fix transfomers import in the evaluator by @mathemakitten in https://github.com/huggingface/evaluate/pull/291
• Add support for name field when loading data by @mathemakitten in https://github.com/huggingface/evaluate/pull/283
• Adding regard measurement by @sashavor in https://github.com/huggingface/evaluate/pull/271
• Raise exception instead of assert in BertScore by @BramVanroy in https://github.com/huggingface/evaluate/pull/292
• fix regard yaml by @lvwerra in https://github.com/huggingface/evaluate/pull/295
• Add CONTRIBUTING.md by @mathemakitten in https://github.com/huggingface/evaluate/pull/293
• Refactor kwargs and configs by @lvwerra in https://github.com/huggingface/evaluate/pull/188
• Revert "Refactor kwargs and configs" by @lvwerra in https://github.com/huggingface/evaluate/pull/299
• Add missing split and subset kwarg into other evaluators by @mathemakitten in https://github.com/huggingface/evaluate/pull/301
• Adding HONEST score by @sashavor in https://github.com/huggingface/evaluate/pull/279
• fix wrong sorting in check by @sanderland in https://github.com/huggingface/evaluate/pull/305
• Fix HONEST yaml by @lvwerra in https://github.com/huggingface/evaluate/pull/303
• Refactor current_features to selected_feature_format by @mathemakitten in https://github.com/huggingface/evaluate/pull/306
• replace datasets list with local list of tasks by @lvwerra in https://github.com/huggingface/evaluate/pull/309
• Adding torch to the requirements by @sashavor in https://github.com/huggingface/evaluate/pull/311
• Honest space fix by @sashavor in https://github.com/huggingface/evaluate/pull/312
• Use HTML relative paths for tiles by @lewtun in https://github.com/huggingface/evaluate/pull/318
• Test for valid YAML files by @mathemakitten in https://github.com/huggingface/evaluate/pull/308
• add versioning the HubEvaluationModuleFactory by @lvwerra in https://github.com/huggingface/evaluate/pull/314
• Add text2text evaluator by @lvwerra in https://github.com/huggingface/evaluate/pull/261
• try main if tag does not work by @lvwerra in https://github.com/huggingface/evaluate/pull/322

New Contributors

• @fcakyon made their first contribution in https://github.com/huggingface/evaluate/pull/221
• @meg-huggingface made their first contribution in https://github.com/huggingface/evaluate/pull/231
• @stevhliu made their first contribution in https://github.com/huggingface/evaluate/pull/236
• @kadirnar made their first contribution in https://github.com/huggingface/evaluate/pull/275
• @sanderland made their first contribution in https://github.com/huggingface/evaluate/pull/305

Full Changelog: https://github.com/huggingface/evaluate/compare/v0.2.2...v0.3.0