Skip to content

Actions: huggingface/lighteval

Actions

All workflows

Actions

Loading...
Loading

Showing runs from all workflows
2,500+ workflow runs
2,500+ workflow runs

Filter by Workflow

⌥ + click/return to exclude

Filter by Event

⌥ + click/return to exclude

Filter by Status

⌥ + click/return to exclude

Filter by Branch

⌥ + click/return to exclude

Filter by Actor

⌥ + click/return to exclude
Pass max_tokens as an int on the litellm judge backend Build PR Documentation #2125: Pull request #1378 opened by gyanu2507
Action required gyanu2507:fix/litellm-judge-max-tokens-int
gyanu2507:fix/litellm-judge-max-tokens-int
Action required
Pass max_tokens as an int on the litellm judge backend Tests #4023: Pull request #1378 opened by gyanu2507
Action required gyanu2507:fix/litellm-judge-max-tokens-int
gyanu2507:fix/litellm-judge-max-tokens-int
Action required
Pass max_tokens as an int on the litellm judge backend Quality #4024: Pull request #1378 opened by gyanu2507
Action required gyanu2507:fix/litellm-judge-max-tokens-int
gyanu2507:fix/litellm-judge-max-tokens-int
Action required
Pass max_tokens as an int on the litellm judge backend Slow end to end tests #1623: Pull request #1378 opened by gyanu2507
Action required gyanu2507:fix/litellm-judge-max-tokens-int
gyanu2507:fix/litellm-judge-max-tokens-int
Action required
[FT] Add tests for VLLMModel base methods .github/workflows/pr_style_bot.yaml #327: Issue comment #724 (comment) by sneha4175
Failure
Failure
Add unit tests for VLLMModel core methods (#724) Build PR Documentation #2124: Pull request #1377 opened by sneha4175
Action required sneha4175:add-vllm-model-unit-tests
sneha4175:add-vllm-model-unit-tests
Action required
Add unit tests for VLLMModel core methods (#724) Quality #4023: Pull request #1377 opened by sneha4175
Action required sneha4175:add-vllm-model-unit-tests
sneha4175:add-vllm-model-unit-tests
Action required
Add unit tests for VLLMModel core methods (#724) Tests #4022: Pull request #1377 opened by sneha4175
Action required sneha4175:add-vllm-model-unit-tests
sneha4175:add-vllm-model-unit-tests
Action required
Add unit tests for VLLMModel core methods (#724) Slow end to end tests #1622: Pull request #1377 opened by sneha4175
Action required sneha4175:add-vllm-model-unit-tests
sneha4175:add-vllm-model-unit-tests
Action required
Use ast.literal_eval instead of eval in hellaswag_arabic_pfn .github/workflows/pr_style_bot.yaml #326: Issue comment #1294 (comment) by jayzuccarelli
Failure
Failure
Fix normalized multiple-choice probability underflow Build PR Documentation #2123: Pull request #1376 opened by YusefSyed
Action required YusefSyed:fix/normalized-mc-prob-underflow
YusefSyed:fix/normalized-mc-prob-underflow
Action required
Fix normalized multiple-choice probability underflow Quality #4022: Pull request #1376 opened by YusefSyed
Action required YusefSyed:fix/normalized-mc-prob-underflow
YusefSyed:fix/normalized-mc-prob-underflow
Action required
Fix normalized multiple-choice probability underflow Tests #4021: Pull request #1376 opened by YusefSyed
Action required YusefSyed:fix/normalized-mc-prob-underflow
YusefSyed:fix/normalized-mc-prob-underflow
Action required
Fix normalized multiple-choice probability underflow Slow end to end tests #1621: Pull request #1376 opened by YusefSyed
Action required YusefSyed:fix/normalized-mc-prob-underflow
YusefSyed:fix/normalized-mc-prob-underflow
Action required
Pass custom_tasks through to Registry in the Inspect backend .github/workflows/pr_style_bot.yaml #325: Issue comment #1320 (comment) by MohammadSadeghSalehi
Failure
Failure
Upload PR Documentation Upload PR Documentation #1568: completed by MohammadSadeghSalehi
10s
10s
fix(metrics): add actionable BERTScore baseline guidance Build PR Documentation #2122: Pull request #1373 opened by LarryHu0217
Action required LarryHu0217:codex/bertscore-baseline-guidance-995
LarryHu0217:codex/bertscore-baseline-guidance-995
Action required
fix(metrics): add actionable BERTScore baseline guidance Tests #4020: Pull request #1373 opened by LarryHu0217
Action required LarryHu0217:codex/bertscore-baseline-guidance-995
LarryHu0217:codex/bertscore-baseline-guidance-995
Action required
fix(metrics): add actionable BERTScore baseline guidance Quality #4021: Pull request #1373 opened by LarryHu0217
Action required LarryHu0217:codex/bertscore-baseline-guidance-995
LarryHu0217:codex/bertscore-baseline-guidance-995
Action required
fix(metrics): add actionable BERTScore baseline guidance Slow end to end tests #1620: Pull request #1373 opened by LarryHu0217
Action required LarryHu0217:codex/bertscore-baseline-guidance-995
LarryHu0217:codex/bertscore-baseline-guidance-995
Action required
fix(tasks): skip few-shot reuse warning for zero-shot tasks Build PR Documentation #2121: Pull request #1372 opened by LarryHu0217
Action required LarryHu0217:codex/avoid-zero-shot-fewshot-warning-801
LarryHu0217:codex/avoid-zero-shot-fewshot-warning-801
Action required
fix(tasks): skip few-shot reuse warning for zero-shot tasks Slow end to end tests #1619: Pull request #1372 opened by LarryHu0217
Action required LarryHu0217:codex/avoid-zero-shot-fewshot-warning-801
LarryHu0217:codex/avoid-zero-shot-fewshot-warning-801
Action required
fix(tasks): skip few-shot reuse warning for zero-shot tasks Quality #4020: Pull request #1372 opened by LarryHu0217
Action required LarryHu0217:codex/avoid-zero-shot-fewshot-warning-801
LarryHu0217:codex/avoid-zero-shot-fewshot-warning-801
Action required
fix(tasks): skip few-shot reuse warning for zero-shot tasks Tests #4019: Pull request #1372 opened by LarryHu0217
Action required LarryHu0217:codex/avoid-zero-shot-fewshot-warning-801
LarryHu0217:codex/avoid-zero-shot-fewshot-warning-801
Action required
vLLM Main Branch Tests vLLM Main Branch Tests #27: Scheduled
2m 30s main
main
2m 30s