Skip to content

Conversation

@golden-ratio
Copy link
Contributor

Hi @NathanHB

I added KyrgyzLLM-Bench as discussed in #1036.

Overview of Changes:
This contribution adds the necessary configuration files and updates to fully integrate Kyrgyz language evaluation:

  1. New Task Configuration: Added the primary task configuration file:
    src/lighteval/tasks/multilingual/tasks/kyrgyz_eval.py

  2. Documentation Update: Updated the README.md to reflect the new language support under the "Multilingual Evaluation" section.

Testing Information: The implementation was tested locally with lighteval version 0.12.2 and successfully runs with the Accelerate backend.

Thank you :)

Copy link
Member

@NathanHB NathanHB left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looking great ! Only nits then we can merge.

ALso do you think it's possible to also add them using inspect ai framework ? It should be quite fast and we have examples here.

Чоң рахмат ! :)

@HuggingFaceDocBuilderDev
Copy link
Collaborator

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@NathanHB
Copy link
Member

hey ! can you just run make style and then we can merge :)

@golden-ratio
Copy link
Contributor Author

@NathanHB, could you pls have a look?

Thanks :)

@NathanHB NathanHB merged commit 2c98b54 into huggingface:main Dec 8, 2025
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants