Skip to content

Conversation

@bram-pramono
Copy link
Contributor

The list tasks function of lighteval tasks list is not showing all tasks without suite. The whole suite seems to be a work in progress. To still show the list of tasks, I register the tasks without suite on a different list to print.

Copy link
Member

@NathanHB NathanHB left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great ! thanks for the fix :)
Because we removed suites can you jsut not take them into account ? Only listing tasks without any reference to suites ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants