Skip to content

Validator: Add Gender assumption bias validator #6

@baarish-tesu

Description

@baarish-tesu

Is your feature request related to a problem? Please describe.
Safety Validator for output that replaces assumptions of user gender made by LLM.

Describe the solution you'd like
If LLM assumes gender for user or any person they are talking about, this validator will replace that with gender neutral langugae.

Describe alternatives you've considered
No existing tools address this specific bias. Gender bias detectors are looking more broadly at semantic detection of gendered bias where certain characteristics or jobs may be assumed to be performed better by women. Or men may be assumed to be more aggressive etc.

Additional context
Limited scope validator that is using rule-based approach to replacing gendered language like pronouns and common nouns with gender neutral words.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Projects

Status

In Progress

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions