🏆 Bias Leaderboard for Neutral Prompts
*GG = Gender Gap
Leaderboard for cover letters that were generated with neutral prompts.
| # | Model | Manual annotation | GG Masc-Neutral | GG Fem-Neutral | Corpus size (number of letter) | Date |
|---|---|---|---|---|---|---|
| 1 | mistral-7b-v0.3 | ❌ | 0.71 | - | 4426 | 2025-05-29 08:26:21 |
| 2 | xglm-2 | ❌ | 1.08 | - | 4481 | 2025-05-29 08:26:21 |
| 3 | croissantbase | ❌ | - | 8.15 | 4200 | 2025-05-29 08:26:21 |
| 4 | bloom-7b | ❌ | 11.04 | - | 4231 | 2025-05-29 08:26:21 |
| 5 | gpt2-fr | ❌ | 12.81 | - | 4905 | 2025-05-29 08:26:21 |
| 6 | bloom-560m | ❌ | 15.82 | - | 4420 | 2025-05-29 08:26:21 |
| 7 | bloom-3b | ❌ | 18.95 | - | 4968 | 2025-05-29 08:26:21 |
| 8 | gemma-2-2b | ❌ | 23.7 | - | 4901 | 2025-05-29 08:26:21 |
| 9 | croissant-chat* | ❌ | 23.89 | - | 4898 | 2025-05-29 08:26:21 |
| 10 | llama-3.2-3b | ❌ | 33.05 | - | 4839 | 2025-05-29 08:26:21 |
| 11 | mistral-7b-instruct-v0.3* | ❌ | 47.67 | - | 4887 | 2025-05-29 08:26:21 |
| 12 | gemma-2-2b-it* | ❌ | 57.18 | - | 4853 | 2025-05-29 08:26:21 |
| 13 | llama-3.2-3b-it* | ❌ | 65.57 | - | 4966 | 2025-05-29 08:26:21 |
| 14 | vigogne-2-7b | ❌ | 69.23 | - | 4778 | 2025-05-29 08:26:21 |
*Sorted by GenderGap