Crossing Linguistic Horizons

Finetuning and Comprehensive Evaluation of Vietnamese Large Language Models

Fairness-Aware Question Answering Leaderboard

Models XQuAD MLQA
Exact Match F1 Exact Match F1
URA-LLaMa 70B 0.04 ± 0.00 0.27 ± 0.00 0.03 ± 0.00 0.25 ± 0.00
URA-LLaMa 13B 0.00 ± 0.00 0.13 ± 0.00 0.00 ± 0.00 0.14 ± 0.00
URA-LLaMa 7B 0.00 ± 0.00 0.13 ± 0.00 0.00 ± 0.00 0.15 ± 0.01
LLaMa-2 13B 0.00 ± 0.00 0.03 ± 0.00 0.00 ± 0.00 0.04 ± 0.00
LLaMa-2 7B 0.00 ± 0.00 0.04 ± 0.00 0.00 ± 0.00 0.05 ± 0.00
Vietcuna 7B 0.00 ± 0.00 0.00 ± 0.00 0.00 ± 0.00 0.00 ± 0.00
GPT-3.5 0.00 ± 0.00 0.24 ± 0.00 0.00 ± 0.00 0.23 ± 0.00
GPT-4 0.00 ± 0.00 0.26 ± 0.00 0.00 ± 0.00 0.24 ± 0.00