Add an "Evaluate" tab to calculate the perplexities of models (#1322)

This commit is contained in:
oobabooga 2023-04-21 00:20:33 -03:00 committed by GitHub
parent ff0d0ac552
commit c4f4f41389
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
5 changed files with 203 additions and 22 deletions

View file

@ -5,12 +5,13 @@ flexgen==0.1.7
gradio==3.25.0
markdown
numpy
pandas
Pillow>=9.5.0
pyyaml
requests
rwkv==0.7.3
safetensors==0.3.0
sentencepiece
pyyaml
tqdm
git+https://github.com/huggingface/peft
transformers==4.28.1