root
/
MNN
mirror of https://github.com/alibaba/MNN.git
1
0
Fork 0
Code Issues Actions 8 Packages Projects Releases Wiki Activity
MNN/transformers/llm/datasets/get-sharegpt.sh

2 lines
94 B
Bash
Raw Normal View History

add perplexity and llm dataset processing, supports wikitext and shareGPT
2024-11-12 13:58:59 +08:00
git lfs install
git clone https://huggingface.co/datasets/shareAI/ShareGPT-Chinese-English-90k