Alternative method for downloading Llama2 70b

[tianmu-li]

Is it allowed to use "git clone https://huggingface.co/regisss/llama2-70b-fused-qkv-mlperf" (with git-lfs) instead of using the Google Drive link to download the model? The weights in the repo are smaller (bf16 vs fp32?) and running git clone is easier on Linux.

[ShriyaPalsamudram]

Please follow steps listed in download-data-and-model to download the dataset. The latest instructions use rclone to download the dataset, which should work well on linux systems as well.

[robinfang7]

I don't know how to setup rclon config. Do I have other way to download mlc-llama2:Llama2-70b-fused-qkv-mlperf and mlc-llama2:training/scrolls_gov_report_8k from huggingface ? Thx.

[ShriyaPalsamudram]

You will need rclone to access the data from the MLCommons hosted S3 bucket. But it should very straight forward to setup rclone on any machine