[Question] how to run serve on SLM flow?

[Sing-Li]

❓ General Questions

I have been using syntax similar to:

python3 -m mlc_chat.serve.server --model HF://mlc-ai/Mistral-7B-Instruct-v0.2-q4f16_1-MLC --model-lib-path "/home/autoqa/.cache/mlc_chat/model_lib/6b41acbf7b45343971f8daf67be0573b.so"

because --model-lib-path is a required argument, I had to lookup the lib (by timestamp since I can't do md5 in my head)

Shouldn't the path to the generated model be figured out automatically by serve.server?

(fwiw: the md5 hash based scheme tying the weights and generated lib as one "logical whole" is ingenious but does cause some problem when I need to try and find the associated lib manually and when/if folks put the .cache on a shared drive to share the model between systems - due to their huge size and download time requirements)

[Sing-Li]

addressed by #1921 (comment)