Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

关于img_encoder和txt_encoder #8

Open
zxt6174 opened this issue Aug 27, 2024 · 1 comment
Open

关于img_encoder和txt_encoder #8

zxt6174 opened this issue Aug 27, 2024 · 1 comment

Comments

@zxt6174
Copy link

zxt6174 commented Aug 27, 2024

作者你好,代码我没看太明白,比如,如果我想更换img_enc和txt_enc部分,教师模型依然使用clip预训练模型,分别对应项目里的哪些文件。看代码有些没理解,你似乎只使用了clip。烦请指教。

@lerogo
Copy link
Owner

lerogo commented Aug 27, 2024

教师模型用的是unicom和mpnet,你可以看看文章或者看看readme的介绍。
如果要应用在其他方法上,你在其他方法上加上外部模型就可以了

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants