Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is there an official documentation for the Java code? #243

Open
limin05030 opened this issue Aug 12, 2024 · 3 comments
Open

Is there an official documentation for the Java code? #243

limin05030 opened this issue Aug 12, 2024 · 3 comments

Comments

@limin05030
Copy link

Hello, I am very interested in the kotlin code under the com.shifthackz.aisdv1.feature.diffusion.ai package (such as vae/VaeDoder.kt, unet/UNet.kt, etc.). Is there any official documentation for this part of the code that can be used as a reference?

If I want to add a new Scheduler, is there anything I can use as a reference?

@ShiftHackZ
Copy link
Owner

Hi, thanks for your interest in SDAI app.

The Local Diffusion functionality is still in the experimental stage, so the structure of the package or the interface methods/parameters contracts might change in the future. Because of that, the package does not have any documentation yet. Furthermore, you are the first person ever asking for the docs 😄.

But in general, current codebase is designed to try and replicate Stable Diffusion implementation with ONNX library (so it has similar components/packages with similar naming, like uNet, scheduler, etc).

If you are interested in implementing another Scheduler, and you have some understanding of how Stable Diffusion works, maybe some of this info might be helpful:

  • I like this article which describes theoretical principles of Stable Diffusion components, providing some basic code samples.

  • Schedulers package from diffusers python package (actually the python code implementation of Stable Diffusion schedulers).

  • ONNX Runtime documentation (the library that powers Local Diffusion AI generations).

@limin05030
Copy link
Author

Hi, thanks for your interest in SDAI app.

The Local Diffusion functionality is still in the experimental stage, so the structure of the package or the interface methods/parameters contracts might change in the future. Because of that, the package does not have any documentation yet. Furthermore, you are the first person ever asking for the docs 😄.

But in general, current codebase is designed to try and replicate Stable Diffusion implementation with ONNX library (so it has similar components/packages with similar naming, like uNet, scheduler, etc).

If you are interested in implementing another Scheduler, and you have some understanding of how Stable Diffusion works, maybe some of this info might be helpful:

  • I like this article which describes theoretical principles of Stable Diffusion components, providing some basic code samples.
  • Schedulers package from diffusers python package (actually the python code implementation of Stable Diffusion schedulers).
  • ONNX Runtime documentation (the library that powers Local Diffusion AI generations).

Thank you very much for your answer. I am very interested in implementing SD on mobile devices and have been searching for relevant information. Thank you for providing the article, I will read it carefully. Looking forward to your follow-up updates.

@sl33pyC01E
Copy link

Please look into the mediapipe and qualcomm methods ;-;

I would also love more documentation

Local Diffusion in it's current state isn't very good..

I love the app though ;-;

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants