Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[how-to-use-ollama-sidecar-open-webui-frontend-cloud-run-gpu]: not working #1441

Open
szxyks opened this issue Oct 7, 2024 · 1 comment
Open

Comments

@szxyks
Copy link

szxyks commented Oct 7, 2024

Following this link: https://codelabs.developers.google.com/codelabs/how-to-use-ollama-sidecar-open-webui-frontend-cloud-run-gpu#6

I'm getting the below error:
$ gcloud beta run services replace service.yaml

Applying new configuration to Cloud Run service [ollama-sidecar-codelab] in project [steeve-playground] region [us-central1]
X  Deploying...                                                                                                                                                                                                                                                              
  -  Creating Revision...                                                                                                                                                                                                                                                    
  .  Routing traffic...                                                                                                                                                                                                                                                      
Deployment failed                                                                                                                                                                                                                                                            
ERROR: (gcloud.beta.run.services.replace) Revision 'ollama-sidecar-codelab-00006-bg8' is not ready and cannot serve traffic. The user-provided container failed to start and listen on the port defined provided by the PORT=8080 environment variable. Logs for this revision might contain more information.

Logs URL: https://console.cloud.google.com/logs/viewer?project=steeve-playground&resource=cloud_run_revision/service_name/ollama-sidecar-codelab/revision_name/ollama-sidecar-codelab-00006-bg8&advancedFilter=resource.type%3D%22cloud_run_revision%22%0Aresource.labels.service_name%3D%22ollama-sidecar-codelab%22%0Aresource.labels.revision_name%3D%22ollama-sidecar-codelab-00006-bg8%22 
For more troubleshooting guidance, see https://cloud.google.com/run/docs/troubleshooting#container-failed-to-start

The provided steps don't work, can someone please look at this and fix it because I ran all the command as outlined in the article

@szxyks
Copy link
Author

szxyks commented Oct 7, 2024

Not only that I have to fix the following:

In my terminal, here is what was deployed
us-central1-docker.pkg.dev/$PROJECT_ID/ollama-sidecar-codelab-repo/ollama-gemma-2b
us-central1-docker.pkg.dev/$PROJECT_ID/ollama-sidecar-codelab-repo/openwebui

While in service.yaml file you have
us-central1-docker.pkg.dev/$PROJECT_ID/ollama-sidecar-codelab/ollama-gemma-2b
us-central1-docker.pkg.dev/$PROJECT_ID/ollama-sidecar-codelab/openwebui

I add to fix so that I can run:
$ gcloud beta run services replace service.yaml

Which resulted in:
Deployment failed ERROR: (gcloud.beta.run.services.replace) Revision 'ollama-sidecar-codelab-00006-bg8' is not ready and cannot serve traffic. The user-provided container failed to start and listen on the port defined provided by the PORT=8080 environment variable.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant