8000 Fix LiteLLM proxy configuration by ddkang1 · Pull Request #40 · ddkang1/smart-agent · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Fix LiteLLM proxy configuration #40

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Apr 5, 2025
Merged

Fix LiteLLM proxy configuration #40

merged 1 commit into from
Apr 5, 2025

Conversation

ddkang1
Copy link
Owner
@ddkang1 ddkang1 commented Apr 5, 2025

This PR fixes the LiteLLM proxy configuration to match the docker-compose approach:

  1. Mounts the config file directly to /app/config.yaml instead of a directory
  2. Uses command-line arguments instead of environment variables
  3. Adds --num_workers=8 for better performance
  4. Adds debugging output to show the Docker command being executed

These changes ensure that the LiteLLM proxy works correctly when launched directly with Docker, matching the behavior of the docker-compose setup.

@ddkang1 ddkang1 merged commit 8cd024e into main Apr 5, 2025
0 of 2 checks passed
@ddkang1 ddkang1 deleted the fix-litellm-proxy branch April 5, 2025 18:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@ddkang1
0