Deploy with an agent
Copy agent prompt
Before you start
Connect your AWS account and choose a project. Review the upstream deployment instructions for the release you plan to pin. See upstream virtual key setup.Data dependencies
PostgreSQL for virtual keys and database-backed spend tracking. A basic model proxy can run without SQL. See SQL databases for private writer access and connection details.Deployment order
- If you need virtual keys, create private PostgreSQL first and wait for the writer. Obtain the application connection from Connect.
- Set
DATABASE_URLto the writer for database-backed features. SetLITELLM_MASTER_KEYand provider credentials at runtime. Keep model routing in a versionedconfig.yamlthat references environment variables for secrets. - Deploy the pinned proxy image or a GitHub build containing the configuration. Use the configured HTTP port, commonly 4000, and restrict access to administrative routes.
- Start LiteLLM after its configured database is ready. Let the pinned image initialize its schema. Create scoped virtual keys only after the proxy is healthy.