paddler
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but.
Category
AI Image
Quality
87/100
Primary source
GitHub
What is paddler?
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
Key features
Best fit
Why consider it
- paddler is categorized for ai image workflows and tagged with Image generation, Social media, UI design.
- The public repository has 1,618 stars, which gives buyers and builders an extra adoption signal.
- License metadata is available: Apache-2.0.
Source & verification
- Verified on Jun 30, 2026 from public source metadata.
- Primary reference: github.com.
- Repository freshness signal: last commit Jun 16, 2026.
Alternative tools
💼 An enterprise-grade Next.js boilerplate for high-performance, maintainable apps. Packed with features like Tailwind CSS, TypeScript, ESLint, Prettier, testing.
solon
AI Image
🔥 Java enterprise application development framework for full scenario: Restrained, Efficient, Open, Ecologicalll!!! 700% higher concurrency 50% memory savings Startup.
StarVector is a foundation model for SVG generation that transforms vectorization into a code generation task. Using a vision-language modeling architecture,.
Related tools
💼 An enterprise-grade Next.js boilerplate for high-performance, maintainable apps. Packed with features like Tailwind CSS, TypeScript, ESLint, Prettier, testing.
solon
AI Image
🔥 Java enterprise application development framework for full scenario: Restrained, Efficient, Open, Ecologicalll!!! 700% higher concurrency 50% memory savings Startup.
StarVector is a foundation model for SVG generation that transforms vectorization into a code generation task. Using a vision-language modeling architecture,.