distributed-llama
Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
Category
AI Productivity
Quality
84/100
Primary source
GitHub
What is distributed-llama?
Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
Key features
Best fit
Why consider it
- distributed-llama is categorized for ai productivity workflows and tagged with Meetings, Notes, Workflows.
- The public repository has 2,967 stars, which gives buyers and builders an extra adoption signal.
- License metadata is available: MIT.
Source & verification
- Verified on Jun 30, 2026 from public source metadata.
- Primary reference: github.com.
- Repository freshness signal: last commit Apr 14, 2026.
Alternative tools
MockServer is an HTTP(S) mock server and proxy for testing that lets you mock APIs, inspect and modify live traffic, and inject failures. It supports HTTP/1.1, HTTP/2,.
TypeScript multi-agent orchestration framework. Describe a goal, a coordinator decomposes it into a task DAG that runs on any LLM: Claude, ChatGPT, Gemini, DeepSeek,.
Related tools
MockServer is an HTTP(S) mock server and proxy for testing that lets you mock APIs, inspect and modify live traffic, and inject failures. It supports HTTP/1.1, HTTP/2,.
TypeScript multi-agent orchestration framework. Describe a goal, a coordinator decomposes it into a task DAG that runs on any LLM: Claude, ChatGPT, Gemini, DeepSeek,.