Best AI tools for Run LLMs locally (no cloud)

Runs workloads privately without external dependencies or monitoring.

When you need managed services or external oversight.

Runs workloads privately without external dependencies or monitoring.

When you need managed services or external oversight.

Runs workloads privately without external dependencies or monitoring.

When you need managed services or external oversight.

Runs workloads privately without external dependencies or monitoring.

When you need managed services or external oversight.

Runs workloads privately without external dependencies or monitoring.

When you need managed services or external oversight.

Runs workloads privately without external dependencies or monitoring.

When you need managed services or external oversight.

Runs workloads privately without external dependencies or monitoring.

When you need managed services or external oversight.

Runs workloads privately without external dependencies or monitoring.

When you need managed services or external oversight.

Runs workloads privately without external dependencies or monitoring.

When you need managed services or external oversight.

Runs workloads privately without external dependencies or monitoring.

When you need managed services or external oversight.

Runs workloads privately without external dependencies or monitoring.

When you need managed services or external oversight.

Runs workloads privately without external dependencies or monitoring.

When you need managed services or external oversight.

Runs workloads privately without external dependencies or monitoring.

When you need managed services or external oversight.

Runs workloads privately without external dependencies or monitoring.

When you need managed services or external oversight.

Provides integrated capabilities within the broader ecosystem.

When you need specialized domain-specific features.

Provides integrated capabilities within the broader ecosystem.

When you need specialized domain-specific features.

Collects and aggregates metrics for monitoring.

When you need log or trace collection only.

User-friendly desktop app with RAG, web search, and model management.

Fewer advanced features than Open WebUI.

One-click installer for AI tools including LLMs and Stable Diffusion.

Abstraction may hide configuration options.

KubeVirt lets you run virtual machines on Kubernetes like pods. Useful for legacy VMs or Windows workloads.

Skip if the workflow above is not a close match. compare the rest of this list first.

eBPF programs run safely in the Linux kernel. Monitor system calls, network, disk.

Skip if the workflow above is not a close match. compare the rest of this list first.

Velero backs up Kubernetes resources and persistent volumes to cloud storage (S3, GCS, Azure).

Skip if the workflow above is not a close match. compare the rest of this list first.

APISIX is an open-source cloud-native API gateway. Dynamic routing and plugin loading.

Skip if the workflow above is not a close match. compare the rest of this list first.

Freebase is a large collaborative knowledge base. Now part of Google Knowledge Graph.

Skip if the workflow above is not a close match. compare the rest of this list first.

GQL is a standardized graph query language (ISO/IEC 39075). Successor to Cypher.

Skip if the workflow above is not a close match. compare the rest of this list first.

Ponchao is Tencent's open-source chaos testing framework. Multi-platform support (cloud, on-premise).

Skip if the workflow above is not a close match. compare the rest of this list first.