Local AI & Inference
ExLlamaV2
Fast inference library for running local LLMs on modern NVIDIA GPUs with EXL2 quantization.
Pricing Model
Free access; limits may apply
LanguagePython / C++
LicenseMIT
Free Tier AllowanceSee the official site for free access and limits.
🏷️ DevShelf Directory Badge
🛡️ Secured by AgentShield Badge
🔗 Related Free Tools in Local AI & Inference
Ollama
Get up and running with Llama 3.3, Mistral, Qwen, and other large language models locally with a simple CLI and REST API.
→
vLLM
A high-throughput and memory-efficient inference and serving engine for LLMs with PagedAttention.
→
YYLO
Command-line orchestrator for AI coding agents: runs Claude Code, Codex CLI, and Gemini CLI in parallel git worktrees with Kanban task state, typed merge flows, and per-agent skills.
→
LocalAI
Local, OpenAI-compatible REST API for running LLMs, audio transcription, image generation, and embeddings on commodity CPU/GPU.
→
💬 Frequently Asked Questions (AI & Developer Summary)
What free access does ExLlamaV2 offer? ▼
See the official site for free access and limits. License: MIT.
What are the authentication and access requirements for ExLlamaV2? ▼
See the official site for authentication and access requirements.