rising3월 15일· 2 sources
LocalAI QuickStart: Run OpenAI-Compatible LLMs Locally
LocalAI 빠른 시작 가이드: OpenAI 호환 LLM을 로컬에서 실행하기
Why it matters
LocalAI is a self-hosted inference server providing OpenAI API-compatible endpoints for running LLMs and multi-modal AI workloads (text, images, audio, embeddings) on local hardware. It supports multiple backends with CPU and GPU acceleration options, and is most easily deployed via Docker containers with various image flavors tailored to different hardware configurations including NVIDIA CUDA, AMD ROCm, and Intel oneAPI.
2
Sources
+0
24h
—
Growth
180d
Active
dockerfinopsgpugpu accelerationllm apilocalaiopenai apiself-hosted llm모델 라우팅클라우드 비용