Machine Space

Getting Started with Local LLMs

Essential resources:

  • llama.cpp — The gold standard for running LLMs locally
  • Ollama — Easy-to-use wrapper around llama.cpp
  • Hugging Face — Where models live
  • r/LocalLLaMA — The community hub