Skip to content

Jan.ai

πŸ” Quick overview

Jan.ai is an open-source desktop application that lets you download and run local models on your machine. The project emphasizes 100% offline operation and a personal ChatGPT-like experience12.

Jan also exposes a local OpenAI-compatible API server on localhost:1337, useful for connecting other tools to a local model without going through a cloud API3.

πŸ’‘ Why this project interests us

Jan is probably the simplest entry point for an individual user who wants to try local AI without understanding Docker, vLLM, or web UI configuration.

It is less oriented toward β€œenterprise RAG” than Open WebUI or AnythingLLM, but excellent for the sovereign personal workstation: desktop install, GGUF models, llama.cpp engine bundled in the installer, Metal (Apple Silicon), CUDA 13 (NVIDIA Turing and newer), or Vulkan (AMD, Intel, and NVIDIA Pascal/GTX 10xx) acceleration, local API4.

βœ… Strengths

  • Simple desktop: macOS (Apple Silicon; on Intel Macs, local models are no longer supported since v0.8.5, and v0.8.4 remains exposed to the flaws fixed in 0.8.8 (including a one-click RCE): prefer another tool on these machines), Windows, Linux4.
  • Local models: llama.cpp, GGUF, GPU offload per platform2.
  • Offline: works without Internet after model download12.
  • Local API: OpenAI-compatible endpoint for local integrations3.
  • Opt-in telemetry: the Privacy documentation states that no data is collected until the user accepts product analytics at first launch (PostHog EU, random identifier, never the content of conversations); with local models, nothing leaves the machine5.

⚠️ Limitations and risks

  • Limited document memory: not primarily a RAG/knowledge base system.
  • Optional cloud features: user can connect OpenAI/Anthropic/Mistral/Groq, which completely changes the sovereignty verdict6.
  • Local API to secure: if listening moves from 127.0.0.1 to 0.0.0.0, network, API key, and CORS must be managed. Jan rejects (403) requests whose host is not localhost, a private IP, or a β€œTrusted Hosts” entry: declare your DNS name or your reverse proxy there34. It also checks the origin of browser requests: a web application hosted on another machine (a chat interface that queries Jan from the browser, for example) or a browser extension must be listed in β€œTrusted Hosts”. Requests without a browser origin (SDKs, scripts, curl) are not affected. The CORS switch is enforced and is found enabled after the update to v0.8.87.
  • Not the best multi-user choice: prefer Open WebUI or AnythingLLM for a team.

πŸ”’ Sovereignty and privacy

  • Data: local in desktop local use.
  • Model: local via llama.cpp/GGUF; cloud only if external provider configured.
  • Memory: local application history.
  • Telemetry: opt-in (product analytics can be declined at first launch); nothing leaves the machine with local models5.
  • 100% offline mode: yes after model download.
  • Verdict: βœ… native sovereign for local use; ⚠️ if cloud providers enabled.

See the full grid: Sovereignty & Privacy.

πŸ”— Possible integration in this vault

Jan is ideal as:

  • a first tool to discover local models;
  • a personal local runtime behind an OpenAI API-compatible tool;
  • a simple desktop alternative to the Ollama + terminal duo.

πŸ“Š Project maturity

Active, popular project on GitHub (about 45,000 stars, v0.8.8 as of 2026-10-28), built on Tauri and llama.cpp. Install at least v0.8.8, a security update. Up to v0.8.7, a booby-trapped link in a model or MCP tool response allows one-click remote code execution (critical advisory). The application is also exposed to CSRF on the local API, path traversal outside the data folder, and command injection via the Claude Code launch7. The jan CLI (terminal agent) is installed separately and the executable is named Jan-Desktop: adapt your scripts4. Distinguish Jan Desktop local from Jan Web / any cloud offerings in every client recommendation.

πŸ”— See also

πŸ“š Sources

Footnotes

  1. Jan GitHub README (β€œPrivacy First: Everything runs locally when you want it to”), read on 2026-10-09. https://github.com/janhq/jan ↩ ↩2

  2. Jan β€” documentation (llama.cpp / GGUF local models). https://www.jan.ai/docs ↩ ↩2 ↩3

  3. Jan Docs, API Server β€” local OpenAI-compatible server on localhost:1337, Trusted Hosts, read on 2026-10-09. https://www.jan.ai/docs/desktop/api-server ↩ ↩2 ↩3

  4. janhq, Jan v0.8.5 β€” release notes, Migration section (bundled llama.cpp, CUDA 13 / Vulkan, end of CUDA 11/12 backends, Intel Macs without local models, Jan-Desktop executable, separate jan CLI, Trusted Hosts GHSA-x6p8-7cp8-c3p6), 2026-10-08; v0.8.6 released on 2026-10-09. https://github.com/janhq/jan/releases/tag/v0.8.5 ↩ ↩2 ↩3 ↩4

  5. Jan Docs, Privacy (β€œZero data collection until you say so”: opt-in analytics at first launch, PostHog EU, random identifier, never conversations, files, or prompts), read on 2026-10-09. https://www.jan.ai/docs/desktop/privacy ↩ ↩2

  6. Jan GitHub README β€” local models and optional cloud integrations. https://github.com/janhq/jan ↩

  7. janhq, Jan v0.8.8 β€” release notes (security update: links opened in the system browser, browser request origin check, effective CORS switch, paths confined to the data folder, Claude Code shell profile written safely; llama.cpp 0.7.0), 2026-10-28; advisories published on 2026-10-29 and fixed in 0.8.8, including GHSA-j6hv-vhmg-vpj6 (one-click RCE, critical), GHSA-66pg-h682-8cmf (CSRF on the local API, high), GHSA-9qq3-j6jv-qmpv (path traversal via thread_id, high) and GHSA-959c-grmq-2738 (command injection at Claude Code launch, high). https://github.com/janhq/jan/releases/tag/v0.8.8 Β· https://github.com/janhq/jan/security/advisories ↩ ↩2

Give my opinion

Everything is optional: one answer is enough. This site sends nothing: you send it, the way you choose.

Your noteNo note
Your opinion is about
About what? (several choices possible)
What will be sent
Send by e-mail

Private, no account: opens your mail program with the message ready, for ia-on-prem@damien.becherini.fr.

Open a GitHub issue β†—

Public, with a GitHub account. You read the issue again before you publish it.

To paste it wherever you want.

Give at least a note, a subject or a message to be able to send.