Lemonade
serve optimized LLMs locally from your own GPUs and NPUs
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. It provides an OpenAI-compatible server, a command-line client and (on Windows) a desktop app.
https://lemonade-server.ai/
Utility
Lemonade CLI
command-line client for Lemonade Server
Lemonade
desktop app for Lemonade Server
Lemonade Server
local LLM server (with system tray icon on Windows)