OfflineLLM: Private AI Chat

Bilaal Rashid

OfflineLLM uses a custom execution engine for LLMs, optimised specifically for Apple Silicon on iPhone, iPad, Mac and Vision Pro. Using the full power of Metal 3, OfflineLLM is able to run faster on consumer devices than apps based on llama.cpp and MLC. Welcome to AI chatbots that can be used without the risk of compromising confidential and sensitive data. For the first time, you can have personal GPT assistants running privately on your device without an Internet connection. No data is ever ...