StartOS, UmbrelOS Now Let You Self-Host Private AI Models
StartOS and UmbrelOS users can now self-host some of the popular AI models on their home servers with ease.
- "Start9, the company behind StartOS, today announced the addition of Stable Diffusion, a text-to-image diffusion model, and FreeGPT, a large language model (LLM) chat interface, to the Start9 Marketplace."
- "Use Stable Diffusion to create new worlds, fantastic characters, and unique imagery from short text descriptions. To ensure proper performance and functionality, Stable Diffusion is currently only available on the Start9 Server Pure."
- "Use FreeGPT to engage in conversation with your own private AI chatbot."
- "These new services introduce AI capabilities to StartOS users for the first time, allowing them to host their own private AI models on a personal server."
"AI might prove to be the most profoundly impactful innovation of the 21st century. It is critical that this new power does not concentrate into the hands of a few, leaving the rest of us dependent on the innovation of those individuals and entities. In the hands of us all, unencumbered, AI could ignite an era of freedom, prosperity, and exploration unparalleled in human history. It is that important," said Matt Hill, CEO and co-founder of Start9.
Press Release / Archive
Announcement / Archive
Umbrel added LlamaGPT
- "Introducing LlamaGPT — a self-hosted, offline and private AI chatbot, powered by Llama 2, with absolutely no data leaving your device."
- "Your Umbrel Home, Raspberry Pi (8GB) Umbrel, or custom umbrelOS server can run it with just 5GB of RAM!"
- "You can install LlamaGPT in one click from the app store on your Umbrel. It's a ~5.5GB download, and may take a while to install depending on your internet speed."
- "LlamaGPT is open source and can be installed on any x86 or arm64 system that has Docker installed."
