
GPT4All runs open-weight models and LocalDocs entirely on your own device. Privatemode extends that reach to models you cannot host yourself, with your conversations encrypted in memory even while they are processed.

GPT4All keeps everything on your machine, which is why people choose it. But a local model is limited by your RAM and GPU, and small models have little context to spare for the passages LocalDocs retrieves.
The Privatemode proxy runs on the same machine and gives GPT4All access to models with far larger context windows than any model you could host yourself, so retrieved documents finally reach a model large enough to use them. Your prompts stay protected during processing within a hardware-isolated environment.
If you don't have a Privatemode API key yet, you can generate one for free here.
The proxy verifies the integrity of the Privatemode service using remote attestation. The proxy also encrypts all data before sending and decrypts data it receives.
Download GPT4All 3.10 from the official website: nomic.ai/gpt4all and open the application on your computer. Remote providers are added on the Add Model page, under the Remote Providers tab.
Minimal changes. GPT4All supports OpenAI-compatible remote providers since version 3.1, and version 3.10 gives them their own Remote Providers tab on the Add Model page. You add Privatemode there with the proxy URL, and the chat interface works as usual. Your local models remain available for offline use alongside Privatemode.
Your agent remembers everything. Your model provider shouldn't see it.
Your gateway routes every team's prompts. Your model provider shouldn't read them.

Want to look for yourself?
