Kauz.ai is the provider of aiStudio, a self-service platform for managing and training simple and complex AI assistants. The company integrates various large language models with its own developed NLU (Natural Language Understanding) engine. With Kauz.ai the response behavior of the AI assistants is context-based and expandable, making AI efficient and easy to use for all types of organizations.
Intelligent chatbots that leverage Generative AI and large language models (LLMs), such as ChatGPT, offer significant opportunities for innovation and efficiency. However, due to stringent IT security and data privacy requirements, many organizations, especially in banking and financial services, currently cannot leverage AI technologies at scale. Due to these restrictions, the challenge for Kauz.ai was: How can we offer our customers powerful chatbots with state-of-the-art LLMs, while ensuring data security and privacy?
Privatemode AI is the perfect solution for this problem. Privatemode is GenAI service that enables you to use LLMs with end-to-end data encryption powered by confidential computing. Confidential computing is a technology that allows for encryption of data even during processing. In addition, the technology comes with remote attestation, making the integrity of a protected workload verifiable to the user. With the latest Nvidia H100 GPUs, confidential computing is also possible for setups that require AI accelerators.
Privatemode AI enables the creation of ChatGPT-style services where both user prompts and model weights are shielded throughout, ensuring that neither the infrastructure nor the service provider can access any user data in plaintext. In short, it works by running the model in a confidential computing environment (CCE) where data stays encrypted in memory. The inference code that processes prompts operates in a sandbox to prevent data leaks. You can try it out for yourself, for free! For more technical information, visit the documentation.
Privatemode can also be integrated easily into existing AI solutions like chatbots via API. Contact us if you want to learn more.
A confidential version of aiStudio offers Kauz.ai’s customers in regulated sectors, such as banks and insurance companies, an additional layer of security. By leveraging the confidential-computing capabilities of Privatemode AI, the combined solution ensures that user prompts and responses remain encrypted during processing, eliminating the risk of data leaks to infrastructure or model providers.
By offering this option, Kauz.ai demonstrates its commitment to addressing the unique security needs of customers with sensitive data and personal identifiable information (PII). With confidential aiStudio, these organizations will be able to confidently adopt AI assistants to streamline their operations and enhance customer experiences, while maintaining the utmost security and compliance.
