What zero data retention is
By default, many AI model providers keep API inputs and outputs for a limited window, often for abuse and safety monitoring. Zero data retention removes that storage, so prompts and responses are not written to logs after the request finishes. Providers typically grant ZDR to approved accounts, and some features that need stored data do not work with it.
ZDR and HIPAA are separate questions, and the rules vary by provider and product. OpenAI, for example, says API use with PHI requires an executed BAA and an organization provisioned with Modified Retention, not ZDR. Anthropic's API BAA covers only the API features it lists as covered. Check each vendor's guide, linked below, before relying on a configuration.
ZDR is also different from training. A provider can retain data without training on it, or train on data it keeps briefly. When evaluating a healthcare AI vendor, ask which model providers it uses, what retention applies, and whether BAAs flow down the chain. Rivvi signs a BAA, and patient data is not used to train third-party models.