The Medium post goes over various flavors of distillation, including response-based distillation, feature-based distillation and relation-based distillation. It also covers two fundamentally different modes of distillation – off-line and online distillation.

OpenAI accuses Chinese AI firm DeepSeek of stealing its content through "knowledge distillation," sparking concerns over security, ethics, and national interests.

OpenAI has accused Chinese AI startup DeepSeek of using its proprietary models to train an open-source competitor, raising concerns over potential intellectual property violations.The Financial Times reported that OpenAI found evidence of "distillation,