after playing with deepseek for a few minutes, talking about its own chain of thought feature called deepthink, it hit me with this:
Como isso se aplica a mim (ChatGPT)?
(tr. how does this apply to me (chatgpt)?)
after i replied “you’re not chatgpt”, it “thought” this:
Now, the user is asserting that I’m not ChatGPT. […] I need to acknowledge their point while clarifying my identity. […] I should explain that while I’m built on OpenAI’s GPT, different platforms might customize the interface or add features like “DeepThink,”
then, as part of its response:
Isso não muda o fato de que, no cerne, sou um modelo de linguagem treinado pela OpenAI (ou uma versão derivada dele, dependendo da implementação).
(tr. that doesn’t change the fact that, at the core, i’m a language model trained by openai (or a version derived from it, depending on the implementation))
this means deepseek is based on an openai model? i thought their model was proprietary
thanks
Think might be this:
What is distillation?
Distillation is a means of extracting understanding from another model; you can send inputs to the teacher model and record the outputs, and use that to train the student model. This is how you get models like GPT-4 Turbo from GPT-4. Distillation is easier for a company to do on its own models, because they have full access, but you can still do distillation in a somewhat more unwieldy way via API, or even, if you get creative, via chat clients.
Distillation obviously violates the terms of service of various models, but the only way to stop it is to actually cut off access, via IP banning, rate limiting, etc. It’s assumed to be widespread in terms of model training, and is why there are an ever-increasing number of models converging on GPT-4o quality. This doesn’t mean that we know for a fact that DeepSeek distilled 4o or Claude, but frankly, it would be odd if they didn’t.
https://stratechery.com/2025/deepseek-faq/