There are no open source AI models, at least not useful ones (yet [1]). Open weight is not the same as open source. "Open weight" models are still just inscrutable binary blobs that you can (theoretically) run on your own computer instead of through a SAAS web app. The open weight model labs don't even provide a high level catalog or any description whatsoever about what went into the training data.
This is not open source and we should stop conflating the two things.
> Open-Source AI
There are no open source AI models, at least not useful ones (yet [1]). Open weight is not the same as open source. "Open weight" models are still just inscrutable binary blobs that you can (theoretically) run on your own computer instead of through a SAAS web app. The open weight model labs don't even provide a high level catalog or any description whatsoever about what went into the training data.
This is not open source and we should stop conflating the two things.
[1] https://allenai.org/
>The open weight model labs don't even provide a high level catalog or any description whatsoever about what went into the training data.
because the training data is full of copyrighted works.
the answer to "what went into the training data" is "everything we could get our hands on".
I think you would be pleasantly surprised by the content of the linked article.
I thought Nemotron tried to be pretty open?
How about learning the internals of LLMs, is Sebastian Raschka's content still the best in 2026?