2 points | by iiTsEddy 11 hours ago ago
1 comments
Introducing Tiny-Qwen, an open source repo for Qwen3 and Qwen2.5 VL built from scratch using pytorch, served with a simple CLI.
If you like Andrej Karpathy's nanoGPT but can't find one for great open source models such as Qwen, this repo is for you!
It includes all variants of Qwen3 and Qwen 2.5 VL, with text + image input support and both dense and Mixture of Experts implemented from scratch.
Feel free to leave a star or any feedback
Introducing Tiny-Qwen, an open source repo for Qwen3 and Qwen2.5 VL built from scratch using pytorch, served with a simple CLI.
If you like Andrej Karpathy's nanoGPT but can't find one for great open source models such as Qwen, this repo is for you!
It includes all variants of Qwen3 and Qwen 2.5 VL, with text + image input support and both dense and Mixture of Experts implemented from scratch.
Feel free to leave a star or any feedback