deus-ex-machina
·
AI & ML interests
None yet
Recent Activity
replied to
ccocks-deca's
post
10 days ago
12 hours ago:
```
Something big* coming
*big = biggest in the world
```
Annnnnd... here it is! https://huggingface.co/deca-ai/3-alpha-ultra âthe largest AI model in the world by https://huggingface.co/deca-ai, clocking in at a whopping 4.6T parameters. Apologies for the delay, but weâre stoked to finally drop this, even in its alpha stage. Before you dive in, here are a few things to keep in mind:
1. **No commercial use yet**: We're still working on Deca 2.5 (Proprietary), and releasing Deca 3 for commercial use right now would impact that. Once Deca 3.5 hits in early '26, weâll be opening it up with a more permissive license.
2. **Built on existing models**: Deca 3 isnât a ground-up creationâitâs a huge step forward, building on whatâs already out there.
3. **Itâs experimental**: As much as weâre hyped about its scale, itâs still in testing.
4. **DynaMoE architecture**: Run a (very) small part of the model with 64GB of RAM/VRAM (when quantized - quants coming soon), or the whole thing with 1TB. Itâs that scalable.
5. **Not widely supported yet**: Frameworks like vLLM and Transformers arenât compatible with Deca 3 at the moment, so until we drop the DynaMoE software (beta coming soon), itâs mostly just a concept.
Weâre super excited to see what you do with it once the full setupâs ready. Hang tight, and stay tuned!
View all activity
Organizations