Fast Compute Grants
We're on a mission to accelerate open and decentralized AI progress by enabling anyone to contribute compute, capital or code to collaboratively train powerful open models. Our ultimate goal? Openly accessible AGI that benefits everyone. But we can't do it alone and we want to do this together with you.
That's why we're launching Fast Compute Grants to support ambitious research into novel models, architectures, techniques, and paradigms needed to make open and decentralized AGI a reality.
A few ideas of what we’d be excited about
- Decentralized Llama-3 MoE Sparse upcycling via DiPaCo
- Scientific foundation models with new architectures ala HyenaDNA
- scGPT as a Llama-3 fine-tune (S/O to Felix)
- Distributed training across a heterogenous swarm of consumer devices (S/O to Omkaar)
- 13B parameter BitNet + infini-Attention + DenseFormer + MoD + In Context-Pretraining + 2 stage pretraining (S/O to Wing)
- Upcycle w c-BTX to an 8 expert sparse MoE + MoA (S/O to Wing)
- Coding agent models
- Novel applied super-alignment research
- Efficient long-context context window extension
- Exploring new Transformer and alternative architectures
If you're working on something in this vein that could use a boost from free GPUs, we want to hear from you. We'll provide:
- $500-$100k worth of Prime Intellect compute credits.
- Exposure to our ecosystem of AI hackers and distributed computing experts
- Promotion of your work to our community and partners
You can apply via this form, and we’ll get back to you in 5-10 days.
- What you're working on and why it's important
- How much compute you need and what you'd do with it
- Who you are and any past work we should know about
- Any code/papers/demos/other material that'll get us excited
The bar for quality is high but there are no other hoops. Anyone from anywhere can apply. Just email your pitch to contact@primeintellect.ai. We'll get back to you within 2 weeks if it seems like a good fit.
Our goal is to get a critical mass of brilliant people pointed at the hardest problems in open and decentralized AI and equip them to make rapid progress.
The future won't build itself - let's get to work.
%20(1).png)
