据OpenAI内部人士透露,行业数据处理规模远超想象,有团队成员每日消耗高达570亿token。为此,Databricks AI团队正积极招募顶尖的推理工程师,以应对每日数万亿token的生成任务。团队提供无限token资源,寻求在SGLang、vLLM、PyTorch等开源系统有贡献,或拥有大规模LLM服务经验的人才。该团队以创业公司模式运作,致力于构建高性能的AI系统。
A few OpenAI folks told me:
"300M tokens/day is a rookie number."
The biggest number I'm hearing now is 57B tokens/day! Sorry friends, I wasn't familiar with your game.
If you're good at making GPUs go brrr (aka inference), DM me. Databricks AI has unlimited tokens for you!
(not limited to SGLang/vLLM contributors. If you've built stellar AI systems, reply or message me.)