inference numbers published for jalapeno, team did an amazing job https://openai.com/index/jalapeno-first-results/
OpenAI: "Today, we shared the first measured performance results from Jalapeño, OpenAI’s first custom inference chip. On InferenceX, a public benchmark using GP...