Mistral Batch API 2024年11月7日 Mistral AI团队
阅读原文· mistral.aiMistral AI 推出 Mistral Batch API，为开发者提供一种处理大量请求的高效方式，其成本比同步 API 调用降低 50%。用户只需上传批处理文件，待处理完成后下载输出文件即可。该 API 适用于客户反馈分析、文档批量总结与翻译、向量嵌入生成等场景，现已在 La Plateforme 上对所有模型开放，每个工作区并发请求限制为 100 万。
This could've been a tweet, but... While the AI developer community was faced with several API price hikes in the past few weeks, we’re trying to make sure to continue bringing frontier AI to you at affordable price points. To that end, we’re introducing the batch API, available today on La Plateforme .
The batch API introduces a more efficient way to process high-volume requests to Mistral models at 50% lower cost than that of a synchronous API call. If you’re building AI applications where you prioritize volume of data over synchronous responses, the batch API can be an ideal solution. You simply upload your batch file, and once the requests have been processed, download and use the output file. For detailed instructions, check out our batch API documentation .
Popular applications for the batch API include customer feedback and sentiment analysis, document summarization and translation in bulk, vector embedding to prepare search indexes, and data labeling.