GGML 和 llama.cpp 加入 HF 以确保 Local AI 的长期进展
阅读原文· huggingface.co本地推理核心引擎获得长期资源保障，端侧 AI 生态稳定性大幅提升
GGML 和 llama.cpp 团队正式加入 Hugging Face，以支持本地 AI 社区的长期扩展。创始人 Georgi Gerganov 及团队将全职维护 llama.cpp，保持 100% 技术自主权和社区领导力，项目继续 100% 开源和社区驱动。Hugging Face 提供长期可持续资源，助力项目增长。技术上将优化 transformers 库与 llama.cpp 的无缝集成，实现近乎“一键式”的模型部署，并改进基于 GGML 的软件打包和用户体验。长期愿景是构建高效本地推理堆栈，推动开源超级智能的普及。
GGML and llama.cpp join HF to ensure the long-term progress of Local AI
Georgi Gerganov and team are joining HF with the goal of scaling and supporting the community behind ggml and llama.cpp as Local AI continues to make exponential progress in the coming years.
We've been working with Georgi and team for quite some time (we even have awesome core contributors to llama.cpp like Son and Alek in the team already) so this has been a very natural process.
llama.cpp is the fundamental building block for local inference, and transformers is the fundamental building block for model definition, so this is basically a match made in heaven. ❤️
What will change for llama.cpp, the open source project and the community?
Not much – Georgi and team still dedicate 100% of their time maintaining llama.cpp and have full autonomy and leadership on the technical directions and the community. HF is providing the project with long-term sustainable resources, improving the chances of the project to grow and thrive. The project will continue to be 100% open-source and community driven as it is now.
Technical focus
llama.cpp is the fundamental building block for local inference, and transformers is the fundamental building block for definition of models and architectures, so we’ll work on making sure it’s as seamless as possible in the future (almost “single-click”) to ship new models in llama.cpp from the transformers library ‘source of truth’ for model definitions.
Additionally, we will improve packaging and user experience of ggml-based software. As we enter the phase in which local inference becomes a meaningful and competitive alternative to cloud inference, it is crucial to improve and simplify the way in which casual users deploy and access local models. We will work towards making llama.cpp ubiquitous and readily available everywhere.
Our long term vision
Our shared goal is to provide the community with the building blocks to make open-source superintelligence accessible to the world over the coming years.
We will achieve this together with the growing Local AI community, as we continue to build the ultimate inference stack that runs as efficiently as possible on our devices.
Community
Big congrats to GGML and Hugging Face! Great news for the Local AI community. Excited to see llama.cpp grow stronger and make local AI easier for everyone!
Congrats to both teams. Well deserved. Wonderful news for wonderful teams and community.
This is a match made in heaven for the local AI ecosystem. Transformers as the model definition layer plus llama.cpp as the local inference layer, backed by HF's long-term resources, gives the entire community a stable foundation to build on for years to come.
The focus on packaging and user experience is especially important. Making local inference accessible beyond developers is how we get to an AI future that's open, private, and user-owned — not locked behind API calls.
Congratulations to Georgi and team. Open-source superintelligence that runs on your own hardware isn't just a technical goal, it's a trust model.
So basically HF, "acquires" an open source project. hmm. I've seen this before and it never ends well (see Trixbox, PCBSD, FreeNAS, etc..).
I sure hope history doesn't repeat itself (yet it always does).
It’s great news for the future of edge AI!
"...it is crucial to improve and simplify the way in which casual users deploy and access local models. We will work towards making llama.cpp ubiquitous and readily available everywhere." (It... already was?)
Before you upvote. Raise your hand if you realize that hf.co is a business with the necessary end goal of making money. This isn't a bad thing; however, this blog post is so devoid of substance and so full of hypebole that one can't help but wonder.
I cant wait till hf adds a quota/limitation on amount of models you can quantize with future versions of llama.cpp requiring hf login /token to quantize a model (trust me bro its just basic telemetry) 😻
of course, when the noose tightens further it won't be officially discussed/acknowledged (why would we?? we have so much to share with sell to the #community like this robot! look its so cute)
Maybe lcpp will now natively support image models quanting? yay
This is awesome news! Making llama.cpp and the GGML ecosystem more sustainable and widely supported will help local AI become more accessible and easier to use for everyone for sure.
reasoning:
min_steps: 2 # Minimum reasoning steps before code
require_action_field: true # Each step must have thought + action = freedom
confidence_calibration: true # Post-process confidence scores ciritcally high!
Congrads!
A great milestone for Local AI!
For those already living daily in the ggml and llama.cpp ecosystem, this is a strong signal for what’s ahead.
The alignment with Transformers brings clear strategic coherence.
A solid move. Looking forward to what comes next.
Congratulations to all involved! These are great additions!
· or to comment