Transformers
An open-source deep learning model library developed by Hugging Face that provides interfaces for loading, fine-tuning, and running inference on pre-trained models. It is one of the most widely adopted toolkits in the natural language processing field.
Core Facts
Hugging Face's Transformers library supports three major frameworks: PyTorch, TensorFlow, and JAX.
The Transformers library is maintained by Hugging Face and provides a unified interface for thousands of pre-trained models
Hugging Face is an AI company founded in 2016, whose open-source library Transformers has become the de facto standard toolkit in the NLP and large model domains.
Timeline (last 90 days)
The model is now available on Hugging Face, and the blog provides access methods via Transformers, llama.cpp, vLLM, SGLang, as well as Mistral's own platform and its coding agent Le Vibe.
The Messages/Chat Completions interfaces of vendors such as Anthropic and OpenAI all support prefilling parameters, and local inference frameworks (vLLM, llama.cpp, Transformers) can also implement prefilling by directly concatenating token sequences.
As of October 18, officially supported llama.cpp, vLLM and Transformers have not merged support for Dory, or it is missing.
The Transformer library's Pipeline is a high-level interface that wraps preprocessing, model inference, and postprocessing, and its internal default parameters may change between versions.
According to the Transformers bitsandbytes documentation, quantized linear layers and other modules are handled separately, and weight storage and compute dtype are two different things.
Step 5 Preview officially states support for the three mainstream inference frameworks vLLM, SGLang and Transformers.
The original Qwen3.8-Flash-Next weights support vLLM, SGLang, Transformers and TokenSpeed, and SGLang had day-0 support on the day of release.
Omni uses Transformers 5.10.2 in a separate image and loads with CPU priority.
Muse Spark Open supports runtimes including SGLang, vLLM, TensorRT-LLM, Transformers, MLX, llama.cpp and Unsloth.
InclusionAI's Ling 3.0 Flash adopts a hybrid MoE design, in which the decoder groups five Kimi Delta Attention (KDA) layers with one Multi-head Latent Attention (MLA) layer, and is natively supported in Transformers with the loading class BailingHybridForCausalLM.
40 more timeline events
All Facts (20)
Hugging Face's Transformers library supports three major frameworks: PyTorch, TensorFlow, and JAX.
90%VerifiedThe Transformers library is maintained by Hugging Face and provides a unified interface for thousands of pre-trained models
80%VerifiedHugging Face is an AI company founded in 2016, whose open-source library Transformers has become the de facto standard toolkit in the NLP and large model domains.
80%VerifiedvLLM relies on Hugging Face's transformers library to load model architectures, tokenizers, and configurations.
75%VerifiedHuggingFace Transformers' Pipeline supports task types including sentiment analysis, text generation, named entity recognition, fill-mask, summarization, translation, and feature extraction.
65%VerifiedThe Pipeline API breaks NLP tasks down into three independent stages: preprocessing, model inference, and post-processing.
65%VerifiedThe storage path for HuggingFace models can be customized by setting the environment variable HF_HOME.
65%UnverifiedThe mainstream AI inference stack (PyTorch, Transformers, vLLM) is built on Python and relies on extensive Python code and complex dependency chains
90%UnverifiedTransformers库默认将模型下载到C盘用户目录/.cache/huggingface下
90%UnverifiedHugging Face的Transformers库、OpenAI的官方SDK、LangChain等几乎所有主流大模型工具都优先支持Python
90%UnverifiedHugging Face's Transformers library provides a unified API interface for tens of thousands of pre-trained models, supporting the three major frameworks PyTorch, TensorFlow, and JAX.
70%UnverifiedHugging Face Hub is deeply integrated with mainstream open-source libraries such as Transformers, Diffusers, and PEFT, allowing users to load any model with just a single line of code.
70%UnverifiedMuse Spark Open supports runtimes including SGLang, vLLM, TensorRT-LLM, Transformers, MLX, llama.cpp and Unsloth.
60%UnverifiedThe Messages/Chat Completions interfaces of vendors such as Anthropic and OpenAI all support prefilling parameters, and local inference frameworks (vLLM, llama.cpp, Transformers) can also implement prefilling by directly concatenating token sequences.
50%UnverifiedAs of October 18, officially supported llama.cpp, vLLM and Transformers have not merged support for Dory, or it is missing.
50%UnverifiedThe Transformer library's Pipeline is a high-level interface that wraps preprocessing, model inference, and postprocessing, and its internal default parameters may change between versions.
50%UnverifiedAccording to the Transformers bitsandbytes documentation, quantized linear layers and other modules are handled separately, and weight storage and compute dtype are two different things.
50%UnverifiedStep 5 Preview officially states support for the three mainstream inference frameworks vLLM, SGLang and Transformers.
50%UnverifiedThe original Qwen3.8-Flash-Next weights support vLLM, SGLang, Transformers and TokenSpeed, and SGLang had day-0 support on the day of release.
50%UnverifiedOmni uses Transformers 5.10.2 in a separate image and loads with CPU priority.
50%