response_format
An option in OpenAI-compatible interfaces that constrains the model's output format; when enabled, it returns a valid JSON string, and it is often used together with JSON Schema to ensure the output is parseable.
Timeline (last 90 days)
In LangChain, structured output binds the type through the Agent's response_format attribute, rather than using the with_structured_output method.
Mistral also supports response_format, but only the json_object type, and does not enforce the schema.
OpenAI-compatible interfaces usually cover only the core fields, and implementations of extended capabilities such as tools, response_format, and streaming events are not fully consistent across vendors; when encountering unsupported features, they may return a parameter error or silently ignore it.
All Facts (3)
In LangChain, structured output binds the type through the Agent's response_format attribute, rather than using the with_structured_output method.
50%UnverifiedMistral also supports response_format, but only the json_object type, and does not enforce the schema.
50%UnverifiedOpenAI-compatible interfaces usually cover only the core fields, and implementations of extended capabilities such as tools, response_format, and streaming events are not fully consistent across vendors; when encountering unsupported features, they may return a parameter error or silently ignore it.
50%