建议增加xgrammar结构化输出支持

[ZanePoe]

Feature request / 功能建议

如题

Motivation / 动机

已知贵团队已经在做outlines结构化输出支持，但最新的国内团队的xgrammar技术相比于outlines有明显的优势，并且sglang这种高速推理引擎已经得到支持，并且vllm团队也积极响应准备支持xgrammar。

xgrammar相比于outlines优势很是挺明显的：

Your contribution / 您的贡献

https://github.com/mlc-ai/xgrammar

[qinxuye]

@wxiwnd 可以看看，在 outlines 之后可以支持这个。

[wxiwnd]

好的。如果 vllm 后续支持的话，大概只需要改一下 backend 为 xgrammar 应该就行了。
其他的 engine 应该需要单独适配

[ZanePoe]

同时结构化输出希望能够兼容openai，希望openai接口能支持response_format参数进行json结构化输出。vllm / sglang 原生openai接口均已支持该参数

[qinxuye]

#2636 有反馈用 openai 接口会有问题。

[github-actions]

This issue is stale because it has been open for 7 days with no activity.

[qinxuye]

@Jun-Howie guided json is introduced in #2391 , and openai-compatible in #2673 .

It should not be hard to introduce xgrammar as backend for vllm.

[github-actions]

This issue is stale because it has been open for 7 days with no activity.

[github-actions]

This issue was closed because it has been inactive for 5 days since being marked as stale.

[github-actions]

This issue is stale because it has been open for 7 days with no activity.

[github-actions]

This issue is stale because it has been open for 7 days with no activity.

[github-actions]

This issue is stale because it has been open for 7 days with no activity.