v0.12.3

What's new in 0.12.3 (2024-06-28)

These are the changes in inference v0.12.3.

New features

• FEAT: [UI] Add favorite function. by @yiboyasss in #1714
• FEAT: add SD3 support by @qinxuye in #1723
• FEAT: [UI] Add the function of automatically obtaining the last configuration information. by @yiboyasss in #1730
• FEAT: support jina-rerank-v2 by @qinxuye in #1733
• FEAT: tensorizer integration by @Zihann73 in #1579
• FEAT: Delete cluster by @hainaweiben in #1719

Enhancements

• ENH: Set the CSG Hub endpoint as an environment variable. by @hainaweiben in #1666
• BLD: pin chatglm-cpp version v0.3.x by @ChengjieLi28 in #1692

Bug fixes

• BUG: [UI] Fix deleting prompt_style when Model Family is other. by @yiboyasss in #1707
• BUG: GGUF models cannot use GPU in docker by @ChengjieLi28 in #1710
• BUG: Fix tool call observation by @codingl2k1 in #1648
• BUG: [UI]fix favorite bug. by @yiboyasss in #1728
• BUG: curl with stream returns unicode chars rather than chinese character by @ChengjieLi28 in #1732
• BUG: Cluster info can be accessed without authorization in the auth mode by @ChengjieLi28 in #1731

Others

• CHORE: upgrade version fix security vulnerability by @rickywu in #1674

New Contributors

• @Zihann73 made their first contribution in #1579
• @rickywu made their first contribution in #1674

Full Changelog: v0.12.2...v0.12.3