Multilingual Code-Switching cannot recognize zh/chinese

[JinVei]

It seems like the Multilingual Code-Switching cannot recognize Chinese (zh).

I used the curl command below to recognize Chinese in multi-language mode, but the transcript in the curl response is empty.

The content of the uploaded file is pure Chinese audio.

curl \
  --request POST \
  --header 'Authorization: Token xxxx' \
  --header 'Content-Type: audio/mpeg' \
  --data-binary @voice_content.mp3 \
  --url 'https://api.deepgram.com/v1/listen?language=multi&model=nova-2'

response

{"metadata":{"transaction_key":"deprecated","request_id":"697096ce-dae2-4031-b43f-971be6e6e7f8","sha256":"7e9cac1f7eb912a613ad837189cf284198486bb4760ba2996ee9d454af113330","created":"2024-08-01T09:42:44.915Z","duration":6.8399377,"channels":1,"models":["dc8a3fe5-a395-4b75-a8b1-71c9a5a87526"],"model_info":{"dc8a3fe5-a395-4b75-a8b1-71c9a5a87526":{"name":"2-general-nova","version":"1999-06-13.21385","arch":"nova-2"}}},"results":{"channels":[{"alternatives":[{"transcript":"","confidence":0.0,"words":[]}]}]}}

However, when I set the query parameter 'language' to 'zh', it works correctly.

curl \
  --request POST \
  --header 'Authorization: Token xxxx' \
  --header 'Content-Type: audio/mpeg' \
  --data-binary @voice_content.mp3 \
  --url 'https://api.deepgram.com/v1/listen?language=zh&model=nova-2'

response

{"metadata":{"transaction_key":"deprecated","request_id":"9bf17771-1e30-4679-9c77-b383d5ebd43c","sha256":"7e9cac1f7eb912a613ad837189cf284198486bb4760ba2996ee9d454af113330","created":"2024-08-01T09:55:17.266Z","duration":6.8399377,"channels":1,"models":["90aed297-6e9b-44d3-b230-7cba901c8b7a"],"model_info":{"90aed297-6e9b-44d3-b230-7cba901c8b7a":{"name":"2-general-nova","version":"2024-05-10.30049","arch":"nova-2"}}},"results":{"channels":[{"alternatives":[{"transcript":"大家好我是小何老师很高兴跟大家在这裏见面同时欢迎大家成为人工智能学习的先行者","confidence":1.0,"words":[{"word":"大","start":0.08,"end":0.16,"confidence":0.99902344},{"word":"家","start":0.24,"end":0.39999998,"confidence":1.0},{"word":"好","start":0.42,"end":0.44,"confidence":1.0},{"word":"我","start":0.71999997,"end":0.79999995,"confidence":1.0},{"word":"是","start":0.88,"end":0.96,"confidence":1.0},{"word":"小","start":1.04,"end":1.12,"confidence":1.0},{"word":"何","start":1.1999999,"end":1.28,"confidence":0.7133789},{"word":"老","start":1.36,"end":1.4399999,"confidence":1.0},{"word":"师","start":1.52,"end":1.68,"confidence":1.0},{"word":"很","start":1.76,"end":1.8399999,"confidence":1.0},{"word":"高","start":1.92,"end":2.08,"confidence":1.0},{"word":"兴","start":2.1599998,"end":2.24,"confidence":1.0},{"word":"跟","start":2.32,"end":2.4,"confidence":0.9951172},{"word":"大","start":2.48,"end":2.52,"confidence":1.0},{"word":"家","start":2.56,"end":2.6399999,"confidence":1.0},{"word":"在","start":2.72,"end":2.8799999,"confidence":1.0},{"word":"这","start":2.96,"end":3.0,"confidence":1.0},{"word":"裏","start":3.04,"end":3.12,"confidence":0.76708984},{"word":"见","start":3.1999998,"end":3.2799997,"confidence":0.99902344},{"word":"面","start":3.36,"end":3.52,"confidence":1.0},{"word":"同","start":3.6,"end":3.6799998,"confidence":0.9980469},{"word":"时","start":3.76,"end":3.9199998,"confidence":1.0},{"word":"欢","start":4.0,"end":4.04,"confidence":0.9941406},{"word":"迎","start":4.08,"end":4.16,"confidence":1.0},{"word":"大","start":4.24,"end":4.3199997,"confidence":1.0},{"word":"家","start":4.4,"end":4.44,"confidence":1.0},{"word":"成","start":4.48,"end":4.56,"confidence":0.99902344},{"word":"为","start":4.64,"end":4.7999997,"confidence":0.9902344},{"word":"人","start":4.88,"end":4.92,"confidence":0.9980469},{"word":"工","start":4.96,"end":5.04,"confidence":1.0},{"word":"智","start":5.12,"end":5.2799997,"confidence":1.0},{"word":"能","start":5.3599997,"end":5.4399996,"confidence":0.9770508},{"word":"学","start":5.52,"end":5.6,"confidence":0.9970703},{"word":"习","start":5.68,"end":5.7599998,"confidence":1.0},{"word":"的","start":5.8399997,"end":5.88,"confidence":0.99902344},{"word":"先","start":5.92,"end":6.04,"confidence":1.0},{"word":"行","start":6.16,"end":6.3999996,"confidence":1.0},{"word":"者","start":6.6199684,"end":6.8399377,"confidence":1.0}]}]}]}}

Does the multi-language mode support Chinese (zh)? Or is there something wrong with my approach?

[team-deepgram]

Thanks for asking your question about Deepgram! If you didn't already include it in your post, please be sure to add as much detail as possible so we can assist you efficiently, such as:

• The request_id if you have a question about your requests or transcription responses.
• The features you used or the full api.deepgram.com URL you sent your request to, including parameters.
• Any code snippets you can share.

[jpvajda]

@JinVei Currently our Multi-lingual feature only supports English and Spanish You can see that on the Docs Page, look for the en & es label at the top of the page. We plan to offer additional languages in the near future, so just keep an eye for an upcoming release announcement from us.

https://developers.deepgram.com/docs/multilingual-code-switching