Getting higher latency (TTFB) even after hosting self-hosted deepgram STT model

[Ujjwal-Squadstack]

We're experiencing a 1.38s p80 latency (TTFB) with our self-hosted Deepgram setup for Speech-to-Text via WebSocket streaming. Below are the configurations we're using:

interim_results: True
endpointing: 300ms
model: nova-2-general
language: hi
punctuate: False
profanity_filter: True
smart_format: True
diarize: False

TTFB:- The time from when speech starts to when we receive the transcript.

Can someone please help here?

[deepgram-community[bot]]

Thanks for asking your question. Please be sure to reply with as much detail as possible so the community can assist you efficiently.
_{Consider joining our Discord community for more opportunity to engage with your fellow Deepgram users. You can earn points which can be redeemed for cool stuff by being active in our communities!}

[deepgram-community[bot]]

Hey there! It looks like you haven't connected your GitHub account to your Deepgram account. You can do this at https://community.deepgram.com - being verified through this process will allow our team to help you in a much more streamlined fashion.

[deepgram-community[bot]]

It looks like we're missing some important information to help debug your issue. Would you mind providing us with the following details in a reply?

• The programming language you are working in (e.g. JavaScript, Python).
• A request ID that triggered your error or issue.

[deepgram-community[bot]]

When you say self-hosted Deepgram, do you mean you have a license agreement for running Deepgram on your own infrastructure? If that is the case, you should have direct contact an account manager who can arrange for support

This message was sent by luke from Deepgram, via our community automation.