[Bug] GPT Sovits service returns error while creating audio

[Ruoyu-y]

Priority

P2-High

OS type

Ubuntu

Hardware type

Xeon-EMR

Installation method

• Pull docker images from hub.docker.com
• Build docker images from source
• Other

Deploy method

• Docker
• Docker Compose
• Kubernetes Helm Charts
• Other

Running nodes

Single Node

What's the version?

Using image version: opea/gpt-sovits:latest

Description

Deploy TTS service with GPT Sovit following the docker compose guide, then test with the same command in the readme file. The output file is a ASCII file instead of WAV file and found errors in both gptsovit container and tts container.

Reproduce steps

Follow the docker compose guide in the TTS readme file

Raw log

Logs in gpt sovits:
gpt-sovits-service  | INFO:     172.18.0.1:36860 - "POST /v1/audio/speech HTTP/1.1" 200 OK
gpt-sovits-service  | ERROR:    Exception in ASGI application
gpt-sovits-service  | Traceback (most recent call last):
gpt-sovits-service  |   File "/usr/local/lib/python3.10/site-packages/starlette/responses.py", line 257, in __call__                                    gpt-sovits-service  |     await wrap(partial(self.listen_for_disconnect, receive))
gpt-sovits-service  |   File "/usr/local/lib/python3.10/site-packages/starlette/responses.py", line 253, in wrap
gpt-sovits-service  |     await func()
gpt-sovits-service  |   File "/usr/local/lib/python3.10/site-packages/starlette/responses.py", line 230, in listen_for_disconnect
gpt-sovits-service  |     message = await receive()
gpt-sovits-service  |   File "/usr/local/lib/python3.10/site-packages/uvicorn/protocols/http/h11_impl.py", line 531, in receive
gpt-sovits-service  |     await self.message_event.wait()
gpt-sovits-service  |   File "/usr/local/lib/python3.10/asyncio/locks.py", line 214, in wait
gpt-sovits-service  |     await fut
gpt-sovits-service  | asyncio.exceptions.CancelledError: Cancelled by cancel scope 75e018154fd0
gpt-sovits-service  |
gpt-sovits-service  | During handling of the above exception, another exception occurred:
gpt-sovits-service  |
gpt-sovits-service  |   + Exception Group Traceback (most recent call last):
gpt-sovits-service  |   |   File "/usr/local/lib/python3.10/site-packages/uvicorn/protocols/http/h11_impl.py", line 403, in run_asgi
gpt-sovits-service  |   |     result = await app(  # type: ignore[func-returns-value]
gpt-sovits-service  |   |   File "/usr/local/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in __call__
gpt-sovits-service  |   |     return await self.app(scope, receive, send)
gpt-sovits-service  |   |   File "/usr/local/lib/python3.10/site-packages/fastapi/applications.py", line 1054, in __call__
gpt-sovits-service  |   |     await super().__call__(scope, receive, send)
gpt-sovits-service  |   |   File "/usr/local/lib/python3.10/site-packages/starlette/applications.py", line 113, in __call__
gpt-sovits-service  |   |     await self.middleware_stack(scope, receive, send)
gpt-sovits-service  |   |   File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 187, in __call__
gpt-sovits-service  |   |     raise exc
gpt-sovits-service  |   |   File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 165, in __call__
gpt-sovits-service  |   |     await self.app(scope, receive, _send)
gpt-sovits-service  |   |   File "/usr/local/lib/python3.10/site-packages/starlette/middleware/cors.py", line 85, in __call__
gpt-sovits-service  |   |     await self.app(scope, receive, send)
gpt-sovits-service  |   |   File "/usr/local/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 62, in __call__
gpt-sovits-service  |   |     await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
gpt-sovits-service  |   |   File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 62, in wrapped_app
gpt-sovits-service  |   |     raise exc
gpt-sovits-service  |   |   File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 51, in wrapped_app
gpt-sovits-service  |   |     await app(scope, receive, sender)
gpt-sovits-service  |   |   File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 74, in app
gpt-sovits-service  |   |     await response(scope, receive, send)
gpt-sovits-service  |   |   File "/usr/local/lib/python3.10/site-packages/starlette/responses.py", line 250, in __call__
gpt-sovits-service  |   |     async with anyio.create_task_group() as task_group:
gpt-sovits-service  |   |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 767, in __aexit__
gpt-sovits-service  |   |     raise BaseExceptionGroup(
gpt-sovits-service  |   | exceptiongroup.ExceptionGroup: unhandled errors in a TaskGroup (1 sub-exception)
gpt-sovits-service  |   +-+---------------- 1 ----------------
gpt-sovits-service  |     | Traceback (most recent call last):
gpt-sovits-service  |     |   File "/usr/local/lib/python3.10/site-packages/starlette/responses.py", line 253, in wrap
gpt-sovits-service  |     |     await func()
gpt-sovits-service  |     |   File "/usr/local/lib/python3.10/site-packages/starlette/responses.py", line 242, in stream_response
gpt-sovits-service  |     |     async for chunk in self.body_iterator:
gpt-sovits-service  |     |   File "/usr/local/lib/python3.10/site-packages/starlette/concurrency.py", line 62, in iterate_in_threadpool
gpt-sovits-service  |     |     yield await anyio.to_thread.run_sync(_next, as_iterator)
gpt-sovits-service  |     |   File "/usr/local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
gpt-sovits-service  |     |     return await get_async_backend().run_sync_in_worker_thread(
gpt-sovits-service  |     |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2461, in run_sync_in_worker_thread
gpt-sovits-service  |     |     return await future
gpt-sovits-service  |     |   File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 962, in run
gpt-sovits-service  |     |     result = context.run(func, *args)
gpt-sovits-service  |     |   File "/usr/local/lib/python3.10/site-packages/starlette/concurrency.py", line 51, in _next
gpt-sovits-service  |     |     return next(iterator)
gpt-sovits-service  |     |   File "/home/user/GPT-SoVITS/api.py", line 561, in get_tts_wav
gpt-sovits-service  |     |     infer_sovits = speaker_list[spk].sovits
gpt-sovits-service  |     | KeyError: 'default'
gpt-sovits-service  |     +------------------------------------

Logs in tts container:
tts-gptsovits-service  | INFO:     172.18.0.1:44548 - "POST /v1/audio/speech HTTP/1.1" 500 Internal Server Error
tts-gptsovits-service  | ERROR:    Exception in ASGI application
tts-gptsovits-service  | Traceback (most recent call last):
tts-gptsovits-service  |   File "/usr/local/lib/python3.11/site-packages/requests/models.py", line 820, in generate
tts-gptsovits-service  |     yield from self.raw.stream(chunk_size, decode_content=True)
tts-gptsovits-service  |   File "/usr/local/lib/python3.11/site-packages/urllib3/response.py", line 1063, in stream
tts-gptsovits-service  |     yield from self.read_chunked(amt, decode_content=decode_content)
tts-gptsovits-service  |   File "/usr/local/lib/python3.11/site-packages/urllib3/response.py", line 1219, in read_chunked
tts-gptsovits-service  |     self._update_chunk_length()
tts-gptsovits-service  |   File "/usr/local/lib/python3.11/site-packages/urllib3/response.py", line 1149, in _update_chunk_length
tts-gptsovits-service  |     raise ProtocolError("Response ended prematurely") from None
tts-gptsovits-service  | urllib3.exceptions.ProtocolError: Response ended prematurely
tts-gptsovits-service  |
tts-gptsovits-service  | During handling of the above exception, another exception occurred:
tts-gptsovits-service  |
tts-gptsovits-service  | Traceback (most recent call last):
tts-gptsovits-service  |   File "/usr/local/lib/python3.11/site-packages/uvicorn/protocols/http/h11_impl.py", line 403, in run_asgi
tts-gptsovits-service  |     result = await app(  # type: ignore[func-returns-value]
tts-gptsovits-service  |              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
tts-gptsovits-service  |   File "/usr/local/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in __call__
tts-gptsovits-service  |     return await self.app(scope, receive, send)
tts-gptsovits-service  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
tts-gptsovits-service  |   File "/usr/local/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in __call__
tts-gptsovits-service  |     await super().__call__(scope, receive, send)
tts-gptsovits-service  |   File "/usr/local/lib/python3.11/site-packages/starlette/applications.py", line 112, in __call__
tts-gptsovits-service  |     await self.middleware_stack(scope, receive, send)
tts-gptsovits-service  |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 187, in __call__
tts-gptsovits-service  |     raise exc
tts-gptsovits-service  |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 165, in __call__
tts-gptsovits-service  |     await self.app(scope, receive, _send)
tts-gptsovits-service  |   File "/usr/local/lib/python3.11/site-packages/prometheus_fastapi_instrumentator/middleware.py", line 174, in __call__
tts-gptsovits-service  |     raise exc
tts-gptsovits-service  |   File "/usr/local/lib/python3.11/site-packages/prometheus_fastapi_instrumentator/middleware.py", line 172, in __call__
tts-gptsovits-service  |     await self.app(scope, receive, send_wrapper)
tts-gptsovits-service  |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/cors.py", line 85, in __call__
tts-gptsovits-service  |     await self.app(scope, receive, send)
tts-gptsovits-service  |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 62, in __call__
tts-gptsovits-service  |     await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
tts-gptsovits-service  |   File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
tts-gptsovits-service  |     raise exc
tts-gptsovits-service  |   File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
tts-gptsovits-service  |     await app(scope, receive, sender)
tts-gptsovits-service  |   File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 715, in __call__
tts-gptsovits-service  |     await self.middleware_stack(scope, receive, send)
tts-gptsovits-service  |   File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 735, in app
tts-gptsovits-service  |     await route.handle(scope, receive, send)
tts-gptsovits-service  |   File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 288, in handle
tts-gptsovits-service  |     await self.app(scope, receive, send)
tts-gptsovits-service  |   File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 76, in app
tts-gptsovits-service  |     await wrap_app_handling_exceptions(app, request)(scope, receive, send)
tts-gptsovits-service  |   File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
tts-gptsovits-service  |     raise exc
tts-gptsovits-service  |   File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
tts-gptsovits-service  |     await app(scope, receive, sender)
tts-gptsovits-service  |   File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 73, in app
tts-gptsovits-service  |     response = await f(request)
tts-gptsovits-service  |                ^^^^^^^^^^^^^^^^
tts-gptsovits-service  |   File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 301, in app
tts-gptsovits-service  |     raw_response = await run_endpoint_function(
tts-gptsovits-service  |                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
tts-gptsovits-service  |   File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 212, in run_endpoint_function
tts-gptsovits-service  |     return await dependant.call(**values)
tts-gptsovits-service  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
tts-gptsovits-service  |   File "/home/user/comps/tts/src/opea_tts_microservice.py", line 54, in text_to_speech
tts-gptsovits-service  |     tts_response = await loader.invoke(request)
tts-gptsovits-service  |                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
tts-gptsovits-service  |   File "/home/user/comps/cores/common/component.py", line 163, in invoke
tts-gptsovits-service  |     return await self.component.invoke(*args, **kwargs)
tts-gptsovits-service  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
tts-gptsovits-service  |   File "/home/user/comps/tts/src/integrations/gptsovits.py", line 41, in invoke
tts-gptsovits-service  |     response = await asyncio.to_thread(
tts-gptsovits-service  |                ^^^^^^^^^^^^^^^^^^^^^^^^
tts-gptsovits-service  |   File "/usr/local/lib/python3.11/asyncio/threads.py", line 25, in to_thread
tts-gptsovits-service  |     return await loop.run_in_executor(None, func_call)
tts-gptsovits-service  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
tts-gptsovits-service  |   File "/usr/local/lib/python3.11/concurrent/futures/thread.py", line 58, in run
tts-gptsovits-service  |     result = self.fn(*self.args, **self.kwargs)
tts-gptsovits-service  |              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
tts-gptsovits-service  |   File "/usr/local/lib/python3.11/site-packages/requests/api.py", line 115, in post
tts-gptsovits-service  |     return request("post", url, data=data, json=json, **kwargs)
tts-gptsovits-service  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
tts-gptsovits-service  |   File "/usr/local/lib/python3.11/site-packages/requests/api.py", line 59, in request
tts-gptsovits-service  |     return session.request(method=method, url=url, **kwargs)
tts-gptsovits-service  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
tts-gptsovits-service  |   File "/usr/local/lib/python3.11/site-packages/requests/sessions.py", line 589, in request
tts-gptsovits-service  |     resp = self.send(prep, **send_kwargs)
tts-gptsovits-service  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
tts-gptsovits-service  |   File "/usr/local/lib/python3.11/site-packages/requests/sessions.py", line 746, in send
tts-gptsovits-service  |     r.content
tts-gptsovits-service  |   File "/usr/local/lib/python3.11/site-packages/requests/models.py", line 902, in content
tts-gptsovits-service  |     self._content = b"".join(self.iter_content(CONTENT_CHUNK_SIZE)) or b""
tts-gptsovits-service  |                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
tts-gptsovits-service  |   File "/usr/local/lib/python3.11/site-packages/requests/models.py", line 822, in generate
tts-gptsovits-service  |     raise ChunkedEncodingError(e)
tts-gptsovits-service  | requests.exceptions.ChunkedEncodingError: Response ended prematurely

Attachments

No response