Need help upgrading Websocket

[UgoEkwe]

Okay so I'm not sure if the issue I'm seeing is due to an error in the audio conversion or if I made a mistake in the request url, but I'm getting an HTTP/1.1 400 Bad request file sent back from the Websocket instead of JSON. I initially took the microphone input as PCM and converted it to NSData but that gave me a 1011 error, so now I'm converting to wav instead and still getting an error. It will successfully connect but then receive a bad request. Have tried a lot of different urls in the header. I've looked everywhere but can't find many Deepgram discussions in Swift. Any help is seriously appreciated.

Here are my recording and conversion functions:

func startRecording() {
        
        if !isWebSocketStarted {
            connectWebSocket(startWebSocket: true)
        }
        
        let inputNode = audioEngine.inputNode
        let inputFormat = inputNode.inputFormat(forBus: 0)
        let monoInputFormat = AVAudioFormat(commonFormat: inputFormat.commonFormat, sampleRate: inputFormat.sampleRate, channels: 1, interleaved: inputFormat.isInterleaved)
        let outputFormat = AVAudioFormat(commonFormat: .pcmFormatInt16, sampleRate: 44100, channels: 1, interleaved: true)
        
        let audioConverter = AVAudioConverter(from: monoInputFormat!, to: outputFormat!)
        var error: NSError?
        
        inputNode.installTap(onBus: 0, bufferSize: 1024, format: monoInputFormat) { [self] (buffer: AVAudioPCMBuffer!, time: AVAudioTime!) -> Void in
            let outputBuffer = AVAudioPCMBuffer(pcmFormat: outputFormat!, frameCapacity: buffer.frameCapacity)
            
            audioConverter?.convert(to: outputBuffer!, error: &error, withInputFrom: { (numPackets, outStatus) -> AVAudioBuffer? in
                outStatus.pointee = AVAudioConverterInputStatus.haveData
                return buffer
            })
            
            if let outputData = toWAVData(buffer: outputBuffer!) {
                self.sendWebSocketData(outputData)
            } else {
                print("Error converting buffer to WAV audio data")
            }
        }
        
        audioEngine.prepare()
        
        do {
            try AVAudioSession.sharedInstance().setCategory(.record)
            try audioEngine.start()
        } catch {
            print(error)
        }
    }

    func toWAVData(buffer: AVAudioPCMBuffer) -> Data? {
        let audioBuffer = buffer.audioBufferList.pointee.mBuffers
        let rawData = Data(bytes: audioBuffer.mData!, count: Int(audioBuffer.mDataByteSize))
        
        let sampleRate = Int(buffer.format.sampleRate)
        let channels = Int(buffer.format.channelCount)
        let bitDepth = 16
        let totalFrames = Int(buffer.frameLength)
        
        var wavData = Data()
        writeWAVHeader(data: &wavData, sampleRate: sampleRate, channels: channels, bitDepth: bitDepth, totalFrames: totalFrames)
        wavData.append(rawData)
        
        return wavData
    }

This is how I'm connecting to the Websocket:

private func connectWebSocket(startWebSocket: Bool = true) {
        guard startWebSocket else { return }

        let url = URL(string: "wss://api.deepgram.com/v1/listen?encoding=linear16&sample_rate=44100&channels=1")!
        let connection = NWConnection(host: NWEndpoint.Host(url.host!), port: NWEndpoint.Port(integerLiteral: 443), using: .tls)
        connection.stateUpdateHandler = { [weak self] newState in
            switch newState {
            case .ready:
                print("WebSocket successfully connected")
                self?.isWebSocketStarted = true
                self?.receiveWebSocketData()
            case .failed(let error):
                print("WebSocket connection failed: \(error.localizedDescription)")
                self?.isWebSocketStarted = false
            default:
                break
            }
        }
        
        let options = NWProtocolWebSocket.Options()
        options.autoReplyPing = true
        options.setAdditionalHeaders([("Authorization", apiKey)])
        
        let parameters = NWParameters(tls: .init(), tcp: .init())
            parameters.defaultProtocolStack.applicationProtocols.insert(options, at: 0)
        
        webSocketConnection = connection
        connection.start(queue: .global())
    }

And this is how I'm sending the data to the Websocket:

private func sendWebSocketData(_ data: Data) {
        
        ///MARK
        print("Sending data to WebSocket:")
        print("URL: \(String(describing: webSocketConnection?.endpoint))")
        print("Data: \(data as NSData)")
        
        
        webSocketConnection?.send(content: data, completion: .contentProcessed { error in
            if let error = error {
                print("WebSocket sending error: \(error.localizedDescription)")
            }
        })
    }

[nickottocode]

Hi @UgoEkwe!
I am pretty unfamiliar with Swift, but I do want to check on a couple of things:

I'm getting an HTTP/1.1 400 Bad request file sent back from the Websocket instead of JSON

I take this to mean the connection never makes the upgrade to websockets? Two things to check are:

• In your authorization header code I see options.setAdditionalHeaders([("Authorization", apiKey)]) Perhaps Swift does something I don't know about, but we do require the header to be "Authorization: Token $apiKey" (the word "Token" must appear as well).
• The url path looks good, but I don't see where the full URL with the path is passed in? In the connection code there is host: NWEndpoint.Host(url.host!), but I don't see a place where the path is given to the connecting code.

I hope that gives us some direction here! I will also point out that if streaming containerized audio, the header should only be sent once at the beginning of the stream, rather than effectively creating a new WAV file each time (I can't quite tell if your code is doing that, but just in case!). Ideally one of the suggestions above will work out and you can stream the raw data as you originally intended!

[UgoEkwe]

It was the first suggestion! Seriously tried everything and of course all I had to do was add "token" to get it to work lol. Thanks!