Using Duet AI for LLM based Acceleration in GCP

Sign up for Duet AI access

• https://cloud.google.com/earlyaccess/duet-ai/join?hl=en

It’s official—you’re in the Duet AI In Google Cloud Preview.

Once you’re ready to get started, please follow the instructions in the documentation [here] to get started using Duet AI in Google Cloud.

Enable Cloud AI Companion API

https://cloud.google.com/duet-ai/docs/discover/set-up-duet-ai#enable-cloud-ai-companion-api

Fixing https://console.cloud.google.com/support/cases/detail/v2/46919421?project=duet-ai-old&supportedpurview=project

michael@cloudshell:~ (duet-ai-old)$ gcloud services enable cloudaicompanion.googleapis.com
ERROR: (gcloud.services.enable) PERMISSION_DENIED: Permission denied to enable service [cloudaicompanion.googleapis.com]
Help Token: AVzH8v0tE5xnAjZra7DvxFbsXsBQScXE7r070bsRIQzGvcVcgDV0ULvMQ81VqyWZeOXBMN5T2rW36_uaUxw1cClHq3yTfDl0c0GFCJgISd28zyoo
- '@type': type.googleapis.com/google.rpc.PreconditionFailure
  violations:
  - subject: ?error_code=110002&service=servicemanagement.googleapis.com&permission=servicemanagement.services.bind&resource=duet-ai-old
    type: googleapis.com
- '@type': type.googleapis.com/google.rpc.ErrorInfo
  domain: serviceusage.googleapis.com
  metadata:
    permission: servicemanagement.services.bind
    resource: duet-ai-old
    service: servicemanagement.googleapis.com
  reason: AUTH_PERMISSION_DENIED

References

• https://cloud.google.com/duet-ai/docs/discover/set-up-duet-ai