Using Duet AI for LLM based Acceleration in GCP

Sign up for Duet AI for Workspace Enterprise

• Duet AI is available for Business Standard and above
• Workspace Enterprise plus is $39/month
• Duet AI for Google Workspace Enterprise is also $39/month
• Duet AI is powered by PALM 2 - see https://blog.google/technology/ai/google-palm-2-ai-large-language-model/

Assign licenses

Review Documentation

• https://apps.google.com/supportwidget/articlehome?hl=en&article_url=https%3A%2F%2Fsupport.google.com%2Fa%2Fanswer%2F13623623%3Fhl%3Den&assistant_id=generic-unu&product_context=13623623&product_name=UnuFlow&trigger_context=a
• https://support.google.com/docs/answer/13951829?visit_id=638309968615425192-3408007188&p=duet-help-me-visualize&rd=1

Sign up for Duet AI access

• https://cloud.google.com/earlyaccess/duet-ai/join?hl=en

It’s official—you’re in the Duet AI In Google Cloud Preview.

Once you’re ready to get started, please follow the instructions in the documentation [here] to get started using Duet AI in Google Cloud.

Enable Cloud AI Companion API

https://cloud.google.com/duet-ai/docs/discover/set-up-duet-ai#enable-cloud-ai-companion-api

Fixing https://console.cloud.google.com/support/cases/detail/v2/46919421?project=duet-ai-old&supportedpurview=project

michael@cloudshell:~ (duet-ai-old)$ gcloud services enable cloudaicompanion.googleapis.com
ERROR: (gcloud.services.enable) PERMISSION_DENIED: Permission denied to enable service [cloudaicompanion.googleapis.com]
Help Token: AVzH8v0tE5xnAjZra7DvxFbsXsBQScXE7r070bsRIQzGvcVcgDV0ULvMQ81VqyWZeOXBMN5T2rW36_uaUxw1cClHq3yTfDl0c0GFCJgISd28zyoo
- '@type': type.googleapis.com/google.rpc.PreconditionFailure
  violations:
  - subject: ?error_code=110002&service=servicemanagement.googleapis.com&permission=servicemanagement.services.bind&resource=duet-ai-old
    type: googleapis.com
- '@type': type.googleapis.com/google.rpc.ErrorInfo
  domain: serviceusage.googleapis.com
  metadata:
    permission: servicemanagement.services.bind
    resource: duet-ai-old
    service: servicemanagement.googleapis.com
  reason: AUTH_PERMISSION_DENIED

As of 20230921: API can be enabled

cloudaicompanion.googleapis.com' was provisioned as of Thu Sep 21 03:21:59 PM UTC 2023

michael@cloudshell:~ (duet-ai-old)$ gcloud services enable cloudaicompanion.googleapis.com --project duet-ai-old
Operation "operations/acat.p2-992638337172-21bd0ce8-a7dd-42c9-8547-e63a4e45a590" finished successfully.

References

• https://cloud.google.com/duet-ai/docs/discover/set-up-duet-ai