You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I need help. I am currently studying Multimodal RAG: Chat with Videos https://www.deeplearning.ai/short-courses/multimodal-rag-chat-with-videos/
In the course, there is a use of bridgetower-large-itm-mlm-itc using predictionguard. When I want to try it on a local laptop, following all the examples in the course, I am currently working on the chapter L4_Multimodal Retrieval from Vector Stores. I am having trouble with bridgetower-large-itm-mlm-itc using predictionguard, which I do not have an API KEY for. So I searched for information on huggingface and found https://huggingface.co/BridgeTower/bridgetower-large-itm-mlm-itc. But the next problem I encountered is how do I make a function to solve this problem?
# helper function to compute the joint embedding of a prompt and a base64-encoded image through PredictionGuarddefbt_embedding_from_prediction_guard(prompt, base64_image):
# get PredictionGuard clientclient=_getPredictionGuardClient()
message= {"text": prompt,}
ifbase64_imageisnotNoneandbase64_image!="":
ifnotisBase64(base64_image):
raiseTypeError("image input must be in base64 encoding!")
message['image'] =base64_imageresponse=client.embeddings.create(
model="bridgetower-large-itm-mlm-itc",
input=[message]
)
returnresponse['data'][0]['embedding']
Can you suggest how I should modify the function to successfully use bridgetower-large-itm-mlm-itc locally?
The text was updated successfully, but these errors were encountered:
I need help. I am currently studying Multimodal RAG: Chat with Videos
https://www.deeplearning.ai/short-courses/multimodal-rag-chat-with-videos/
In the course, there is a use of bridgetower-large-itm-mlm-itc using predictionguard. When I want to try it on a local laptop, following all the examples in the course, I am currently working on the chapter L4_Multimodal Retrieval from Vector Stores. I am having trouble with bridgetower-large-itm-mlm-itc using predictionguard, which I do not have an API KEY for. So I searched for information on huggingface and found https://huggingface.co/BridgeTower/bridgetower-large-itm-mlm-itc. But the next problem I encountered is how do I make a function to solve this problem?
Can you suggest how I should modify the function to successfully use bridgetower-large-itm-mlm-itc locally?
The text was updated successfully, but these errors were encountered: