Log & Monitor Everything in Azure Open AI with API Management Service
HTML-код
- Опубликовано: 7 фев 2025
- In this video, you will learn how to have a complete log including all prompts and open AI model outputs with the total token number used through integrating Azure Open AI with Azure API management service.
☎️ Do you need any career or technical help? Book a call with me: calendly.com/m...
Repo used in this video:
Link Added to Discord Channel under:
Discord channel: / discord
*******************
LET'S CONNECT!
*******************
Join Discord Channel: / discord
✅ You can contact me at:
LinkedIn: / mohammad-ghodratigohar
Email: mo.ghodrati95@gmail.com
Twitter: / mg_cafe01
🔔 Subscribe for more cloud computing, data, and AI analytics videos
by clicking on the subscribe button so you don't miss anything.
#AzureOpenAI #AzureMonitoring #apimanagement #ChatGPT #Logging #artificialintelligence #machinelearning #cloudcomputing #chatbot #virtualassistant #customerservice #developers #technews #innovation #Microsoft #CognitiveServices #BotService #naturalanguageprocessing #NLP #conversationalAI #videotutorial #tutorial #learningAI #AIchatbot #AIassistant #AzureAPI #AzureTools #MG #MGAzure #MGAI #GPT4
This is great stuff. Was helpful. Thanks MG!
This helped me so much, I was missing adding the backend step. Thank you for putting this together
Quality content. This is really very helpful MG. I love your work man. Thanks for everything ❤
This is amazing. Thank you for putting this together.
That was great. This video helped fill in a gap in my knowledge :)
Hi, where can I download the open AI swagger file that you have used in the demo?
This is really useful! Am I able to get user information into API Management logs? Caller IP might be not enough to track user statistics.
@MG I have deployed my Azure Open AI on web app for 200 users where I have Customized the domain. Will this same process help me to log user prompt??
Do I need to use Custom domain as endpoint or I can use default endpoint from Azure Open AI service.
Hey @MG - Amazing video, totally loved it. I want to ask if it's possible to send AZ openAI logs to ElasticSearch?
error when configuring open Api : One or more fields contain incorrect values: Invalid value of the Web service
Hi, I'm getting below error:
One or more fields contain incorrect values:
Invalid value of the Web service URL
Could you please tell me how to resolve this.
Good information 👍
One question: does it also logs the prompts if I am using the azure function with Api management and calling my openai from that function?
Did you figure out an answer for this? Does it log prompts and responses while using Azure function to call the API?
@@DannyWilfred no, I am doing manually logging of these in azure function.
@@its_kumar Thanks for the reply. It helps. So do you mean there is no much use with APIM in terms of logging while using Azure Function? Since you are having to configure it in Azure Function? And do you get that granular level of logging prompts and responses via Azure Function?