Using Azure OpenAI to retrieve SQL data

The session is about how we can use Azure OpenAI to interact with SQL databases in natural language.
It's aimed at anyone that is looking to leverage AI for advanced information retrieval. You should attend if you are interested in getting ideas on how we can leverage Azure OpenAI to interact with different data sources.
GitHub link - github.com/NikhilSehgal123/Az...
[eventID:20616]

[@kwakuowusu-tieku4289]

Thank you so much for this. It really opens one's eyes to the kind of things you can do with Azure AI and OpenAI. I can see how this could be a great tool for an organization that may not have report capabilities and need adhoc reports on a regular basis.
I think the audience here, however, should think about the security implications as well. For instance:
- how much trust should we place on queries coming directly from ChatGPT, should we allow it to execute against production database without review?
- are the queries coming from ChatGPT secure, and optimized?
- does the schema I send to ChatGPT become part of OpenAI training data?
- could my schema end up being exposed to the world?
These are some of the concerns I have as I explore AI solutions in general not just Azure AI.
I can see this capability being built into a tool like PowerBI, so if I have a database hosted in Azure, and am using PowerBI for reporting, PowerBI already knows my schema, a model can be trained on my data, nothing get sent to OpenAI. That would be amazing!

[@anony124]

this works only on small database , but it iwll not work if there are more than 15tables , because the schema will be huge and gpt models have limited number of tokens

[@javaman04]

Nice session.. however we may need multiple tables/sources to really have a conversation with the data. Like Finances could be link to Sales table or to products table.

[@bmm8213]

I would love to see a guide on how to apply this to LOD / SparQL endpoints. That would be a huge step forward in democratizing information. That would potentially have a big impact on research.

[@timokankaanpaa6762]

I would love to collaborate with you to solve our common problem to connect a graph end point. In case if you found already a solution please share!

[@thebuildreview]

Wouldn't this be easier to import your sql table view into Azure Cognitive Search and then use that in Azure Chat Playground...?

[@bmm8213]

Sweet. So usefull.

[@jawadalam1515]

great session. Can we have the link for the source code, please?

[@RobbieMraz]

Hi, by connecting Azure Open AI to a SQL DB, will have SQl DB a performance impact? Let's say that our company has a lot of integrations, we exploring Azure but we don't know if will performance let's say that we only want to bring Inventory/Finance Tables for now.

[@arielbenjamin3253]

Does this LLM only work on top of Azure SQL, or could the data be in a SQL Server instance hosted on AWS ?

[@ShubhankarSharma2795]

When will this code be available on Github?

[@hiramushtaq1054]

Can you please guide me I want to do calculations on my chatbot that is built on Azure openAi studio. How to do calculations? Like simple addition etc?

[@thaithien3994]

I cannot Install dotenv package, and it return error message ModuleNotFoundError: No module named 'dotenv', please help

[@fazalghani9916]

How do i connect Postgres db ?

[@shivchandrakumar2298]

I have multiple files how to our azure open ai chat bot refer multiple files

[@sandeepvuddagiri1418]

I am getting this error when I try to run the program. I have the key and deployed the model.
"The API deployment for this resource does not exist. If you created the deployment within the last 5 minutes, please wait a moment and try again."