As a marketer this is groundbreaking. I never came steps ahead of the basic interacting with a data frame. Now I can really learn and gain insights from giant data sets. Thanks for the video- very fact-based and not following the overall hype.
Computers understand Machine language so your need to create Software to convert Human language to Machine languages. This shows actually skills of programmers and developers.
This video deserves more views.... Horribly amazing how this can change the data analytics and data science job sector in the future..... Genuinely concerned😵😵😩
Indeed… only the best at the job will survive. Skills like mathematics may help us survive… Also note that, if things get complex, ChatGPT may be wrong (like in Python programming). Only the best skilled may spot its errors.
This wrecks most of my degree. I have a data specialization in a Computer Science degree. I’m just going to end up being a data farmer and janitor 😂 I’ve already got ChatGPT 4 building most of my dashboards (there are issues with depreciated features since 2021). This then lets me ask for the types of data analysis/visualization that I need and apply ctrl-C&V into my dashboard. Or someone could skip the dashboard if they only need a few calculations and the data is clean enough.
This indeed does look incredible. I have been using Langchain so far to 'analyse' information but Code Interpreter seems way faster and more intuitive. Just out of curiosity, how long were you on the waitlist before getting access to the plug-ins?
Ben your book is awesome, very thoughtful and original. Your insights into the the use and misuse of data will only become more relevant. I do hope to be able to follow your interpretations of how LLMs change data analysis. Thanks
7:00 the thing is while an LLM is possibly going to be wrong when working with training data and giving a response, when its working with information you specifically give it, I imagine its less likely.
Absolutely! And remember that writing code is for the AI like everyday language for us. After all our weird prompts and expression styles, when it gets to strict code, it goes, oh, yeah, finally we're talking, let me build this Python script for you! :) This showcase and technology will have great implications for our lives soon imo.
Thank you. Literally all the other videos about Code Interpreter don't bother to check the results. It's mind-blowing to see the chatbot be so accurate. Now I wonder if it can solve equations, make physics simulations... Also, there's something never mentioned in those experiments : the time the AI takes to do the tasks. It takes much longer to ask ChatGPT to interprete this data than to do it yourself, lol. I know, this was an experiment, but as AI gets widely used people will constantly have to wonder if they can't be more productive _without it._ In this case, you would definitely be faster making the graphs yourself.
A tutorial on using the Code Interpreter Alpha plugin for Chat GPT to analyze data, using a CSV file of air traffic passenger statistics. [00:01](ruclips.net/video/b9hSCuFGNRU/видео.html) Using Code Interpreter Alpha plugin for data analysis in Chat GPT [02:33](ruclips.net/video/b9hSCuFGNRU/видео.html53) Plugin infers column information and creates descriptive statistics and charts [05:11](ruclips.net/video/b9hSCuFGNRU/видео.html) Modified bar chart showing top 10 operating airlines by passenger [08:00](ruclips.net/video/b9hSCuFGNRU/видео.html) Combining and filtering data in Python and Tableau [10:44](ruclips.net/video/b9hSCuFGNRU/видео.html) The AI model can perform different types of analysis based on user input. [13:04](ruclips.net/video/b9hSCuFGNRU/видео.html) Analyze data using NLP and Transformers with ease [15:40](ruclips.net/video/b9hSCuFGNRU/видео.html) New technology allows for conversational data analysis [17:53](ruclips.net/video/b9hSCuFGNRU/видео.html073) Super intelligence on the planet raises concerns for human species --------------------------------- Detailed Summary for [Trying out Code Interpreter for ChatGPT](ruclips.net/video/b9hSCuFGNRU/видео.html) by [Merlin](merlin.foyer.work/) [00:01](ruclips.net/video/b9hSCuFGNRU/видео.html) Using Code Interpreter Alpha plugin for data analysis in Chat GPT - Code Interpreter Alpha is an experimental model that can use Python and handles uploads and downloads - The plugin can be used to analyze data by uploading CSV files and using pandas data frames [02:33](ruclips.net/video/b9hSCuFGNRU/видео.html53) Plugin infers column information and creates descriptive statistics and charts - Plugin guesses column metadata, which may be susceptible to error - Plugin creates bar charts, pie charts, and descriptive statistics [05:11](ruclips.net/video/b9hSCuFGNRU/видео.html) Modified bar chart showing top 10 operating airlines by passenger - Data labels added to the ends of each bar with thousands separated - Passenger count verified with Tableau analysis [08:00](ruclips.net/video/b9hSCuFGNRU/видео.html) Combining and filtering data in Python and Tableau - Python code combines data based on a condition and creates a bar chart - Tableau is used to filter the data by domestic flights and redo the bar chart [10:44](ruclips.net/video/b9hSCuFGNRU/видео.html) The AI model can perform different types of analysis based on user input. - Filtering data by Geo summary is possible for domestic flights. - The AI model can identify seasonal patterns and major outliers in passenger count data. [13:04](ruclips.net/video/b9hSCuFGNRU/видео.html) Analyze data using NLP and Transformers with ease - Create python code from everyday language to modify data, charts, and graphs - Output data as PDF with ease [15:40](ruclips.net/video/b9hSCuFGNRU/видео.html) New technology allows for conversational data analysis - Technology is error-prone and requires careful cross-checking - Enables self-service data analysis for anyone [17:53](ruclips.net/video/b9hSCuFGNRU/видео.html073) Super intelligence on the planet raises concerns for human species - Real conversations needed on how to handle this technology - Guardrails needed to be put in place quickly to avoid negative consequences
I am not able to see all the models after purchasing the plus subscription. It only shows GPT 3.5 and GPT 4 (as a tab and does not even have options). How are you able to access the Code Interpreter model?
As far as we understand, it isn’t available to all Plus subscribers yet. But there’s a chance it’s available to you, and you have to edit your account settings to turn beta plugins to the ON state. Give that a try, and if that doesn’t work, it might be a waiting game for you.
How do you suppose it generated that statement on the time series plot? Does it ingest the data and look at the values? Is it breaking down the output image?
I'm not 100% sure! I tried this analysis with this data set a few times, and sometimes ChatGPT did not say anything about the drop at first, and I had to ask it why air traffic dropped in early 2020. For times it seems to recognize the trend without me asking, I highly doubt it's using the .png file itself, as I don't believe the version I'm using has image recognition. I suppose it's possible that its pulling from previous chats. I use new chats each time, so it's not basing its awareness from earlier exchanges in the same chat. It's a bit of a mystery to me, though, and a great question that you're asking.
Code Interpreter is not in the plug-in store, actually. It’s a native plug-in. You need a ChatGPT Plus subscription, and you need to enable it: Open ChatGPT. In the bottom left corner, select Settings > Beta Features, then toggle the Plugins setting
I am not sure how the model was able to see the data and get the trend and also explain "there was the drop in passengers in 2020". Because the model itself isn't seeing the result. It is actually making the code and then the interpreter is running the code. Then after the plot, how is the model able to see the result? Does it use some GPT-4's image reading capabilities?
The number of smart people, like yourself, saying things like, "this is not only amazing in functionality and capabilities but it's also terrifying" is of great concern...
Great video sir keep it up. And to confuse your confusion AI does tends to Hallucinations but if its doing under code interpreter it runs that code and gives the output so stop saying it will be wrong. It will always be write because its code running from Python interpreter. I mean anyone could just assume it would be correct its simple thing.
Good video. At the end i dont see GAI being a problem for sometime. These are great advancements and even leaps from what we had half a decade ago. Or even 1-2 years. But as long as we are still messing with massive amounts of parameters we are going to reach a computational soft limit in terms of available compute power. We are going to have to augment NN with hard code and other tools. Our advancements with LLMs and other models will open us up to capturing and evaluating nee data about ourselves and the universe. Our biggest threat is corporations keeping AI behind a toll and gate. Then gate keeping knowledge and education. You will only be able to get answers from AI for exchange of your thoughts and metadata. Once they have enough data they will take that away and either have the masses enslaved or free to fend for themselves while the capitalist/aristocracy go off to party and live like gods. They will only need enough warm bodies until all labor tasks are trained to be done by robots and AI. Waves of extinction will occur because mass layoffs and no one will be hiring.
Hi, how can i get this plugin code interpreter ? i've been paying fot chatgpt plus since the beginning but the only plugins i have are the third parties. Thanks
In the model selector of ChatGPT, those with access can select it from the drop-down where you choose between GPT-3.5 and GPT-4. Currently at the bottom of the selection box will appear "Code Interpreter ALPHA." We believe the waitlist is the same as the one for the 3rd party plugins, so if that option does not appear, our guess is that you'll have to wait for OpenAI to take you off the waitlist and grant access. Good luck!
will this work by connecting it to a data source like a postgres db? or it has to be csvs? do we know about its limitations at all when it comes to how much data it can analyze in a csv?
As of today, it tells me that it can accept .txt, .csv, .xlsx, .json, image formats (.png, .jpg, .jpeg, .bmp), .pdf, and Markdown files .md. I was also able to upload a zip of a shapefile to create a map, so I'm guessing there are other file types it can accept as well. Right now it seems to be just file-based only.
"IT" didn't do the math correctly. It didn't do any math at all. It literally wrote the code that did the math for "IT" and it output the result that the code returned. That's why it is acurate with code interpreter and innacurate without it. There are so many incorrect interpretations and poorly understood comments on what llms do. It doesn't think anything. It doesn't interptet numbers or values. It doesn't do math or science. It literally doesn't even actually chat with you. All it does is complete contextually appropriate strings (which is a very complicated and resource demanding thing to do). And becaue programming is a language and because it's been trained on massive body of code data, it is exceptionally good at writing code. Which is why it's been give this functionality via a code interpreter and not in some other way.
Yeah, that’s actually a fair point and a valid correction. I tried to make your exact point elsewhere in the video, but probably fell back on somewhat lazy shorthand in the description you’re critiquing. Perfectly valid.
It wrote Python code to do the math. That IS caled doing math. Or are you gonna say that programmers don't do math when they write code to make calculus?
Well, it all boils down to how you define “thinking” and “doing” something. I would argue that IT actually thought, just using silicon, and not neurons
i think you mean data analyst that csv file was generated by pulling data from most likely multiple sources with different formats aka data engineer job
As a marketer this is groundbreaking. I never came steps ahead of the basic interacting with a data frame. Now I can really learn and gain insights from giant data sets. Thanks for the video- very fact-based and not following the overall hype.
You're welcome! "Very fact-based and not following the overall hype" is EXACTLY what I was going for.
I feel like this is what computers should've been like all along, asking them in clear language what you want and then them doing it. Pretty amazing.
Computers understand Machine language so your need to create Software to convert Human language to Machine languages. This shows actually skills of programmers and developers.
@@HaseebHeaven I’m pretty sure computers understanding human language is a more impressive way of showing the skills of developers.
This video deserves more views.... Horribly amazing how this can change the data analytics and data science job sector in the future..... Genuinely concerned😵😵😩
Indeed… only the best at the job will survive. Skills like mathematics may help us survive… Also note that, if things get complex, ChatGPT may be wrong (like in Python programming). Only the best skilled may spot its errors.
This wrecks most of my degree. I have a data specialization in a Computer Science degree.
I’m just going to end up being a data farmer and janitor 😂
I’ve already got ChatGPT 4 building most of my dashboards (there are issues with depreciated features since 2021).
This then lets me ask for the types of data analysis/visualization that I need and apply ctrl-C&V into my dashboard.
Or someone could skip the dashboard if they only need a few calculations and the data is clean enough.
Thanks for taking the time to put out this video. Can't wait to get my hands on this but you said, it's also getting pretty scary.
You’re welcome, and agreed!
This indeed does look incredible. I have been using Langchain so far to 'analyse' information but Code Interpreter seems way faster and more intuitive. Just out of curiosity, how long were you on the waitlist before getting access to the plug-ins?
Great demo of this exciting new product...
Ben your book is awesome, very thoughtful and original. Your insights into the the use and misuse of data will only become more relevant. I do hope to be able to follow your interpretations of how LLMs change data analysis. Thanks
Thank you Joel! Means a lot to me.
Impressive! Thanks for sharing.
Thanks for watching!
7:00 the thing is while an LLM is possibly going to be wrong when working with training data and giving a response, when its working with information you specifically give it, I imagine its less likely.
Absolutely! And remember that writing code is for the AI like everyday language for us. After all our weird prompts and expression styles, when it gets to strict code, it goes, oh, yeah, finally we're talking, let me build this Python script for you! :)
This showcase and technology will have great implications for our lives soon imo.
How about doing a similar work using Bing More Creative mode?
This is horribly amazing 😮😮
Thank you. Literally all the other videos about Code Interpreter don't bother to check the results. It's mind-blowing to see the chatbot be so accurate. Now I wonder if it can solve equations, make physics simulations...
Also, there's something never mentioned in those experiments : the time the AI takes to do the tasks. It takes much longer to ask ChatGPT to interprete this data than to do it yourself, lol. I know, this was an experiment, but as AI gets widely used people will constantly have to wonder if they can't be more productive _without it._ In this case, you would definitely be faster making the graphs yourself.
hi are you in the US, we can't any plugins yet, which waiting list do I use, Thanks for your help
A tutorial on using the Code Interpreter Alpha plugin for Chat GPT to analyze data, using a CSV file of air traffic passenger statistics.
[00:01](ruclips.net/video/b9hSCuFGNRU/видео.html) Using Code Interpreter Alpha plugin for data analysis in Chat GPT
[02:33](ruclips.net/video/b9hSCuFGNRU/видео.html53) Plugin infers column information and creates descriptive statistics and charts
[05:11](ruclips.net/video/b9hSCuFGNRU/видео.html) Modified bar chart showing top 10 operating airlines by passenger
[08:00](ruclips.net/video/b9hSCuFGNRU/видео.html) Combining and filtering data in Python and Tableau
[10:44](ruclips.net/video/b9hSCuFGNRU/видео.html) The AI model can perform different types of analysis based on user input.
[13:04](ruclips.net/video/b9hSCuFGNRU/видео.html) Analyze data using NLP and Transformers with ease
[15:40](ruclips.net/video/b9hSCuFGNRU/видео.html) New technology allows for conversational data analysis
[17:53](ruclips.net/video/b9hSCuFGNRU/видео.html073) Super intelligence on the planet raises concerns for human species
---------------------------------
Detailed Summary for [Trying out Code Interpreter for ChatGPT](ruclips.net/video/b9hSCuFGNRU/видео.html) by [Merlin](merlin.foyer.work/)
[00:01](ruclips.net/video/b9hSCuFGNRU/видео.html) Using Code Interpreter Alpha plugin for data analysis in Chat GPT
- Code Interpreter Alpha is an experimental model that can use Python and handles uploads and downloads
- The plugin can be used to analyze data by uploading CSV files and using pandas data frames
[02:33](ruclips.net/video/b9hSCuFGNRU/видео.html53) Plugin infers column information and creates descriptive statistics and charts
- Plugin guesses column metadata, which may be susceptible to error
- Plugin creates bar charts, pie charts, and descriptive statistics
[05:11](ruclips.net/video/b9hSCuFGNRU/видео.html) Modified bar chart showing top 10 operating airlines by passenger
- Data labels added to the ends of each bar with thousands separated
- Passenger count verified with Tableau analysis
[08:00](ruclips.net/video/b9hSCuFGNRU/видео.html) Combining and filtering data in Python and Tableau
- Python code combines data based on a condition and creates a bar chart
- Tableau is used to filter the data by domestic flights and redo the bar chart
[10:44](ruclips.net/video/b9hSCuFGNRU/видео.html) The AI model can perform different types of analysis based on user input.
- Filtering data by Geo summary is possible for domestic flights.
- The AI model can identify seasonal patterns and major outliers in passenger count data.
[13:04](ruclips.net/video/b9hSCuFGNRU/видео.html) Analyze data using NLP and Transformers with ease
- Create python code from everyday language to modify data, charts, and graphs
- Output data as PDF with ease
[15:40](ruclips.net/video/b9hSCuFGNRU/видео.html) New technology allows for conversational data analysis
- Technology is error-prone and requires careful cross-checking
- Enables self-service data analysis for anyone
[17:53](ruclips.net/video/b9hSCuFGNRU/видео.html073) Super intelligence on the planet raises concerns for human species
- Real conversations needed on how to handle this technology
- Guardrails needed to be put in place quickly to avoid negative consequences
We have RUclips Summary GPT we dont need this now man
@@HaseebHeaven I used Merlin for this - totally different
Great video
I am not able to see all the models after purchasing the plus subscription. It only shows GPT 3.5 and GPT 4 (as a tab and does not even have options). How are you able to access the Code Interpreter model?
As far as we understand, it isn’t available to all Plus subscribers yet. But there’s a chance it’s available to you, and you have to edit your account settings to turn beta plugins to the ON state. Give that a try, and if that doesn’t work, it might be a waiting game for you.
How do you suppose it generated that statement on the time series plot? Does it ingest the data and look at the values? Is it breaking down the output image?
I'm not 100% sure! I tried this analysis with this data set a few times, and sometimes ChatGPT did not say anything about the drop at first, and I had to ask it why air traffic dropped in early 2020. For times it seems to recognize the trend without me asking, I highly doubt it's using the .png file itself, as I don't believe the version I'm using has image recognition. I suppose it's possible that its pulling from previous chats. I use new chats each time, so it's not basing its awareness from earlier exchanges in the same chat. It's a bit of a mystery to me, though, and a great question that you're asking.
For me, although I have plugin access, I stil cant get access to Code interpreter. How did you enableit?
Code Interpreter is not in the plug-in store, actually. It’s a native plug-in. You need a ChatGPT Plus subscription, and you need to enable it: Open ChatGPT. In the bottom left corner, select Settings > Beta Features, then toggle the Plugins setting
I really want to get access to plugins
I wonder how good it's suggestions will if you wanted to do ML wih the data?
I am not sure how the model was able to see the data and get the trend and also explain "there was the drop in passengers in 2020". Because the model itself isn't seeing the result. It is actually making the code and then the interpreter is running the code. Then after the plot, how is the model able to see the result? Does it use some GPT-4's image reading capabilities?
The number of smart people, like yourself, saying things like, "this is not only amazing in functionality and capabilities but it's also terrifying" is of great concern...
I agree. It's like the movie don't look up. I heard the EUs regulation on ai are supposed to take effect only on 2024. This seems to be far too late.
how do you use the code interpreter model?
I am much interested to the software later he used to make the graph? He said Tabluo or something
Tableau
Where does the data from the spreadsheet you feed it go? Is it saved anywhere/accessible to others?
Great video sir keep it up. And to confuse your confusion AI does tends to Hallucinations but if its doing under code interpreter it runs that code and gives the output so stop saying it will be wrong. It will always be write because its code running from Python interpreter. I mean anyone could just assume it would be correct its simple thing.
Good video. At the end i dont see GAI being a problem for sometime. These are great advancements and even leaps from what we had half a decade ago. Or even 1-2 years. But as long as we are still messing with massive amounts of parameters we are going to reach a computational soft limit in terms of available compute power.
We are going to have to augment NN with hard code and other tools. Our advancements with LLMs and other models will open us up to capturing and evaluating nee data about ourselves and the universe.
Our biggest threat is corporations keeping AI behind a toll and gate. Then gate keeping knowledge and education. You will only be able to get answers from AI for exchange of your thoughts and metadata. Once they have enough data they will take that away and either have the masses enslaved or free to fend for themselves while the capitalist/aristocracy go off to party and live like gods. They will only need enough warm bodies until all labor tasks are trained to be done by robots and AI. Waves of extinction will occur because mass layoffs and no one will be hiring.
I have GPT 4 since it came out but I don't have the interpreter, how can I get it?
Add yourself to OpenAI's plugin waitlist here: openai.com/waitlist/plugins
@@DataLiteracy They only select Scientitst Professors and Some important people in society
Please what is sql query training
Very cool, could you please make a video on how to set this up on Windows?
Should be very similar to the experience on Mac as we're just using Chrome and Excel in this workflow.
Hi, how can i get this plugin code interpreter ? i've been paying fot chatgpt plus since the beginning but the only plugins i have are the third parties. Thanks
In the model selector of ChatGPT, those with access can select it from the drop-down where you choose between GPT-3.5 and GPT-4. Currently at the bottom of the selection box will appear "Code Interpreter ALPHA." We believe the waitlist is the same as the one for the 3rd party plugins, so if that option does not appear, our guess is that you'll have to wait for OpenAI to take you off the waitlist and grant access. Good luck!
@@DataLiteracy I am guessing you must have a paid sub to gain access to the Model Selector?
I cannot see the code interpreter on my Chatgpt plus
its not available yet for most people.
You need to add yourself to the waitlist: openai.com/waitlist/plugins
@@DataLiteracy okay thanks
will this work by connecting it to a data source like a postgres db? or it has to be csvs? do we know about its limitations at all when it comes to how much data it can analyze in a csv?
As of today, it tells me that it can accept .txt, .csv, .xlsx, .json, image formats (.png, .jpg, .jpeg, .bmp), .pdf, and Markdown files .md. I was also able to upload a zip of a shapefile to create a map, so I'm guessing there are other file types it can accept as well. Right now it seems to be just file-based only.
ever tried importing an exe file and see what it does?
ChatGPT error prone? As opposed to a humans running the numbers. Haha.
You have a point there.
How long does the waitlist took?
We don't have any information about OpenAI's process to take people off of the waitlist, sorry!
I have a GPT-4 submission, but however I cannot find I can use Data interpreter. Can someone help me out?
Add yourself to OpenAI's plugin waitlist here: openai.com/waitlist/plugins
@@DataLiteracy How long does this approximately take?
@@victorhoupst7293 there is no waitlist for code interpreter as it is in alpha
@@permiek But how can I enable it?
Well... the world is changing at a crazy rate. People don't realize what is happening now... wow.
Wow
Time to retrain to become a plumber.
Letsa go
You're asking friendly and being nice to the AI. Are you afraid the robots will come for you if you don't? 😅
Down the road, perhaps. For now, I'm more afraid of what I'll become if I allow myself to be a jerk, even to an AI.
@@benjonesauthor Haha, totally get what you're saying!
@Data Literacy Thanks for the content, subbed!
Fun Fact: Bing Chat has a sensitive personality. It can even close the conversation on its own if it considers you're mean to it, lol.
Saying please to chatgpt is a Canadian thing, eh?
SORE-y, couldn't resist.
Take out your pitchforks people!!
"IT" didn't do the math correctly. It didn't do any math at all. It literally wrote the code that did the math for "IT" and it output the result that the code returned. That's why it is acurate with code interpreter and innacurate without it. There are so many incorrect interpretations and poorly understood comments on what llms do. It doesn't think anything. It doesn't interptet numbers or values. It doesn't do math or science. It literally doesn't even actually chat with you. All it does is complete contextually appropriate strings (which is a very complicated and resource demanding thing to do). And becaue programming is a language and because it's been trained on massive body of code data, it is exceptionally good at writing code. Which is why it's been give this functionality via a code interpreter and not in some other way.
Yeah, that’s actually a fair point and a valid correction. I tried to make your exact point elsewhere in the video, but probably fell back on somewhat lazy shorthand in the description you’re critiquing. Perfectly valid.
It wrote Python code to do the math. That IS caled doing math. Or are you gonna say that programmers don't do math when they write code to make calculus?
Well, it all boils down to how you define “thinking” and “doing” something. I would argue that IT actually thought, just using silicon, and not neurons
ya no shit.. no one's saying it's magic
“Any sufficiently advanced technology is indistinguishable from magic.” - Isaac Asimov
iTS OVER FOR YOUR JOB AS DATA ENGINEER!
i think you mean data analyst that csv file was generated by pulling data from most likely multiple sources with different formats aka data engineer job
@@FidelHimself yep I’m working on it now
None of this was related to Data Engineering
Boo hoo
Its over for you guys. Now simple madafakers with csv knowledge will be data engineers. Keep coping