Is GPT-4 Really 10x Better At Programming? | ChatGPT
HTML-код
- Опубликовано: 13 июн 2024
- Open AI recently released GPT-4 as a successor to the original ChatGPT using GPT, a chat based artificial intelligence that knows how to code. In this video, I put it to the test to see how it performs in various software engineering tasks in comparison to GPT-3.5.
Prepping for your frontend interviews? Use code "conner" for a discount on my course FrontendExpert:
www.frontendexpert.io/conner
LinkedIn: / connerardman
TikTok: / connerardman
Video/Coding Gear: www.amazon.com/shop/connerardman
ChatGPT: chat.openai.com
Timestamps:
0:00 Coding Interviews
3:52 Center A Div
6:49 CSS Challenge
9:15 JavaScript
12:41 Tic-Tac-Toe
15:09 Infinite Scroll
18:04 React Hooks
19:54 React App
22:17 System Design
27:14 Debugging
29:07 Computer Science Knowledge
34:40 Will ChatGPT Replace Software Engineers 
Наука
I think people misunderstand how AI could impact software engineering jobs now. If I’m an employer, I’m not looking to completely replace my employees tomorrow. That would be foolish. But I am very interested in seeing how my leads and senior engineers could utilize these tools and have their teams be just as productive as they are today with a smaller supporting staff.
Smaller supporting staff... It means AI will replace those people categorized as supporting staff, right? 🙂
@@Ez-se2dl in theory, yes. It could threaten junior and mid level jobs.
@@tropicten I think you are wrong. I am a sr software developer. I specialize in backend work, forms application work, sql work but not web/css/javascript. With chat4, I can effectively do the front end work because, without wanting to seem arrogant, I am smarter than most people around me. Before, the barrier to me doing the web work was that I had never put in the time to dig deep into the topic to know the syntax or organization, or best practices. In the future a Jr developer who has a sharper mind, will be able to do the same work as your sr developer who has a dull mind.
apologies for my english, i am not a native speaker.
@@JCElzinga I don’t think we disagree. Good developers will still be in demand, regardless of their experience level. But what about the bottom 50%?
Here's another thought. If I'm a business owner, I will think about how my engineers can use these tools to be more productive and make me more money.
If a business can scale their revenue, and in this case even profits by closing more clients (if a product company) or delivering more features early (if it's a service company), they would rather do that than fire their employees and potentially also lose respect and trust in the market
Man you get right to business, no bs intro and fluff - love it.
Hey Conner, I really liked your in-depth approach! In comparison to other RUclipsrs you definitely put a lot more effort into it! Especially, the "System Design" part which is really important but most RUclipsrs don't focus on that. I'd really love to dig more into that, since it is such a crucial part of building an app, but I didn't have much touch points with that so far. Are there any recommendations on how to use ChatGPT to "drill down" into those details? How would you approach learning about it or even trying to build an app with the guidance of the ChatGPT answers?
Thanks! For using ChatGPT for it, I would say just ask it more specific questions (e.g. what are my specific database options, which would you recommend, and why). As for learning about it, there are some good courses out there if you're into that, but ultimately it is something that just comes more with experience. There's a reason most companies only give system design interviews to senior engineers. I'm definitely not an expert here either though, system design is still something I am working on learning more about too.
@@ConnerArdman Thanks a lot, I'll try it out :)
This is by far the best video on this topic! Everyone else is just hype about building "this and that" with GPT. This actually shows the flaws and issues it has with coding and thinking of it. I use GPT on a daily basis for various tasks in my daily developer life, and I think it is great. But it is just assisting me, I still am the developer doing the work. But it sure saves a lot of time, and does help by pointing me in the direction towards a solution to a problem.
But it sure helps to feed it a context to your issue, before asking for a solution.
22:09 I think what just happened explains the bug, it's not that it's connecting 5, it does play connect 4, but it checks if you win two steps too late.
My guess is that for reason it checks only if the player that currently plays won, and that he checks it at the start of a turn instead of at the end. But that on its own will make you win after your forth block but _before_ you can place another one, so maybe there's more, or maybe it's something else entirely.
As fast as your specific research corner I guess it got better, but I know that in many other ways the Model refinement are to be taken with a grain of salt. I started GPT 3 Oct 2022.
It was amazing for my usage, but it got its wings clipped more and more.Guess out of missuse caution..
+1 subscriber great video.
I'm not sure your background as I'm new here, but if you're coding full time somewhere I'm curious how you've implemented GPT into your workflow. I'm a solo developer working on a few projects at an investment firm and am using it basically as a PM + engineering manager + senior developer to ask questions all wrapped into one. Always looking for ways to make my process more efficient. Thanks again for the video.
Thanks, glad you enjoyed it! My primary work outside of YT right now is creating coding interview questions over at AlgoExpert. So I'm not working a traditional software engineering job anymore, but I still spend a large portion of my day writing code. I haven't been using it a ton, but here's a few of the things I've used it for:
- Writing simple self-contained helper functions
- Ideation
- Confirming my understanding of some CS topic is correct
- For YT, confirming my scripts/notes are accurate and finding places to add more useful information to them
- Asking it to explain well known algorithms that I was having trouble finding the best way to articulate
I think ChatGPT with GPT-4 is vastly underestimated. I am an intemediate level hobby programmer, by no means a full stack professional. I used GPT-3.5 to try to help develop an app using the flutter framework and it make tons of mistakes, but it still managed to help me get the base functionality working. GPT-4 on the other hand literally made the core functionality of the app for me within an hour, only had about 4 errors along the way. I am honestly blown away. I feel like I could code anything now.
Haha bullshit. I can't even code a pong game that generates a bonus ball after so many points with a score tracker to present to the player how many points away until getting the bonus ball.
I ask it to fix the errors and it removes major components of the game, create errors, or just completely destroys the game after a matter of time.
Yup... as a fellow hobbyist (was a pro, back in the dinosaur days - but just like to play around and make my own toys now) I am drooling at the opportunity to 'prompt' my way through some more complex ideas I'd like to implement. And I imagine I'll learn some things as I tweak the output.
@@HoopsForecast It's all in the prompting. I found that if I opened up a text editor and spending a good 10 minutes clarifying my specifications I could get far better results than just typing in a request. It's dumb but smart, if ya catch my drift.
I've spent easily 10 minutes on a single prompt for my pong game and it'll forget certain things or it'll have errors. I try to correct the errors, but sometimes it delete certain aspects of my game even after re-clarifying what I wanted and what I wanted fixed and how so.
I had better success in GPT4 than GPT 3.5, but certain aspects of chat GPT4 really struggle in.
But I'm very excited and I cannot wait to see how this will all progress 5 years from now. Being only in my early 20s, I can't wait to see how this advances and I am so glad we are all able to experience A.I technology and how useful and fast it's improving.
@@HoopsForecast GPT 4 is smart af but its missing something else for complex projects.. just waiting for gpt 5
It's kinda sad that the team at OpenAI didn't tell us anything about their architecture and training. That makes it so much harder to extrapolate into the future as we don't know what new advancement in transformers did they already use (or if they used H1 processors for training). Either way, it does seem like this technology will take over at least 80% of coders' workload in the next few years (I hope it doesn't go much beyond that number)
there's no architecture or training, it's all interdimensional demons you're interacting with when using the prompting interface.
its a trade secret
@@noniche1387 OpenAI wasn't supposed to have trade secrets
@@pengun4841 There is nothing Open Source about GPT 4 though. Their data, architecture, code even some basic information such as paramter count or hardware used are hidden.
At this point they should honestly stop calling themselves "OpenAI" it makes them look ridicilious
The Game Snake, GPT-3 used Python to generate the code. It was very much Python to everything else. GPT-4 used HTLM with css for scoreboard, and javascript for the game it self. It worked as intended at first attempt. GPT-3 never managed to finish its code.
3.5 does that just have to prompt it
wow, thanks for this thorough video :)
Thanks for watching it 🤝
Agree with the people in the comments - great to watch such carefuly made unbiased test, instead of all those hyped videos ...
I would add one important fact I am not sure it was mentioned here - Bing Chat seems to have the access to the latest APIs, at least in case of Blender (Python) I tested ... this makes it night & day compared to ChatGPT, no matter the difference in the technology itself.
Thank you for your work!
Thanks for the kind words, glad you enjoyed it! And yeah sounds like I might need to finally give in and try Bing 😅
@@ConnerArdman It's worth it. I've been using them both. Bing has access to details, ChatGPT is stable for long conversations. They were trained differently, so they have different strengths/weaknesses
Yeah I hate the hyped videos. I feel like I should go live in the woods and live off hunting gathering by tomorrow
So you have less bugs in python scripting in blender compared to Chat GPT ? I would like to use AI in general to accelerate my learning of coding (as an architecture student who wants to do some parametric architecture stuff).
@@3deesigner900 Bing is using the latest Blender API, ChatGPT knows 2.9 max... but Bing (GPT 4) is generally better for scripts generating.
Hi Conner, I am a front end intern and I will graduate from college this year, I found it’s so hard to do my daily work well, hard to implement project requirements logic. And my css skill is so terrible, I can understand teammates’ css code easily, but it’s so hard for me to write by myself . Can you give me some useful tips for my career ? Thank you very much! Your high quality videos are so nice.
It's similar to learning how to swim, you see your teammates swimming really well but you cannot swim as well as them. Then just spend a much longer time swimming and your body will get used to the movements. Hope you find it comfortable to write code in the future!
@@charlieduke1627 Thank you very much. I need to write more code and learn more. Practice makes perfect !👍🏻
Hey, for starters congrats on landing an internship in the hardest environment we've seen in years. As for the actual question, I think there are two main components to it. First of all, I can guarantee you that your teammates probably don't understand things as well as you think they do. Software engineering is a field where everyone is copy/pasting from somewhere else. More senior engineers are just better and finding what to copy/paste 😂
Also, every. codebase is different. As an intern, you're expected to just dive into a new codebase and be somewhat productive. As a full-time developer, you usually have months of ramp up time (not to mention that some of them have probably been there since day 1).
And as Charlie said, a lot of it is a time thing. As an intern, you've probably spent < 6 months of your life doing professional development. Some of your most senior teammates have probably been doing it as long as you've been alive, and they all have a multi-year head start on you. Just keep working and practicing and it will slowly become easier, just like coding is probably much easier now than when you first started learning. A lot of it is just pattern recognition, which takes a lot of time to develop.
People who are afraid of job loss , are not thinking that chat gpt will be used by humans and not bots , be it developer, or intern or student or teacher , and many more , what i think is it will improve quality of productions , discoveries and services , it will help humanity . It will also clear difference between the high end developers and average ones and even beginners will be working like obsolute pro within 1 year of their carreer using AI.
As someone with no coding knowledge at all I was able to build a mini website using gpt3.5 and trial and error, I can’t wait to try gpt4
Thanks, that was helpful.
Dude, I grew up in the street with no vocabulary, so I couldn’t understand code function descriptions, I asked gpt-4 to describe the functions in the tone of a 80s New York Italian mobster to an idiot, I now work at Microsoft as a coding overseer
I think the 'API example' is the only interesting test for chatGTP, would be more interesting to see you test novel problems that currently require a human to do more than just parse search results to solve.
Amazing video keep going man
Thank you!
Sounds like you know what you're on about! - Top job;
Thanks!
Hey Connor! As someone who just realized they are passionate about being a software developer I started a bootcamp 2 months ago. I had a plan where I was giving myself 1.5 years to learn before I start applying for jobs. That being said, when I started my bootcamp software development was a good field with plenty of job security and had a need for more developers. Seeing chatgpt and what it can do has been amazing but also discouraging, I can totally see it shifting the software development world to a place where there are no need for junior devs and less senior developers are needed overall. What are your thoughts on this?
I can't predict the future, but here's my personal thoughts. GPT is absolutely amazing, but it is nowhere near replacing software engineers. It can code decently well in a vacuum, but it is not all that close to the proficiency of a real developer (although it is way faster). It's sort of like the 80/20 rule. It is probably close to 80% of the way there, but they've probably only done 20% of the work to get it to 100%.
The tech industry is one that has spawned some of the largest, most successful companies of all time. Of course there would be a significant reward for them if they could layoff all of their engineers and get the same results, but the risk is way too large for them to try it. It just takes one bad piece of code to create a major problem like a data leak that can destroy a company. Because of this, even if GPT was better than real engineers, it would take a long time for it to start replacing a large number of employees.
Moreover, software engineers won't be the first to go. I'd go as far as saying they will be one of the last to go in the scenario where AI is replacing jobs. The job might change a bit, but software engineers would be needed to integrate the AI for a long time. And if we do get to the point where software engineers are being replaced, then most other jobs would be replaced as well. This simply isn't something worth trying to over-prepare for in my opinion, because it would result in a radical shift to how the economy works as a whole.
On the senior vs junior thing, there might be some truth to this. However, eventually that would just mean what we call senior now would become the new junior (i.e. you can't have no entry level jobs in a field. If that were to happen, once a wave of retirements occur there would be no qualified job applicants for those senior roles anymore).
So my general opinion is don't let AI discourage you from doing what you are interested in. But at the same time, learn how to use that AI to learn faster and be more productive.
I have a full video on this here btw: ruclips.net/video/vE4f_LI9Oj0/видео.html&t
Don't be discouraged. It makes mistakes every time I use it for basic functions. Someone who understands software needs to be at the helm to know what needs to generated, review the code and understand what needs to be fixed and why. It is another tool in the toolbox for software development to help fill in gaps and make engineers more productive.
@@ricosrealm Making mistakes now doesn't mean it will keep making them in the next 2 years lol. It's highly likely to replace junior developers in the future.
@@ConnerArdman as much as I like to be hopeful, perception will always be stronger than reality. Some jobs become commoditized and lose much of their high value over time like writing. Now it’s coding and other jobs. It’s about asking the right question. Would it replace jobs, no in the short term. What we need to ask is if it will devalue certain jobs, yes.
@@HustleLizard trust is huge problem with llms. they don't know truth from fiction and aren't currently capable of running without validation. I would say until we see it capable of debugging itself, then we won't see jobs go away for devs even if it gets more accurate: someone still needs to tell it what to do and validate its output.
what technologies have more opportunities with decent salaries at present?
That's really hard to answer, and it depends a lot on location and what you mean by "decent". Most developer jobs (at least in the US) aren't hiring for a specific technology, they are just looking for strong developers who will learn their stack if they need to. Moreover, 99% of developer jobs have what I would consider at least decent salaries.
To attempt to answer the question, there is probably the most growth in machine learning and AI right now. Those jobs tend to pay the most, but also tend to have the highest barrier to entry education wise. As far as pure number of jobs, there are probably more jobs using JavaScript than any other language, as it is the most used language in the world. Some of those jobs don't pay as well as the barrier to entry can be lower, but some of them pay extremely well. It all just depends on the location, company, specific role, etc.
** This answer was generated by AI
One thing i see AI struggling is helping debug programs that utilise third party libraries. I have compared using gpt3.5 and gpt4 debugging python code using third party library and it seems to get no where near in resolving the issue,it actually makes it worse.
. . For Now.
The more you give it, the more it "learns".
In a sense , it's just Hi-Tech plagiarism.
Any idea why they are still calling themselves OpenAI? Seems like ClosedAI is more fitting.
Well executed video. The improvements here seem small, but if we can get our hands on a newer version, we'll have a good gague on the growth potential and be able to get a timeframe.
Still, I think the world is going to be massively different in 2030 if the momentum keeps moving forward. If it keeps it's pace though, we might only have 3-5 years before we start seeing massive effects.
Lol that is a good point. Hopefully they open source GPT or at least parts of it, but I kind of doubt that happens.
And thanks, glad you enjoyed the video!
ChatGPT says: "The term "open" in OpenAI has a dual meaning. While the source code and certain details of the underlying models may not be fully open to the public, OpenAI is committed to openness in the sense of sharing research findings, collaborating with the community, and fostering transparency."
edit: although, when i copied your question word for word this was the answer (completely different)
"The name "OpenAI" reflects the organization's commitment to openness and collaboration in the field of artificial intelligence. OpenAI was founded with the goal of ensuring that artificial general intelligence (AGI) benefits all of humanity. While they conduct research and development, they emphasize openness in sharing their findings, publications, and even providing public access to some of their models."
do you think still worth it as new beginner start learning from the basic to become front-end developer?
If you find it interesting, then of course it is. Plus, now you have a great tool in ChatGPT to help you learn :)
I'm actually creating a version mainly for writing Python code and JavaScript code that can soon enough work great offline, but... many of the websites are not letting me easily scrape for data there by making it timeout. GPT4 created a basic Python template for me of function calls galore so all my chatbot has to do is retrieve from that sequential order. When I saw that solution... it reminded me of a quote by Michelangelo, the famous Italian Renaissance artist, paraphrased "The masterpiece was already in rocks... it just needed the excess to be cut away".
Hello Conner! Great video! But... im a full stack software developer and im afraid to continue working with it. For context, im a 17 years old developer, i have 2 years of employed experience. What are the expectations for software development/engineering?
Thanks, glad you enjoyed it! But I'm not sure I understand your question. What do you mean by "expectations for software development/engineering"? And do you mean 2 years of experience as an employed developer? Not trying to doubt you, but I've never met anyone who got a developer job at 15 🤔
Can someone give me good java programming interview task and good website to get some practice on some problems or even practice repo or smth. Thank you.
Sounds like neither of these are real winners. Maybe gpt-5.. I can't get chatgpt to display a navbar menu generated (with jinja tags) based on json with recursively generated sub menus using jinja tags. Its possible to do, and it got close, but the menu just wouldnt work. I spent hours trying to debug with it to get it working and it wouldn't make it work. I dont have gpt 4 access yet.
I am a sysadmin planning to go back to programming this year after 25 years I did C++ back in the 90's and I want to go frontend React JS Node etc Do you guys think the AI will be able to reduce all the jobs and get rids of all the bad programmer being lazy ? like the one at google facebook the bunch of people who are in programming but aren't real one you know what I mean
after about 3 years of getting into coding GPT4 have finally done what I was wanting to do for so long it helped me build a machine learning algorithm using a neural network and store the trained data on my hard drive and learns how I use my computer from gaming streaming and creating content it's fucking crazy it's learning as I'm texting now with a data cap limit of 350GB ITS FUCKING INSANE!!!!!
What it can do for you?
Liked and Subscribed. Wish shared growth.
Thank you!
for me, gpt4 is much better at debugging - you can paste in a bunch of code, and it can think through what it does and what might be wrong far better than gpt3 did.
the errors make you better 😂
As I've said to the other people challenging ChatGPT with childish tasks I want to advice you to actually make an application only using GPT. And then I mean something more advanced than a TODO-list or the infamous snake-game.
Can you talk about TS. Should it become a default instead of JS ?
I'm not sure I understand what you mean by becoming a "default" (e.g. a default for what?). For professional developers using JS/TS, TS pretty much is the default choice at this point. Very few major new projects are being written in plain JavaScript. If you mean "default" in terms of browsers natively supporting it, I don't think that will happen anytime soon, and there's not much of a need for it to since the compilation process from TS to JS is so simple.
There's still plenty of times plain JavaScript works fine though and can save you some time. If I just need a short and simple script, I'll usually just use JavaScript. The real benefits of TypeScript don't really start coming until a project gets larger and needs to be properly maintained.
@@ConnerArdman Thx, Yeah i meant that a real job basically implies that TS is used nowadays and maybe there will be more tools/libraries in TS without even JS support so TS will eventually overshadow and become a default way we write frontend. Ofc deep in it's core there will be old JS (which modern JS isn't anyway) But modern JS is basically kind of the same as TS in regard that new JS is actually a transpiler as well (to old JS) . So when we talk about core JS vs TS there is actually no core JS anyway as both are transpiled into old JS =) Sorry if it's confusing..) Are my thoughts correct ?
I don't think we will ever see any significant number of tools/libraries/etc that support only TS. There's just no reason to. I would think of TypeScript as closer to a JavaScript framework/tool than its own language. And yeah we will always be converting the most modern features of JS into older features for backwards comparability. I guess you could think of these two things as similar, but fundamentally they are pretty different imo as one is part of the language, and one is an outside tool.
I could see a world where Ecmascript eventually just adds a bunch of TS-like features into the standard (similar to how Python added type hints). That would effectively give us more "native" Typescript support without the transpilation step (other than potentially transpiling it back into "old" JS code for that same backwards compatibility).
I think you should've prompted them better to be able to debug the code
I must be doing things wrong because I can't really get much useful out of GPT-4 regarding code. It constantly loses context and then makes errors and gets in loops where it constantly makes a bug, fixes bug, creates bug, fixes bug and nothing REALLY gets done.
I've found that GPT-4 is a huge improvement in this area. It's able to retain context a lot better than 3.5 was, but yeah it still isn't perfect. I have had the same issues with debugging though. If you give it a task that it fails to complete, oftentimes the debugging seems to just end up in an endless loop of it making the code worse. If you give it a really good follow-up prompt, sometimes it can debug its own code, but that definitely isn't its strong suit just yet.
Complexity is measured in O-Big Oh in Algorithms
"It Is Difficult to Get a Man to Understand Something When His Salary Depends Upon His Not Understanding It"
In 4 months it improved dramatically. Where will it be in 5 years if this is the rate at which it is "learning"? And it's not just you're industry. Legal, medical, and pretty much all white collar jobs are potentially done here soon to give some examples.
Right now it still needs a seasoned developer to guide it and ask all the right questions. Soon it will probably just need the client to tell it what kind of software it wants.
I had the same fears as you but then I read this thing that completely changed my opinion on chatGPT. It's not the jobs that are getting replaced. It's the people who won't adapt to this new technology.
What this means is that ChatGPT will not replace lawyers. Lawyers who use ChatGPT will replace lawyers who don't use it. Just like google did not replace the IT sector even though you can find all answers online.
ChatGPT is only a tool. Embrace it, learn to use it and become better than your competition.
Very true. This will be a HUGE political talking point soon.
There's the huge legal issue with AI generated code. There is an IP issue with code generated by AI models. Companies will need to train their own models from scratch rather than relying on pre-existing code. This is why some MANG company employees can't use chat GPT. There's also lots of privacy issues. People forget that when they get their engineering jobs then need to sign all this paperwork and no-disclosure / compete / IP contracts.
@@Ivcota Good point. I would favor some kind of open source license, forbidding the code from being used for AI models.
In many cases it won't need to write the program, it will be the program.
I always wanted to ask a professional software engineer about this..
How long does it take you to solve a very hard problem ?
And how long did it take you to become very good at problem solving ?
Were you good from the beginning or did you improve slowly ?
Watching the coding interview you did with clement made me feel stupid because of how you make it look so easy for you haha
Thank you .. I hope your channel grows as big as your brain :D
Assuming you mean a very hard algorithm problem, to be honest there are very few I could solve without hints unless I have seen it before. Most of the easy questions on AlgoExpert I could probably do in a few minutes. I'd guess the average medium would take me ~10 minutes, with a few taking a lot longer. Hards would probably take ~45 minutes on average without the hints as it would take more trial and error to find the solution, and some I probably wouldn't be able to solve without the hints.
As for getting good at problem solving, I don't know a specific timeline. There's not one day I can point to as becoming good at it. It's a much more progressive thing. I think it came more natural to me than most, but I certainly wasn't always good at it. The thing that helped me the most was teaching. When you teach, if you don't explain every little aspect, you start losing students. As a result, I really developed the skill of explaining every small thing I do and thus making sure I also understand every small bit. You can't teach someone through a flawed logic process, because you will lose them when their brains naturally notice the flawed logic.
Also, specific to coding interviews, I took some really good university classes that helped. I took 2 courses that were basically dedicated to data structures, and a third dedicated to more advanced algorithm topics like dynamic programming, greedy algorithms, and graphs. This gave me a really strong fundamental knowledge that I think is really important in excelling in coding interviews (although less so important for frontend ones). They also just help develop your logical thinking skills.
@@ConnerArdman Thanks so much ❤
Bro i am commerce background(India) .what is the best field in IT as i want to switch from commerce to IT?
That's impossible for me to answer. It depends on what your skillsets are, how much time/money you have to learn new skills, what you're interested in, what jobs exist in your area, etc.
Ask ChatGPT
@@ConnerArdman is this you or gpt 4?
I think people are giving chatgpt to much credit. Yes, it is an amazing program and can do a good job with coding simple projects but you still need a fairly good knowledge of coding and the specific software being made to prompt it correctly and debug it's mistakes. For more complex and specialized programs it can create a rough framework and buggy starting code at best.
Prompt engineering. Do not tell it it did wrong, just hand the script back to it and tell it to fix it. There are often many ways to say the same thing, GPT is limited by its interface.
And you will end up realizing, it is easier to code without it...
You should try some problem it can't crib from the web for answers.
Synthesizing and applying is sort-of impressive, but it still is not working at a high level of creativity.
And you're still needing to look at the question of liability. Who gets sued when the code screws up royally?
Ask it to resolve NP completeness.
Is it? If you make sure to bring ChatGPT to output everything under 580 tokens, yes. Longer code? Nope. Even if you say it should split it to chunks of 580 tokens, it forgets the conversation over time. (Including your requests about 4000 Tokens)
OpenAI could easily release a model to fix that without a doubt.
@@Blackfatrat , well, ChatGPT‘s tendencies are: reducing output tokens, shorten replies. Currently we are at about 250 output tokens with ChatGPT-4, typing „continue“ after each junk, and a limit of 25 requests each 3 hours.
I have this problem too, its soo annoying and always cuts the code half way or quarter of the way i wonder if gpt4 will be better🤔
@@qTnationX you can advice it to split it in chunks of 245 tokens. But as told, after 25 messages you‘re blocked for 3 hours. That is ChatGPT-4 currently.
@@Blackfatrat Really? How? This is the foundation of the technology. To overcome this limitation, they would need to invent new things and that is not that easy.
From experience it absolutely is much better than gpt3.5, for sure. And yeah i think it'll become a standard companion for coders, copilot already sort of is but chatgpt is much better at architectures.
I'm not sure I would call copilot a standard companion just yet, I've almost never seen anyone use it outside of a video meant to demonstrate copilot lol. But yeah, I think over time both will become fairly standard tools that developers are using, similar to how we currently StackOverflow.
I've tried several scripts including simple memory games that gpt has made and they are full of errors. it sucks at coding and last i checked when writing stories it wasn't as creative as people claimed, would repeat details ad nauseum and would never want to go into great detail, just this thing happened and that's the end of the story! if you give it a specific detail ypu want explained it will just repeat the detail instead of writing about it. I'm not impressed. plus gpt 4 is supposed to have an image function yet it doesn't.
yea man it just a start.. lets see in some months Gpt -5,6,7 this sh1t will grow up fast
@@bobtylen9993 chatgpt is unfortunately probably going to be shutdown. idiots are already abusing and miusing it, it's banned in italy, they're having money troubles and people are concerned about privacy leaks and people spreading hallucinated information with it. plus, some guy died and they blamed it on the bot even though he was mentally unstable and jailbroke the bot to tell him to kill himself.
@@bobtylen9993 The foundation of ChatGPT is in 80s. The research is not that fast as you may think. Like self driving cars, it has been developed for over 20 years and still limited usage.
You know that the generative AI model such as ChatGPT is just a tool to ‘pull’ existing code where the model is trained on. It can not completely replace the coder who made the original code. 😂
there is no ChatGPT-4. only GPT-4. because there is no ChatGPT-1 or ChatGPT-2 if anything. there is only GPT-1 and GPT-2
No it's not. But it could leverage RAD. You have to feed it information. How we could feed that specifications will at least speed things up. It will spit out garbage that you can not code review well.
I think ai will replace teaching jobs and online learning platforms and medical advice like reading test data predicting illness and legal suggestions thats all and programming jobs will not loose so much because companies dont trust an ai with there money and we don't know what ai doing in backend so what if it giving you company data to some others
With those hallucations? Come on, the kids will have so much mess in their head. It can help, but its still early to replace teachers.
If it’s python and not indented then that’s a definite minus coz indentation matters a lot in python
It is indented properly, I think it was just a UI bug. I recorded this only a few hours after GPT-4 launched. As far as I can tell, the bug was fixed.
Every primitive thinking (based on logic, like programming) can be done by AI
If you want to survive AI wave build products and services, NOT code.
Yes!! this is what people do not understand. You can now leverage you knowledge and build products and projects that will impact large groups of people.
The model (algorithm) creators of GPT-4 love that so many people out there are training their model - at no cost to them. Best to leave this HiTech plagiarism platform alone. Played with this tool only a bit, and realized it knows nothing about really thinking through a problem, only what it can replicate by scanning it's vast datasets.
10x better? No. But definitely better.
Can this bot replace a programmer in future?
I discuss this at the end of the video, and I have a full video on it on my channel. TL;DR though: not anytime soon. For now, it is just a tool that can help us be more productive.
@@ConnerArdman As a fresher I'm very confused I go for development and otherwise choose a another domain.
What you suggest me as per your experience can you give me the name of best domain rather than development?
@@anithegamer4166 if it can replace developers, it can replace most white collar jobs. because what they do is not that different from programming. instead of code, they produce excel/word/powerpoint/emails/graphics/videos according to customers requests
@@ConnerArdman I don't think these companies know EXACTLY what they are doing,they are putting them selves out of business and they don't even know it,but at the same time, they may think, if we don't do this, our competitors will;
My question is,IF AI/automation takes all the jobs and no ones making money and no one has any money, to buy products,after all the rich people die and their generational wealth has ran out,who's going to buy products/how are products going to be sold?
Even automation TECHNICALLY cuts into your POTENTIAL profit,think about it,if the employees you hire,also buy your products, they also contribute to your over all profit,also other companies employees has a domino effect as well,when it comes to your profit,this isn't the EXACT percentage,its more just for a thinking exercise,you can either hire an actual employee and get 50% of that money back, that you invested in that employee or that someone else invested in their employee,or get automation/a Machine/AI/a robot to do it and loose SOME OR ALL of your potential profit, especially since this is talking about,if EVERYTHING was automated/no humans were needed, for production/technically the more thats automated, with in business,the less money you will make,obviously SOME things are fine,like privately owned autonomous cars,but from a business stand point TECHNICALLY autonomous vehicles COULD effect delivery drivers/over all profits,if implemented,with in businesses, just things to think about,also if you could send your vehicle to go pick up something and a robot/drone/arm,could put it in your vehicle,that would get even crazier.
I've always thought this was going to happen,I thought we might have a little more time though and I honestly thought machines/robots were going to be built and be refined,before complete automation/AI,I didn't think software was going to be completely reliable/refined,before machines/robots we're.
I don't know if rich people will let go/allow a moneyless/credit less society to evolve/form/at some point money becomes obsolete as well,unless we turn to desperation/war/go back to our old ways/we MAY NEED to be more self reliant/we may need to grow crops/have cows/chickens/pigs/horses and so on.
What will we do, focus on our hobbies?
It looks like hardware jobs are going to be more viable, longer than software jobs.
This comment is just for something, for people to think about,I'm not saying any of this will happen or that it is happening,I'm just saying this is definitely something to think about.
I definitely don't think the younger generation will enjoy tech,exactly like we did/this is the first time that I've had the thought that computers/automation/AI,isn't a great thing,yes a terminator scenario/sky net/I-Robot scenario COULD happen,but even if humans control all of this, this changes A LOT,good and bad,but it all depends on what we decide to do/our reaction to all of this,we don't want to be the reason for our own demise.
I think we will be able to learn more effectively/efficiently;but for what purpose,if were competing with something that we can never win against,also if money becomes obsolete,what is the drive?
This is also a dilemma, a few generations MAY have to go through, when it comes to gene splicing/altering as well;How does an organically born baby/human compete with a human that has been altered/refined/optimized?
This is DEFINITELY A LOT to think about,hopefully we can all get through all of this and make the right decisions.
These are just things to think about.
@@forben3523 Nothing is safe. What you should focus on is building services with your knowledge and AI assistance. The grunt work that we all hate will get done by AI
it only a matter of time untill AI replaces programmers.
wow, thanks for the benchmark. Every developer is completely enhanced.
you misspelled replaced.
When learning python i used reddit. Now with c++ i use chatgpt
You didn't provide much information when trying to debug, if a test fails, you can just copy and paste the reason why it failed and use words like "Only this scenario failed because of the following error: bla bla" and chatGPT will be more helpful than if you just say "This failed" without telling him why.
A lot of the debugging stuff got cut out of the video (the raw footage was over 2 hours, so a bunch had to go), but I did try different methods for debugging. Regardless of what I did, the result was pretty much the same. It had a really hard time debugging code it wrote, unless I basically pointed to the exact line in the code that was wrong. I'm sure there were probably some better prompts I could have used, but in general I just don't think debugging is where it is strongest yet.
That said, copy and pasting just the test cases did work pretty well for the algorithm coding interview questions that I did off camera. When told a test case it failed, it was really good at fixing that code. And it seemed to be able to do this pretty well regardless of the specificity of the prompt.
Soon we can just type “spin me a civilisation on Mars” and then we can watch it enfold.
The question now is what happens to humans once AI are running things? We will get an allowance from the government and be on holiday for life?
There is a non-zero chance we are living in a simulation created by GPT-5, and we are nearing the point where our simulation creates a new simulation 🫡
I think the more likely answer to your question is that AI creates more jobs than ever before. We just don’t know what they are yet.
What is 10x man!!?? May be 1000x.... It creates whole game in seconds, while you need to spend your whole day...
10x was referring to GPT4 vs GPT3.5. There were some headlines claiming it would be 10x better a while back.
But also, it might be 1000x faster, but definitely not 1000x better than humans _yet_
Now i just idk what i should study, this is pain-
honestly at this point anything which interests YOU, most jobs will be lost anyway
IDK what it is but somehow I get the feeling this kid enjoys latke. I dunno man, I just have a feeling.
Well this kid had to Google what latke is so...
Shalom
The thumbnail...
Best part is that GPT actually generated that code 😂
Chat GPT4 and 4o is likely programmed by different group. It is chatty, overcomplicated, border rude and responses are looooooooooooooooong.
I am sticking with my terminator Arnold 3.5 till higher numbers will fix their attitute. 3.5 is better with coding python. Simpler and quick.
3.5 and 4 most likely won't make developers lose jobs. However, unlike the analogy of a tractor helping a farmer, eventually, AI will write a better AI. Tractors don't create better tractors. Jobs will be lost, but new jobs will be created.
All jobs are in jeopardy.
When GPT-X programs GPT-X+1, which then programs GPT-X+2, etc, we'll be off to the races, and all out of jobs. I was going to say "except for trash collectors," but they'll be self-driving and intelligent, too. Beyond learning the basics of logic and the main control structures, a lot of programming is just remembering stuff, like all the awkward garbola for making an Object. And guess what is Really good at remembering stuff?
But the thing is it is already trained on the data that existed till 2021.... that is already a lot of data and this is the result we got after being trained on this... and with time there will always be new approaches coming for solving problems better which chatgpt doesn't know and hardware architectures will also change with time and new frameworks will also come so i guess we will always be one step ahead of these models as a human has this skill of innovation which I think chatbot will never have at least in the coming future. The transformer model which is being used to train this has this limitation of hallucinations and creating wrong facts and this limitation will always be there until some computer scientists come up with some different kind of architecture for neural networks
@@kanavsharma7378 True, and also, the current architecture does not allow a model to program "itself". You need to do a whole new round of training to get a newer and better version of the model. It doesn't matter if these models come with plugins that allow them to search the web, that's just querying data and if it's not on the training set, it will definitely make errors.
its clear in 5 years 80% programmers will lose job
Will not happen
@petrusi.7669 this is the peak of debate:
Person 1: It's clear this will happen
Person 2: No it wont
@@antiprime4665 Let me rephrase it to be more precise: There will be change, it is inevitable, but programers will be there, even in 10 and in 20 years. We will do the job more productively and will be able to do more in the same time or maybe even do things which are now not yet possible.
Yeah for copy paste engineer will lose job lmao.
Programmer is far beyond coding
😂 did developers lose their jobs when we went from punch cards to C and compilers? Or when frameworks were created?
it's time to select a career without coding skills !!!
clearly no
nope it is junk simple answer in this state it is ussless
your Nvidia eye lock looks unnaturally... this is annoying
Interesting take given that I don’t own an Nvidia graphics card 😂