The First AI Software Engineer Is Here!
HTML-код
- Опубликовано: 12 мар 2024
- ❤️ Check out Lambda here and sign up for their GPU Cloud: lambdalabs.com/papers
📝 My paper on simulations that look almost like reality is available for free here:
rdcu.be/cWPfD
Or this is the orig. Nature Physics link with clickable citations:
www.nature.com/articles/s4156...
🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
Alex Balfanz, Alex Haro, B Shang, Benji Rabhan, Bret Brizzee, Gaston Ingaramo, Gordon Child, Jace O'Brien, John Le, Kyle Davis, Lukas Biewald, Martin, Michael Albrecht, Michael Tedder, Owen Skarpness, Richard Putra Iskandar, Richard Sundvall, Taras Bobrovytsky, Ted Johnson, Thomas Krcmar, Tybie Fitzhugh, Ueli Gallizzi.
If you wish to appear here or pick up other perks, click here: / twominutepapers
Thumbnail background design: Felícia Zsolnai-Fehér - felicia.hu
Károly Zsolnai-Fehér's research works: cg.tuwien.ac.at/~zsolnai/
Twitter: / twominutepapers
#devin 
Наука
I'm looking forward to see if it can help with debugging. Another pair of eyes can do wonders, especially if it's quick and available 24/7.
So, are we 2 papers away from recursively self-improving generative AI, yet?
Why are you looking forward to having your wage decreased or getting unemployed?
Yes yo can help HIM debugging, dont feel useless yet there brother!
Debugging... tomorrow you will be the bug lol People are so delusional is beyond stupid.
@@piotrek7633 instead of limiting advancement in technology out of ridiculous fear. embrace it.... it will happen rather you like it or not...if technology can replace your job let it.. at some point you won't have to work those types of jobs .. let AI take those jobs and allow a UBI to happen the capital system is in need of a rehaul
Software engineers finally software engineered themselves out of a job.
On the contrary. They just gave themselves a salary increase.
Lol
@@rafaelmateodev haha no.
I'm an dev and salary is getting lower, less jobs on market, and lay offs
So cool. I've always wanted to not exist, now I can be a part of making that a reality ☺
Time to become a farmer I guess
😂😂😂
Yes, that'd be an opportunity to research upcoming AI managed farm robots.
Oh... wait.
just watch out for when we are two papers down the line, or you might lose that job too
I mean we've had backlog-generating agents before, they are called junior and middle developers
hello, mr. andersen.
It feels like I graduated with a Computer Science degree in the worst time possible, its over.
CSD means you can properly talk to the engineering AI software.
Increase your production
This is still the early days, and I'd imagine the need for people working on these systems is booming. The field is also so new comparatively there isn't much necessary minutiae to be learned yet.
*computer science is advancing at an insane pace* not a good time to be a computer scienctist right now
you still have time
@@Faizan29353
that's what we were saying about video generation a year ago
@@puskajussi37
Now we need an AI that can take the jobs of CEOs, Directors and the shareholders.
These people don't work lol.
Even the dumbest AI chatbots can do that. Alas, those people are the few in a company that don't need to be efficient. They even set their own pay.
@@jackdaniels5538 Really? Show me a real example.
Just know one thing - even just managing a company requires much more than big talks and wonderful idea on paper. Try a leadership position yourself and you'll know.
I didn't know shareholder was even a job
@aniksamiurrahman6365
I think you're both wrong; ai can make everyone a CEO, which makes the concept of a ceo kinda meaningless
As a software engineer myself, I can't wait for this AI to do our work for us! Once this evolves enough, I can just sit back and relax in the cardboard box I call a home, and beg for money as this machine replaces me and my money, working gracefully as I slowly starve to death!
What a time to be alive!
Same brother
If this becomes really good, someone will tell it to make a free and opensource version of itself.
Had a time to look into it, and was it's mesmerizing to use this tool. But still much more works need to be done. Still in WIP
"I'd like to submit a pull request on your AI project git."
Guys, nooone getting replaced just yet. The cost of integration for this technology is too high. It is simply a tool to use to fix simple things, to free up time for more important stuff. Imagine the tech debt and other bugs being fixed instantly, so that you can spend all your time on exciting new features. That's the future we're going to look forward too! (We've got at least 3 years to go until it can replace the exciting stuff too)
What a time to be a software engineer!
Oh wait
Could you please have more than 2 thumbnails? I always think i saw the vid already when it pops up in my feed
When it was ai art, a lot of coders laughed at me. I'm not laughing now, because I know how it feels to see all that time about to be wasted and not having a monetizable skill, at least to the same degree. I hope both artists and coders will be fine in the coming years.
Time for the government to instate Universal Basic Income
How about we wait at least until the government actually has enough to give essential workers a 4% real wage increase? Mass AI induced redundancy means humanity has the resources to produce more goods and services than it needs.
@@virgilxavier1Fun fact: at least in the US, there's already a ton of money that the government has which can be used for either UBI or wage increases, among other programs. They just misallocate a ton of the budget, like spending 26x as much on the military as the UK does. Our excessive scarcity is more a function of allocation issues than resource lack.
@@IceMetalPunk -- This is such a tired talking point. Look up a pie chart of U.S. federal outlays from any of the last 10 years. The government's spending on social programs far exceeds its spending on the military.
@@mvmlego1212 And yet we still spend 26x on the military what the UK does.
@@IceMetalPunk -- That's a bizarre comparison. In your opinion, what's the _proper_ multiple of the UK's military spending that we should have, and why?
As a software engineer, what a time to be alive!
Pivot into UBI consumer
Soon to be "former software engineer"...
I was waiting for this video ever since the announcement yesterday.
There is so much hype floating around of AI being applied to Software Development, I've tried most of these, in the real world, you spend more time fighting with it trying to understand what to do, they often hallucinate or create crazy code, or way over complicated, for simple static methods, they can save some time, but that is usually lost, when it doesnt do what you need done, and not even talking complex tasks, this video, looks like more of the same hype tbh.
The thing is in dynamic of changes and progress. The same fast grow in quality as in image generation but with time lag in 1-1.5 year
I'm treating this like another subordinate. Unfortunately with a real person, you can teach them the right way... with AI, it'll 'apologize' and hallucinate once more when you're not looking, with great authority and gusto. *sigh*
Given how often I have to correct the answers of LLMs, I have a few years left at least
Scary but imagine if any corporation used just this ai for their entire development with out an engineering team… yeah highly unlikely but it may make it harder to get a software job. Time to get into hardware. 🙃
Don't worry we're putting ai in charge of hardware development as well.
Also a lot of other jobs in marketing, HR, management also get removed. An intelligent coder could run an entire software company with enough capital.
become a landlord
What a time to be alive...with no job!
Great, needed one when things go south, and fixes are just a prompt away!!!!!!!
This is a very early AI "engineer", but it got me thinking. I wonder if one day we could have an AI look at another AI's black-box algorithm and disambiguate it into something that a human can understand and configure.
I think it'll happen with music.
Right now AI creates a whole song, but in the future people will do manual labour seperating AI generated music into the different layers, like instruments and vocals, then it'll create data for AI to do it automatically
As for code, I'm not so sure if there will be a lot of value in having people annotate and explain code, but I think AI will be able to explain the mechanisms of something at hand.
Even now we can ask it to annotate on simple code.
i dunno, but i bet soon an ai is going to make its own programming language that only other ais can understand. so people are going to be telling ai to code something, and they are going to have no idea what it is doing :o
@@ayoCC Music can already be separated into instruments and vocals with ai
I just see this as the next step along machine code -> assembly -> low level language -> high level language ->
there is no hope
Just a few more years and this will be the Future. Local, Open Source, Hiperspecialsed AIs.
With a Controler agent, like this so that we can manage the work th AIs are doing.
I can't Wait.
there was an article on TIME (see r/StableDiffusion) about the US government clamping down on public models
Can’t wait until the time where we can download a new AI made, procedurally generated GTA every other day.
How much time to be alive?
Just imagine where these Terminators will be 2 more papers down the line!
The singularity is approaching, I can feel it
Soon jobs who can handle AI Software Engineers will replace Software Engineer jobs
I don't think so. Because AI software engineers can handle themselves
@@feynstein1004by making the worst mistakes of human programmers as their norm
Probably some overlap between them
I'd bet that Software Engineers would coordinate their work through a platform like Devin.
I doubt it. There will be no need for any software devlopers no matter the field. Even light transport engineers will become pointless once the models can render scenes fast enough. No need to waste money funding research! And thank god, the universities will need the cash.
From what I heard, they went from basically being on par with those other systems, to where it is now in ~8 months. At this rate, in a couple of years it'll be better than most experts.
"... by late next month you'll have over four dozen husbands!" (C) xkcd
So we're reaching the singularity now. We'll soon be able to ask an AI to create a better version of itself
Absolutely not. We are nowhere near a Singularity.
Yup. A lot of people don't understand the nature of exponential growth. At this point, the singularity is eminent, and our society is not yet prepared for the consequences.
I'll ask it to create a better version of myself.
@@yahiiia9269 True. Also they have no idea what generative AI is and why it sucks. It makes me depressed every time I peek to the comment section on this channel. 😑🔫
@@merowing8588why does it suck?
This is great! I can see the average person without a CS degree automating tasks that would have required a team of 5 by 2030. Maybe it, or something like it, will be integrated with Model 5 (I don't know if it will be a transformer) from OpenAI. Same for Google, Anthropic, and everyone else.
Giving people the power to customize their existing hardware without having to undergo specialized training is great.
you meant "not so much time to be alive" 💀
Every time the author says "What a time to be alive!!!" I always smile. I tried to restrict myself. I failed...
What a time to be alive!
What a time to be AI!
This is not software engineering. This is programming (a coder). It's good what they have done. But it is NOT software engineering. It is not doing any requirements engineering, it's not building a specification that is then signed off but the customer. It's not creating a testing schedule including the acceptance criteria.
@@RichardEricCollins did no code or low code tools, that have been around since years, replace software engineers and web developers? Absolutely not.
Love it!!!!!!!!!!!!!!!
Time to build the paper clip optimizer.
Could you make videos about more nieche papers? I feel like this channel has went off-course, and only covers hyper well known topics
hell no, this is exactly what I want
Agree, but this is what brings the most attention sadly....
No one wants the garbage news
To be fair, looking at the channel name, he already did at least two minute papers.
Therefore, he can now only cover hype stuff because they are not minute.
First AI computer programmer. Thanks!
You're such a good explainer that, after watching one of your videos, I understand everything except for how to pronounce your name!
The jump from 4% success to 14% in just a few months is quite amazing, as is its seemingly greater ability to automatically improve AI models. This feels a lot closer to an ASI loop.
automatically improve under what criteria? You can run anything to "train it" but the problem has always been bad/irrelevant data messing with the results
We need some sort of benchmark for that - 0 for hello world 10 for a feature complete operating system I propose.
So... is this AI being used to improve itself?
the only way to improve AI is computation power and invention (maybe soon AI can invent more than human do)
No, obviously it cannot come up with novel AI architectures. It should only be able to deal with already known ways to create AI, it won't be able to come up with true innovations yet, which requires a degree of true creativity (instead of an interpolation of preexisting ideas) coupled with experimentation, something existing systems can't do yet.
Maybe next year.
Totally autonomus IAs that improve themself and build new IAs.
13.86% sounds like still not that great, but consider that the problem set was specifically selected to be very complex and tough. Across three full spectrum of SE tasks it’ll be able to handle a LOT higher percentage of real-world tasks.
- And as long as it has tests to verify correct functioning, offloading 14% of the toughest problems would be a huge win. Just let the AI take a pass over all the outstanding PRs, take care of the maybe 30-40% it’s able to handle and let the humans handle the rest.
It would be very interesting if you did a video about a company called Verses AI. They are taking a different approach to AI, distributive intelligence, and will be releasing a beta version of Genius this summer. Very interesting...
4:46 I'll add it because he didn't say it "Remember the first law of papers- it is not about where we are now but where we will be two more papers down the line. By then, this might be up to 70%"
"great! but can it make doom?"
It would be nice if you linked to the research in your description.
Google?
what a time to be alive 😅😐😶😶🌫
Saw a video today about humans becoming redundant. It talked about how self-driving cars are not in the future because they are already better drivers than humans and computers are doing computer programming tasks. Fair enough. But since the video was 9 years old it goes to show how timelines are hard to predict.
It did make a good point that people who say technology won’t make humans unemployed but will instead create better jobs for them are overlooking the fact that over a hundred years ago you could say the same thing about horses. Technology was replacing cavalry war horse jobs and farm labour horse jobs which are hard and dangerous but jobs pulling milk and deliver wagons in cities were being created by the urbanization caused by fewer people working on farms-much nicer work for horses. That worked for a time. Then horse populations peaked in 1915. Horses didn’t become unemployed, they became unemployable.
we should go forward to monke
This is the worst it will ever be
Imagine where this will be 2 papers down the line!!!
RIP Programmers!
so cute ai youtuber makes video about fellow ai engineer
I wonder what will happen if these tools get to the point where they can write any type of software. It doesn't seem like it would be monetizable. If you charge for a tool that can make anything, then what would prevent people from using that tool to make a version of itself that can be used for free.
Looks like words will become more important because you still need a vocabulary to describe what you want to do. Like with the AI that generate art. A person with knowledge of different art and having the vocabulary to describe a problem more precise will be much better at designing a prompt in comparison to a person with a software engineering background.
A lot of people are accusing the company behind this as being sham. I wonder what coders outside the company think
As a developer who doesn't work for Cognition, I don't think it's a sham. I also don't think it's taking developer jobs away any time soon. I would love if an AI could solve some of the more difficult challenges I have at work, but so far they all fail hard. One big problem is that new versions of dev tools are released faster than AI can keep up, so AI just hallucinates to fill in the gaps. Also, AI is not generally creative, so it's much better at solving problems that humans have already found the answer for. Some day I might have to worry. But not today.
Their claims are not incredible. I expect something like this to exist by now. And it will only get better, pretty quickly.
As soon as these models are able to solve problems that do not exist in their dataset through better reasoning, this is where we'll see an increase in problems solved that are harder and possibly not even a part of the dataset. However, no one really knows, apart from maybe people that create these models how close or far we are from that.@@andywest5773
What will humans do for work when robotics and AI eventually replace us? Genuine question. Unless this stuff is strictly regulated, it'll just keep being used by corporations to slowly remove humans from their industrial equations. If we have no way to work, what will we do?
Naaahhh, evil companies/CEOs won't replace us because robots can't suffer because of the work 😅😨
shh, youre not supposed to ask that. Its crazy how little attention that question gets
Answer: we will do whatever we want. What we actually enjoy doing, rather than what other people require us to do. You know how you enjoy vacations, and if a vacation gets a little long, you find something you enjoy doing to break up the monotony? It'll be like that without the interruptions of "obey someone else's demands or starve to death."
We will create a post-money society... or we'll drive ourselves extinct. But that's our choice -- whether we want to care about other people or remain greedy -- and it's not the fault of AI if we decide to remain dicks until our deaths.
Good luck persuading those on top not to be greedy 👍@@IceMetalPunk
Selfdevelopment, rising childs, politics.
4:06 AI training a different AI, what a time to still be alive 🤖👀😬
These LLMs have saved my business a ton of money just this year alone! No need for daily scrums and no need for healthcare! Just like a remote developer but free and it will do what it's told. Perfect little AIs! The future is bright!
What a time to become a farmer!
1/6 is super good.
Im studying programming 💀
Keep at it, and good luck! It's a great field of study 😁
I'm sorry you had to be born at the worst time to have a future.
could you please link the research paper?
I kind of miss the days when these videos would focus on techniques more than products.
When you don't want to work but you are an engineer:
I'd trust this AI developer a lot more if it had been able to even create contact form for requesting access to it. Currently they still seem to use Google Form for requesting access.
While I understand where you're coming from, I'm a software dev at an animation and game dev studio, and our IT department sends out Google Forms for basically all info gathering. I'm also the only one in the dev department (pipeline dev) who knows anything about web dev; everyone else only knows Python plugin and desktop tool development.
So I'm not surprised if the AI devs have specialized so much that they don't know how to make a good web UI or backend.
These are just some coder nerds. What do you expect? Professionalism? That will come later when somebody buys them.
@@PyrioldAs a professional coder nerd, I mildly resent that characterization! 😝
@@IceMetalPunk Yeah, but remember that they are claiming that they have an *AI developer* - wouldn't that mean that they don't need to mind about developer salary?
@@MikkoRantalainen Who said anything about salary?
i hate partly relying on AI now
and I love it as well...
this is amazing! So many people with less software engineering experience will be able to make custom applications someday!
U need brain
It's a real shame to be replaced by AI. Now people with no skills will be able to use it to make money, but without it they'd be nothing.
@@dynastykingthereal just like without computers, many people would be nothing
@@ayoCC you need brain too 💀 even for computer you need skills to operate it do stuff
@@dynastykingthereala person with no skills can not verify that the ai output is good and be responsible for it
But can it win Code Wars?
Devin has been debunked, finally a time to be alive.
Software Alone : Deviiinnn!
If it’s not in my code, do I need to fix it?
Fuck this future.
They haven't compar3d with Gemini ,IDX or AlphaCode for some reason. Also I have a strong suspicion this release might be overhyped like the gemini release. We need to test Devin ourselves to check its worth
I just got my masters in computer science a few years ago, and bought a house... this makes me sick. Its the same for dalle and stable diffusion, and self driving cars. what are we supposed to all do for a living? How are we supposed to afford homes? Huge portions of the population are gonna be unemployed due to all this stuff and no one is working on a solution to THAT!
That's how bank employees felt 30 years back...
Friendly fire! xD
When it came for the artists and I did not speak out, but now it's coming for me. I am scared. But honestly most good programers probably can adapt.
13.86% = We're in charge - it's just a tool
100% = We're not in charge - we're looking for work
I like how engineers are so desperate to make themselves obsolete.
Engineers are just humans. They want to maintain their quality of life and if possible, get a better quality of life...like all humans do. Currently, the investment market awards people who can generate the most profit, and in the 21st century, the best way to do that is to cut costs. It's really that simple, unfortunately.
Not themselves, but other engineers jobless 🤣
Personally, I'm excited for making all job requirements obsolete. Whether we allow that to happen, or kill ourselves fighting to hold onto our greed and selfishness, is a problem for us humans to decide, not AI.
Engineers are just passionate about tech progress, hence selfless. Thing is being passionate also means knowing the subject, and already planning a few steps ahead.
@@n0madc0re This is a situation where paradoxically, being selfish instead of selfless would benefit the majority
just an assistant - but surely it wouldn't take much to get it to decide what apps it would need to write to achieve its goals, and create them.
I'm lucky, I'm a "senior" engineer
2045: AI takes over the entire world and humans have no jobs left to do.
What a time to be jobless. Fantastic!
Watched video…. Amazing ….
Prepared for comments as expected "AI taking jobs" ….😂😂😂
No first law of papers...
Are we at two more papers down the line?
Jensen Huang met Devin
Then we just need to make an AI QA agent and boom, it's like a living GAN for usage rather than training
AI training AI sounds like it could go the way a lot of people think it will. 😅
Goodbye world
the question is, will this company monopolize human work or they will help open source communities by helping them to solve bugs and unsolved programming logics, etc.
It seems that they didn't post any technical details about Devin. Instead, they post a few demo videos. 😶
Devin Devout
In the not too distant future: “The AI has learned how to improve its own code!! What a time to be aliiiii…” *drops dead*
Is not the "first", not even the second. So much hype behind a company heavily funded while others that did the same months ago remain ignored. RUclips as shitty as usual.
Time to respect the lesser jobs and survive with them.
AutoGPT was ahead of its time...this tech was available 1 month after ChatGPT was first launched. Now, people are just reusing what was already discovered.
I LOVE TWO MINUTE PAPERS !!!
I just want an AI that can install from github or colab with a crazy requirements list from readme instructions, all dependencies and whatnot, and let me know when it's done..........
I see they have a cool presentation but their report says it was tested on SWE-Bench and got 13.86% success rate which means other 86.14% cases failed. Additionally, the SWE-Bench is just 2K of pull requests only just from 12 python popular repositories. So I'm a bit confused: the presentation looks cool, but their report and the possibly the testing dataset itself are not that cool as everything seems to be. Do I miss anything?
You missed the part where the current state-of-the-art performance on SWE-Bench is far, far lower than 13.86%, even with extra human guidance.
I am glad that I did not decide to continue career development for computer programming.
If it can make your job easier, it will also make it irrelevant.