How TikTok dances trained an AI to see
HTML-код
- Опубликовано: 24 апр 2023
- And remember the Mannequin Challenge? Yep, they used that too.
Subscribe and turn on notifications 🔔 so you don't miss any videos: goo.gl/0bsAjO
The quest for computer vision requires lots of data - including real world images. But that can be hard to find, which has led researchers to look in some pretty creative places.
The above video shows how researchers used Tik Tok dances and the Mannequin Challenge to train AI. The quest is for “ground truth” - real world examples that can be used to train or grade an AI on its guesses. Tik Tok datasets provide this by showing lots of movement, clothing types, backgrounds, and people. That diversity is key to train a model that can handle the randomness of the real world.
The same thing happens with the Mannequin Challenge - all those people pretending to stand still gave researchers - and their models - more real world data to train with than they ever could have hoped for.
Watch the above video to learn more.
Further Reading:
Here’s the original project pages for each researcher in the video:
Tik Tok aided depth: www.yasamin.page/hdnet_tiktok
Mannequin Challenge: google.github.io/mannequincha...
Geofill and Reference-Based Inpainting: paperswithcode.com/paper/geof...
Virtual Correspondence: virtual-correspondence.github...
Densepose: densepose.org/
Make sure you never miss behind the scenes content in the Vox Video newsletter, sign up here: vox.com/video-newsletter
Vox is an explanatory newsroom on a mission to help everyone understand our weird, wonderful, complicated world, so that we can all help shape it. Part of that mission is keeping our work free. You can help us do that by making a gift: www.vox.com/contribute-now
Watch our full video catalog: goo.gl/IZONyE
Follow Vox on TikTok: / voxdotcom
Check out our articles: www.vox.com/
Listen to our podcasts: www.vox.com/podcasts
This is the fourth of five videos Phil is doing on the ins, outs, and struggles of AI! Watch more of our robot revolution coverage by checking out our AI playlist here: ruclips.net/p/PLJ8cMiYb3G5ek1Ux66aJ_qWf6CfBaAkGG
Every time I watch this kind of videos about AI I can't avoid to wonder what gives them the right to use open internet data? (not the legal one as that depends of the rule: money vs people), how the military is gonna be using this who is financing this projects and what other ones behind scenes. Technology has been always used to do what it supposed to do but also to control societies/communities.
Does researchers and all the people involve in the creative and technical process even question themselves before just doing, what is gonna be used for, who will have the possibility of use it and how could affect society in general but also particular communities like workers, social classes, genders, etc. "If I don't do it someone else will" can't be the base of economic and technological research/advance.
Can you do a history of why Sudan is having a civil war
Sorry if I am not compatible with this hype, in the past ~25 years I have worked on dynamic knowledge management in information systems as a developer, architect, analyst, and a few years ago even as an academic researcher.
I so much want to see a world that can tell the difference between _learning_ and _adaptation_ - machine or human, does not matter. A world that realizes that LLM is AI only if that acronym resolves to Automated Ignorance. A world that finally calculates the carbon footprint of this global masquerade before moaning about resource crisis. Until then, we are just "Amusing Ourselves to Death", as Neill Postman predicted.
_PhD research on TikTok dance "AI"... epic._ 🤦
*struggles of Tiktok trying to be unbanned 😂😂
Forcing an AI to watch countless hours of TikTok is definitely how the robot uprising starts
💀
It will help with that!
Now we're closer to getting 99% accurately shot at by robot soldiers! ^u^
@@casper6014 I meant that global leaders are going to get some ideas, but that's also very true.
skynet is incoming
And now we cannot even blame them.
Using old Mannequin Challenge videos for training a depth prediction model is such a wildly clever idea! 🤯
The most genius thing for death
Art n science is brilliant
You have to wonder if the CIA or some academics are behind some viral 'challenges' or TikTok dances.
the most genius thing for the end of life as we know it 🤗
Thats why you use social media platforms free.
i really like how phil is so personable, it feels like he's casually having a conversation with just me.
a great presenter
A great orator and educator aye?
@@KobrokoHere brothel
And he's an absolute zaddy.
@@Becausing 🥵🎉
Check out his personal channel too. He has tons of great videos like this on a whole variety of topics.
I believe that the challenges are a way to collect data to train AI.
Not just TikTok,
People share photos from their childhood, teens and adult versions. No wonder how good those filters work 😂
Some challenges are just in line with AI data projects that I’ve rolled in.
do ppl do earn money on this and those who posted their photos dont even know? Or are you being asked for permision if your eg tic tok is being used for AI training?
@@hervva No, you're not.
@@hervva the terms & conditions my friend 😉 (no one reads them unfortunately)
TikTok is already suspected of using user data for Chinese surveillance, so I wouldn't be surprised to find out it's being used for other less wholesome predictive algorithms as well.
That’s actually insanely cool. A bizarre social trend from years ago becomes the weirdly perfect dataset for these computer vision models. Those researchers literally couldn’t have asked for better
Plot twist, they were the ones who created the trend in the first place
@@cheesybirdmess7349 This is what I was thinking about. But in reverse: What trend should we start next to create another, even more amazing dataset?
@@cheesybirdmess7349 That actually may be true. AI development started in 2015
@@cheesybirdmess7349 It’s not a plot twist lol it’s the reality
Phil's shower dance is 100% ground and life truth
Never thought I'd see a day when the mannequin challenge becomes useful.
Never thought Napoleon Bonaparte would see the day Mannequin Challenges come into existence period.
The whole point of tiktok has ways been AI. People fear China getting stronger than us, but you’re helping them every time you use that app. Great job.
Everything is a training set. You use to be an advertising target, now you are a training set.
or both
😂
Bingo.
Talk about data privacy though 😂
I was just wondering this, kinda scary
@bigfishh Its probably hidden in Terms of Services . Pretty sure 99.99% of people just click agree on it and unknowingly give their data.
New drinking game: Take a shot whenever you hear "ground truth" while watching this video.
It's scary to think that AI companies can use data like this even if it's to train an AI. I guess it's the same way with how image generators like Bluewillow was trained with a few differences.
Though the methodology is fascinating, the actual question is what will this research be applied on? I can imagine predictive vigilance and ever-expanding tracking and warfare capabilities. It'd also be nice to know who has funded all of these researches.
Lol it’s not that deep, this is mostly object extraction. A lot of new phones have that feature where you can grab the silhouette of things out of pictures and it uses similar CV techniques. Or this can may be used for image segmentation and helps AIs understand what objects are in pictures and how they relate to each other spacially
"the actual question is what will this research be applied on?" The better question is what *won't* it be applied on, it will help in alot of things from consumer things like VR to important things like 3d medical scans, to forensics, etc. These research are made to benefit as much technologies and occupations as possible.
@@casperguo7177 Oh buddy, are you familiar with Clearview AI? I got some bad news for you...
🐻🍯
TikTok funds itself and we know exactly what they'll apply it towards: making their app more addictive and their ads more profitable.
If it's free, then you are the product
More like the customer, you just don’t realize it yet
I mean even paying customer are products cuz they contribute to the overall statistics and data that can be used in mass social engineering.
In this capitalistic techno hellscape, everything is product 😅
I appreciate you guys showing the titles of the papers you’re citing, other channels could learn from this!
I never downloaded tiktok way back when it was being advertised a ton on Snapchat because my assumption was that it was the “dance” app was going to be used to aid AI in understanding body movement for the Chinese government to further improve their I.D. tools on an individual’s gait and other identifiers. This just further reinforces that the original purpose was not a fun dance app.
all social media companies sell data to the government & other companies, so facebook, instagram, youtube, and tiktok are all equal “threats” regardless of the country of origin.
Imagine if your entire purpose in life was to watch tiktok dance videos endlessly.
When the robot uprising happens I bet this one will be extra cruel in return for what we made it do 😂
in my opinion it's better to watch something different than something the same over and over again
@@clydencee just trained a model for half a year CPU time last week and it looked each of 5,000 photos over about 100 times. So yes, I concur
I'm loving these AI-themed videos from Phil!
ikr, Its fascinating but also scary at times.
Imagine if this video was AI generated and it turned out Vox was never real to begin with
That would be very scary bro 😭
Yes
Don’t most people post things online to communicate with friends or have fun? When did we sign up for collecting data and training machines?
It's a free service so they collect data to sell once we accept their ToS.
Soon as you click “Accept” Terms and Conditions 😂 Should’ve read it before clicking it
when you agreed to the TOS
Have you heard about facebook?
You didn't. You signed up to enable them using anything you post on there. That's true for Facebook etc. There was a case where a picture posted by somebody on facebook was used as an ad.
As people have pointed out in the comments: we don't have to accept that our personal data, our images and videos can be used by anyone for any purpose. Doing research is great In many countries it is allowed to use most data for that purpose. The problem begins when said research is sponsored by a for profit company and is used by them for generating profit. That's a loophole and it's been abused for the last years.
AI image generators like Stable Diffusion, Midjourney and the others have abused this loophole to create their product that's been developed on the data they have no rights to.
No matter how cool the technology is, we have to protect our rights!
They are also entitled to the right to panorama.
Personal images made public like a person's medical information or home are a real privacy concern, but I hope you don't think every online artwork and doodle great or small should be immune to future projects like these!
@@kmjgsdkmjgsd Every piece of information in the form of text, image, or audio we post should not be used without vocal consent, period. It doesn't matter whether it's something important or silly. We can't pick and choose where we decide to apply the laws, and where a company can wave them away in the name of progress.
@@septiquaddoubleyou4019 what is the right to panorama?
From learn, to exploring how to, i love how the tech esp AI is rapidly growth
"The machines - they are learning but for now, we are still the teachers..." Cue dramatic dystopian music.
This makes the mannequin challenge even more fun than I realized!
I can't imagine the time it consumes to train the model: I am training a model to predict emotions in reviews and it takes a lot of time of computing
I don't even like tiktok or dances, challenges but this is wild. Also, great video guys 🎉
It's really cool to see my current research direction summarized in a video. :D
Can you make a video about the rollout of digital IDs in some African states and how it threatens a variety of human rights?
I'm not understanding the end goal with AI. What are we trying to do here?
it's a large datasets of how humans move in 3D space. In war, Chinese robots will be able to distinguish humans thanks to having seen millions of humans from different races and heights dancing (moving)
The "wait for it" training the AI.
Never thought Mannequin Challenge can use on it!
This will be great for diagnostics
But also for surveilance
EVERYTHING ABOUT THIS HEADLINE MAKES ME WANNA BAN ALL OF IT GHAAAAAA
3:25 hey I thought that was my secret dance
when your dancing could be training a military drone to detect targets
Never would have expected that tik toks can be considered a valid source of any sort of truth 😂
Is beautiful when art meets science
Until it kills art.
Great Vid! Completely unrelated but hoping you'll answer, what watch are you wearing in the video? Looks like a casio but curious about the model and the strap. I really like it 👌
What happens once an AI can make its own flash cards?
This would make such a good conspiracy theory
Datasets are really important for AIs that utilize machine learning such as Bluewillow AI or other models. Otherwise, responses come out fuzzy.
Wonder how that one program that can fly though environments from just a handful of pictures factors into this
WHERE IS THE OUTCOME! WHAT DID IT GENERATE?
One day machine will: I am the teacher now.
Love Phil Edwards! This guy is born to teach
They didn’t “use” the mannequin challenge, they created the mannequin challenge.
who is they?
@@itseveryday8600 big pharma
@@itseveryday8600 the lizard people
TRANSFORMING A 2D ENVIRONMENT INTO 3D ONE LIKE ENTERING A PHOTO?! INTERESTING OwO
and this is how skynet started in the terminator
Chinese gov: This is good, this is really good. I'll take it from here, TikTok. Thanks!
That poor researcher had to suffer huge amounts of IQ loses while she was gathering data at the universe's deepest abyss, Tiktok
The next evolution of AI really needs to be built with a layer of 3D modeling. Blending the intersection of what is known from 2d planes of existing models with an understanding of how those planes map into 3d spaces would be a massive leap forward…not just with people, but essentially any object.
It’s already being done.
"Crying in the shower"-dance is the best misunderstanding of how Tiktok works yet.
Excellent explainer.
Social media had real benefit for a change instead of being used to show off, brag, rant, or troll.
TikTok for moving people and still backgrounds. MC for moving backgrounds and still people. You could ask for a better unexpected data set.
Essential predictive models for training killer micro-drones/nanobots to find earholes and nostrils
And now that computer ended up getting cancer. An impossibility? Not anymore.
For an art project, I used an AI that was trained to estimate the 3d depth estimation of a scene.
Guess what is is trained on: 👇
Well, many datasets but mainly:
Street scenes from car cameras.
There's enough material to make an AI guess what the next frame "moving forward" looks like (=what is closer and further away) and then check how accurate it was.
@Zaydan Alfariz 💀💀💀Nvidia stole her work
we should all be compensated for being data sets to proprietary software...at the very least.
Why, when millions of people will just do it for free?
This kind of technology will make it possible to build 3d game worlds from real video and photo. The next Google Street View could be a 3d game environment (using all the images and videos available). Imagine fusing Google Immersive View, MS Flight simulator and GTA...
I’m really loving this series!🤖 🧠💃🏽
For some reason this video does not appear on my subscription feed, I had to look for it.
why is there an empty glass in the shot!? I kept waiting for it to be a part of the video.
Seems fun but there’s a TON of use cases for body positioning from a film , without complex 3d cams.
*Not Vox desperately trying to find something positive about tiktok* 💀
AI for Science Engineering ...STOP STUDYING US
Funny to think that we are watching some of the last non artificially generated images on the internet
2023 is really the big shift
We should change the world calendar to BC (Before Covid) or BT (Before TikTok) 😔
Here's my guess as to why tiktok dances would be a good data set, It has a huge library of people with different physicalities all dancing in similar ways; but with a wide amount of variables, however when people dance for tiktok they have to stay within the vertical rectangle of the phone camera which cuts off a lot of the background if they want to be seen dancing well.... just a guess?
Authoritarian regimes will love this! ^_^
I only came up with 2 solutions. The easiest is game engines. Instead of creating a functional game you only have to create a realistic setting using 8k textures for object permanence recognition. The harder method is to build a body for A.I., it doesn't need to be a human body but something that can move and pick up objects. With proximity sensors, cameras, lidar, gyroscopes, pressure sensors, and a weight scale the a.i robot will be able to move around an apple, pick one up and know it's size weight speed distance hardness etc... and be able to use all it's robot senses to try and identify an object instead of just pictures. The benefit of doing this is that a robot would be able to gather its own data set in real time using the real world as reference.
I love your videos they are always fascinating. So when are you gonna pull a Johnny Harris and start your own channel?
i'm sure they compensated each of the tiktokers for their contribution😂😂😂
This is an awesome video!!
Suprised that the experts didnt jump out the window watching that many tik tok dances....the horror
Finally an actual important use of TikTok.
Learn to see us… and imitate us. I guess I’m worried about what that will
Mean ultimately.
Hmmmm- the mannequin challenge- how convenient- Stop getting played everyone-wake up while we are still the teachers 😉
It's SkyNet I tell ya. It's gathering data to finally launch a global attack against mankind *puts tin foils hat on
But like, what is the use case of all this?
I think there are use cases for AI, but I fail to understand the use case in these instances, lol
omg the mahak cameo
The man just declared the entire section of unsupervised learning useless in a video about tik tok😂
i wonder how long it will be until humans are no longer the teachers
Nice ending, We can still have faith in humanity (?)
Seems like TikTok can be useful for a great cause. We can see here just how AI is developing.
I wonder if that how they trained NeRF which Corridor Digital showed
The fact this video completely ignores the underlying fact institutions are using videos of people who did not consent to being fed into a database is pretty grim. Aren't universities supposed to care about anonymity and consent in their research? Jeez
I agree with you, but I’m pretty sure everyone on TikTok agreed somewhere to waive their rights to videos they post on their platform
TikTok videos are public domain
"Aren't universities supposed to care about anonymity and consent in their research?"
do you know their identities?
They actually did and it is on every social media when you create your account and click I agree.
لقد تاب اللّٰـهُ علىٰ من هو أغلظ منك جُرمًا، وأشدُّ منك ذنبًا
فلا تقنط من رحمة اللّٰـه.❤
Probably improving Chinese CCTV technology as well
4:57 Holy shi that's impressive!
The graphics are pretty, but the moving noise completely ruins the image with the low bitrate. Consider changing that in future videos.
What is the moving noise?
You sure it's not the aesthetic?
@@thepinoz The graphics from 1:02, background has moving noise which is a part of an aesthetic that usually visually emulates screenprinting technique, but is totally inappropriate for use in video.
I was enjoying this video right up to the point where you shown James Corden
Imagine the comments if this video happened to be shown on Xinhua news instead of Vox.
2:12 "AI can learn how people work..." In my time people were used to learn how machines wored instead
Interesting how just when a new AI learning requirement appears, a new security check or TicTok challenge appears. First, proving you were not a computer by identifying barely readable text turned out to be instigated to also teach an AI to correctly transcribe scanned text. Next, proving you were not a computer involved identifying which cells in an image contained a select object, turned out to be Google's AI being trained to recognise objects better in Street View scans. Now, AI needs better flash cards to recognise people and render them properly. Will this be for AI police, government remote identification, or to completely put people out of work by fooling people they are actually talking to a real live human being online? Sometimes, it must make you think, are we already being manipulated by AI to train it better?
But doesn't the mannequin challenge generate a lot of inaccuracy? Even slight movements will compromise the precision. And I believe using scenes from tv shows like friends that may have an even worse effect, since sometimes the shot and reverse shots are not filmed simultaneously and can have major differences.
"Even slight movements will compromise the precision." why would it need that much precision?
Ah yes, mannequins.
Turns out Big AI was behind the mannequin challenge the whole time!
I made a Tick Tock, called I cried in the shower this morning.
I always forget that there's the whole dance section of tiktok. Never touch that area.