I’ve never seen Marquess been blown away like that with a tech demo. First few seconds you can clearly see him trying to figure out how they were doing this. That’s impressive
I can see this being super useful for telemedicine. A medical-specialist-doctor-expert person can be a world away, but if they can "meet" with you using Starline, you can show them the weird rash on your elbow or your crushed hand or whatever, and they would be able to see it so well, the only thing missing would be touch. That's important too, especially for orthopedic and internal injuries, but you'd be at a hospital that had a Starline booth anyway, so a local RN or doctor could follow the expert's instructions WHILE THE EXPERT WATCHED AND COACHED... I think this will have huge benefits for telemedicine. Not to mention surgery training! Um, I'll let your imagination take over, but if you're a surgeon intern...!
That's a very good point. Reminds me of Children of Men/GITS holo displays. Parallax Hall effect needs to be more prominent than simply being a gesture for phone wallpapers. 😮💨
Internal injuries?? The doctor must be there to examine you. Surgery trainings?? Think about what you said again, man. What kind of surgent will you get by virtual trainings?
Probably the best use I can imagine is nursing homes, hospitals, where one of the people is bound to one place, so the relative could just come to a public Starlight kiosk and dial the right device. Also a great way to communicate with people in medical isolation, during interrogation or with prisoners to ensure the safety on both sides.
While working at Google, I had the opportunity to take many of my 1:1 meetings in booths like this. It was wild - you legit remember those meetings more, and no zoom fatigue!
That's crazy Billyfx! I'm definitely feeling a bit jealous you've gotten to try something like this out. Ok... *asks Chatty-G "Tell me how to get a job playing with emerging tech?"*
Super proud of you MKBHD. The fact that Google gave you access to something like this, and being the first outside of Google to see it, is impressive. Shows that all the hard work you have done over the years is paying off. Seriously good stuff
I was constantly thinking about the 3DS, specifically the new 3DS while watching this as well because it had tracking to make the 3D effect better too.
The New 3DS felt a lot like what this is with the glasses-free head tracking 3D. When it worked well it worked *really* well. Project Starline feels like the next evolution. Almost like if the 3DS had dual front facing camera and video chat.
@@podracer35 I'm still disappointed that I only ever got an original 3DS and not a New 3DS. The eye tracking would be so useful, especially for games that take advantage of the motion controls. I might get one just for that lol, if I ever start to care enough to spend money on it
@@petemiller2598 yeah, same. It's a shame the 3D was not used enough by third party devs to the point where they made the 2DS XL (which is pretty fantastic, even without the 3D)
@@SoarMallardhat required the Screen to be divided into odd and even sets depending on the view. It the whole reason 3DS technically has a 800x240 physical screen but only renders at 400x240 to accommodate the 3D. This looks like the screen adjusts the viewpoint relative to the head position without needing specialized screens.
I think this could be incredible for virtual doctors visits. Would make them feel much more personal, and greatly increase the experience for both doctor and patient.
Great point. My mom did a "virtual Physical Therapy session" the other day and this would've been soo much better. Only problem would be that getting this in your house in the first place is probably unreal expensive.
I was thinking therapy appointments for people who move a lot. You'd be able to keep the same therapist while minimizing the detachment that comes from remote sessions
As a senior med school student, I can only imagine how this kind of technology could be implemented in telemedicine soon. Props to Google for this one.
Too big and expensive to replace your typical Webcam, but this would be a great idea for a private booth at say your local pharmacy. Have a quick Tele-health call with your doctor and have a prescription filled all before leaving.
@@aryav.1108 It probably won't, it does not add anything more than what video call already has (medically wise it even reduces information), but it is more realistic to look at, seems like gimmick for now.. Maybe I am wrong, but it is not practical compared to its benefits, just high fidelity video call... I like 3d movies though, wish that kept on going more... Also regular 2d video call in hi res would be more helpful in medicine, for distance (showing wounds, skin conditions, etc...)...
This would be really great for remote counseling. I imagine a world where maybe only professionals own their own setup, but then you could go to a center and rent a room to meet with them.
Sounds super cool, read so many sci-fi books with a similar concept. I could see a variety of consumer uses for these Google sites or maybe even a sort of phone booth setup in your local target.
This is what the Metaverse should be. Making virtual meetings feel like in-person meetings to your brain. Could really decrease “zoom fatigue” and meaningfully improve remote work.
Yeah well META might change back to just Facebook and it’s parenting companies like WhatsApp/Instagram. META is dead and no one bought into the idea. That is why they just fired over 10,000 employees it’s too late. Google is now going to become what the metaverse should’ve been
Think about the precious memories that could be recorded. A mother could speak with her child who's away at college, and 30 years later, they could replay that interaction and feel as if they were back in that moment. Picture a younger version of yourself, speaking to your older self. A father's final message to his son could be played back as if he were still present. Wild right? Imagine a future where this technology could instantly translate different languages, even imitating the speaker's voice. It would revolutionize communication. I'd love to see this in schools; just imagine a student meeting a penpal from another country "in person". I would go out my way to use such technology like this if it enabled me to connect with distant family members in a way that feels deeper than a regular zoom call. I am certain this technology will be adopted in hospitals and corporate meeting rooms, but I'd also love to see it in public libraries, households, even dorms. I am genuinely excited to witness what this tech could do in our lives.
My fiancé is a psychologist. Pre-pandemic she said that a practice like hers would never go remote. Obviously it did and we were able to move from Washington, DC to Vermont. That said, she still spends a week or two in person because so much is lost when remote. I can see a scenario where she sets up a system like this in her DC office giving her clients the opportunity to have a near-match to an in-person experience. The same is true for other areas of healthcare where the meetings are 1:1 and there is a massive value to creating a more intimate human connection. I am a singing teacher and here to, my practice could justify the expense, I could live where I wanted, but have a studio in an area where there are many clients, or schools could put these setups in practice rooms and bring in teachers from all over. I expect that it will be a long time before setups like these are part of everyone’s home, but there is a clear, exciting use case for small businesses that have already expanded their reach with remote tools, but are suffering from the current quality of the systems at our disposal. Thank you, as always for delivering such precise, useful content!❤🎉
My first thought was mental healthcare. I did see a counselor during the pandemic and it was mostly over the phone and that's not at all the same as it is in person. But this would for sure make it more like seeing the counselor/psychiatrist/therapist/psychologist in real life.
This sounds like an awesome use case! My initial thought though is user privacy and confidentiality for things like psychology. I'm sure whatever software is running this technology will be all cloud based to begin with, so making sure we're not just sending Google our most private conversations will be important. Interesting problem and I'm excited to see where it goes!
What an incredibly cool bit of tech. Video chatting always feels a bit off because of the whole lack of presence thing and this looks like something that could help solve that. Neat stuff.
someone figuring out the eye contact thing would be a game-changer. i always thought it would be under-screen cameras that would do this but the ones all around the screen would work too.
@@nadeemshaikh7863 If this thing ever goes to mass production, I see no reason why it should be extremely expensive. It has a few cameras & microphones and a screen. The magic is made with computing.
This kind of tech is really exciting to me as someone in the health sector. Once it's more affordable having these sort of booths in regional/rural health centres would enable practitioners from anywhere to have more meaningful consultations with patients/clients. Things like phone and Zoom counselling over the past few years has become more widespread, which is great, but it's still highly limited in ability to connect with the person you're talking to and in things like psychology the connection between client and practitioner is often as important, if not more, than the treatment modality. If you can get one of these things mobile on the back of a trailer you could enable people driving from small rural town to small rural town and allow them to consult with GPs in major cities for more things than current zoom/telehealth options allow. Very cool possibilities and I hope we get to see more and more improvements and cost reductions asap!
@@sciteceng2hedz358 I imagine to one client would be really expensive, but you could have a psychology center in one big city and have those screens in smaller villages.
Yeah but do you really need the 3d capabilities. In my opinion having a big screen that can render the person on the "other side" the proper size and a good enough camera + microphone setup is good enough to make you feel like the person is there. Think about it, if you do a zoom call on your phone or laptop you are mostly looking at a small head. Interacting with a human sized image with a torso and arms is a completely different experience and the technology to do it is already available and cheap. Having the 3D experience is really cool but I don't feel it adds that much
@@FakeButt If you're just talking with the person, that's probably true. But if a health professional was trying to do a remote examination, having the best possible visual representation would be important.
Some part of me really values the little glitching or geometric shimmer around the edges of the models. There's something deeply charming about a not-quite-perfect simulacrum of the participants that is just weirdly compelling. A perfect version would indeed be futuristic, but the little scuffs around the edges of tech like this makes it *feel* futuristic.
In the UK right now it's pretty much impossible to get a face to face doctors appointment. They usually just end up calling you or try to give you a "diagnosis" over text instead based on the symptoms you describe without even seeing you. I could see this making a HUGE difference to online doctors appointments and diagnosis
@@AutoMotivate yeah what i was thinking. not even remotely more practical having a 15k special monitor, of which can't fully accurately be trusted for medical purposes as the picture is reconstructed using ai from multiple sources.
Idk why, but what immediately came to mind is using this tech for helping patients and their close ones have one-on-one conversations that feel like they're in the same room without the risks. Hope this project lives on!
@@anjolatope-babalola2338 It is very different for a couple main reasons, that being said, it is fundamentally just a more advanced video call. The main two differences are brought up in the video: Depth, it looks like the person is physically there with you cause you can turn your head and move off axis and look "around" them, for example in the video when he lifts up the shoe, the camera can move down and look up to see the underside of the shoe, even though he isn't directly presenting that part. You can see him freak out about the apple in the video because to him it looked like the guy was physically reaching over the real table in front of him and holding the apple. It does this through having many different cameras around the outside of the display that can see you from a lot of different angles, then AI "guesses" the depth of everything in all the images. When you look at the screen you are actually seeing two different images layered on each other but both angled to reflect the distance between your eyes and these images are moving to keep tracking where your head turns and moves. This is how it creates a 3D effect, kind of like 3D glasses or VR. The other main difference is eye contact, the human connection. In a video call if you want to give the appearance of eye contact you have to stare directly into the camera lens, not even looking at the other person. With this device you actually can make eye contact. They don't just look like a person on a screen, they look like they're physically there.
@@haydonwhipp3141 I did not ask you for how it's created a 3d effect, I watched the video I am not looking for the difference in technology, but the difference in simulating real-world experience, the difference in incorporating real-world senses. This is basically a more advanced video call. It improves the video call experience but does not come close to mimicking a real-life meeting any more than a video call. you are wrong. You can make eye contact on a video call. You don't have to look into the camera. The camera applies depth. You can position the camera father away from you and look at the screen, and then you see the person. The camera is what is looking at you and not the other way around. You can also notice a person reaction and facial expression You do understand. In this case, too, you are still looking at cameras You miss understood the question, how is would this make a different feeling, how does this simulate a personal or physical meeting better, no matter how good the technology is, you still interact with it your eyed snd only your eyes, it does not actually feel like a real meeting because it is not. It is a more advanced video call that does not actually solve any real-world problems. It is just cool tech. This will in no way or form immerse you like a real physical meeting does. VR is even more immersive because you can actually mimic physical interaction with virtual spaces, but that is still way off. Unless it engages more senses, it is not different Video calls changed from voice calls because you can now see the person. The next step would be to add smell or touch
Really just had the urge to say this dude constantly pumps out quality and quantity without it feeling forced and he also feels pretty relatable as well.
Very interesting! I can see the comeback of "phone booths", so people can make realistic meetings; think of long distance relationships, families living far or abroad, etc. Not for homes or domestic use, but yes for scheduling calls or meetings. Also: RUclips with 2 audio tracks?? Amazing for making content accessible for the masses. I love when technology is actually useful.
I always thought it would be awesome if the Nintendo 3DS would calculate perspective instead of it being fixed, this shows it can be done though its a way more complex system. The New 3DS does track your eyes to match the angle you're looking at it from, though that data is used just for the display view angle adjustment and doesn't reach the games. Imagine if you could move your head and see behind stuff in games!
I agree, the original 3DS was designed with only a single sweet spot for 3D viewing, a limitation that was eventually resolved with the New 3DS. However, the true disadvantage of the 3DS was its premature release, before the technology was fully matured. With the advancements of today's technology, I believe a modern-day 3DS would feature high-definition graphics and the ability to perceive depth around objects. The 3D photos were another intriguing feature, albeit held back by subpar camera resolution and technology. This resulted in grainy and faded images, which could've been avoided had the 3DS been introduced later.
It could be done, but having the cameras closer together will make it harder to produce a realistic depth of field, so it would likely be a noticeable drop in quality compared to this larger one for now(but who knows how well AI might be able to improve upon such a limitation).
I have my doubts it would get any smaller. They want that large of a screen regardless if they can shrink it. Then it's just the camera which are quite compact already
This is super awesome. The first idea for this that comes to mind for me is for deployed military. When I was deployed we had sometimes had rooms where we could have video calls with our family over Skype. I could imagine these being setup for soldiers and their families to see each other while deployed
Good job on demoing the depth and how immersive it is. If users understand the complexities of depth and can understand that what's seen on video sometimes is not what you actually see them they'll understand that this would be even more impressive in person. It's like for me watching Formula 1, some fans even to this day love to hate on the cars "halo" claiming that it affects the drivers vision but in reality your eyes and brain very quickly learn to tune it out because of the depth of where you are supposed to be looking. It's basically the same as how you can see your nose but your brain tunes it out.
I can imagine this going mainstream if it makes it into the entertainment industry, imagine a curated movie experience, produced just for this technology, it will be insane!
I think there's a distinction to make between the quality of music and cameras and the quality of video calls. Yeah, hearing high def audio would be nice, but it's just... nice. Video calls that make you feel like you're really with the person, though, could be super useful to people who are far away from family and friends who haven't seen each other in years. I think if it's cheap enough, it could have a healthy impact on long distance relationships.
I think this could be really great for the telehealth and virtual therapy spaces by helping patients feel a lot more at ease given a physical separation.
I literally watched that intro 10x just to indulge in that motion graphic glory. Your team makes me want to make stuff like that. Now I'll watch the rest of the video. My impression: definitely agree with the 'just enough fidelity' for the masses. This seems like it would breathe new life into photo booths once they get it working with more than 6 people. That and it can help with an extra dimension of learning / education
i just wanna give love to this videos intro specifically the audio track of it , it was great .I legit spent the first couple of minutes playaround with the back button replaying and looping the intro
Honestly, I take heaps of Tech with a grain of salt but to see him react that way to a piece of tech is something I have never seen before, he was genuinely blown away.. That made me really want to see this myself.
I've been amazed by the reaction to this tech at Google IO. I've been listening to podcasts and the people that got to try out project Starline have been blown away
Can definitely see this being used in the medical field. We've already seen a lot of doctors move to virtual visits when it makes sense and this technology would only expand the types of visits that can happen virtually.
Nah… I’m a doctor and I can tell you that I have never diagnosed someone by “touching” and “feeling” the patient. I never even look at them before diagnosing them.
I could see this being useful for larger international companies. Not only to hold more effective virtual calls but also to interview prospective candidates from afar.
I don't know about that. You would have to give one of this (probabbly) expensive divices to each employee and most people don't even turn the camera on for calls.
When catching up with family overseas, even using zoom still feels so distant. I feel like something like this could help me have deeper and more pleasant conversations with family.
I agree. Remember those days when the only internet hotspots were at "cybercafes"? I'd go to a "Starline cafe" and pay per minute to really catch up with family while I'm overseas. Facetime and Zoom are great, but they only go so far, and maybe because they are so limited in both size and clarity-like peeking through a keyhole, if one person is using a phone-people don't bother to make sure the lighting or sound or camera angles are okay. Going to a booth where all that is already dialed in for you means you'd also sit up and pay more attention to the conversation. (My adult daughter will set her phone down on the kitchen counter for ten or fifteen minutes at a time while we are talking, so that I'm staring at the ceiling! Better than nothing, but it would be nice to have an alternative to "super-casual just whatever" video chat. Like, really really nice. Depending on the occasion and the person with whom I am chatting. I'll bet my 90+yo dad would be able to have a real conversation with me in a Starline booth: I would be life-sized, not phone-sized or laptop-screen-sized, and the 3Dish super-high-fidelity would hold his attention as if I were really present with him. That's another huge potential market. I wish every elder-care facility had a Starline booth, and every major city in the world had at least one Starline cafe. I'd buy a membership to get frequent-user discounts...
The great thing is that 3D chat is now possible on the Lume Pad 2, a tablet with a 3D display. I’ve tried it and it’s a very surreal experience, so something very similar to this has already arrived in consumer devices for the first time and it’s really cool
@@jnfunvufb I mean Google doesn't really care. There's like a 95% chance that this project gets scrapped and never sees the light of day in a year or two. It's still nice that big tech companies and their employees are coming up with unique designs and ideas, even if it doesn't directly create revenue.
As someone with monocular vision, that demo you showed was stunning. It looked super 3D to me. Obviously looking through a screen at another screen doesn’t help, but it’s already about as convincing as a 3D video game to me.
Only problem, is that I think it only works for one person. The TV screen gives you head tracking, but it can't do it for two screens without some form of headset, etc.
I wanna say 12-15 years ago I saw them doing this in a tech demo at UNC chapel hill. They were using a ton of Xbox connect cameras and unbelievably powerful computers. The resolution was much lower and you had limited movement before the parallax effect stopped working, but it's cool to see it actually being developed.
I’ve watched this a few times and I think this tech has potential for some brilliant applications. I do online guitar/music lessons and I keep thinking about how this would be such a beneficial tool for the students and the teachers.
It is rare to see Marques geeking out over technology. He sees so many new products, and to know this one made him giddy tells me how impressive it really was.
This is really cool. There's a kind of intangible fatigue that comes with zoom meetings currently and it's I think partly because it's this lack of sense of presence. Whether it's this or VR or some mix, I think video conference thing still has a long way to go
This sounds like a great way to do virtual interviews, for jobs. No commute and you get to do more realistic body language. Could eliminate anxiety in some people.
Funny thing is the awkward zoom interviews actually make me more comfortable in interviews. So this will bring back my anxiety like I had back when I had to do in person interviews.
@@prospersikhwari5289 we need to put ourselves in those uncomfortable situations tho. Anxiety is healthy, despite what the pharmaceutical industry wants is to believe. One of the worst mistake of my life is getting on anxiety meds. We are getting too comfortable hiding behind tech, and we are all guilty
This is really neat. One thing that strikes me interesting is that this is a very hardware intensive piece of tech, and feels more like something that Apple would be developing, probably in secret, rather than Google. It’s interesting how far Google has come in terms of hardware, and where they might be going…
This could be such a difference for people working in health care like a psychologist/psychiatrist. Like Marques if feels like someone is there next to you. Sensing that a psychologist is there for you include seeing someone in good clarity and having the feeling that someone is there for you. And looking in the future and the possible threat of a new pandemic (recent human bird flue infections). a booth like this could even be a home office where you feel that you are working with colleagues that just pop in to talk to you for meetings.
well the slight problem would be that no one would buy this just to see a psychologist, which means that the booth will have to be at the meeting location, but if one person is at the meeting location, whats stopping the psychologist to be at the same location? very niche situations that sound good but may or may not be worth it
I can see a future version of this that uses a large ultrawide curved screen you sit in the middle of. It can identify and render multiple people and place them along the screen as if you were sat infront of a row of people. It would be a great way to do larger remote meetings.
@@TheDarthChief I think he's trying to say that stuff like zoom calls already exists. And to be fair, this would be a lot more expensive, but it would be way more immersive, and that's the point. I'm thinking jedi council room but a screen instead of holograms lol
I remember seeing this tech showcased on two minute papers more than a year ago. It's an interesting benchmark imo, to go from idea to a tool that's ready for the enterprise.
Sounds like an amazing experience, and this was by far the best video I have seen explaining it. As for use cases, I personally would really like to use such a thing to connect with loved ones who live very far away.
Yeah I was thinking this would be great for my wife so that she could feel closer to her family. Tho we would have to buy 2 lol. I feel like that’s just too expensive
@@Print2shoot Yes, was rethinking bout the price too. Just brainstorming, but could be a cool investment for libraries, installed in a private room. Though it might be too niche. Might be worth a pilot though.
This is a much more reasonable expectation for meetings than what Meta are trying to achieve. I can see this actually being used in larger companies, particularly those with offices across the globe. Probably not viable until it allows for more than one person on either side, but better to simulate an actual meeting with an actual person than having to stick an uncomfortable headset on.
Looks amazing. I would like to see it work over distance to see if there is latency. There's a lot of processing going on, and if you add in network latency, I think the illusion could be broken if you perceive delay. Many years ago, I used HP Presence, which was a similar non-3d version of this, and we needed a dedicated satellite uplink to keep the connection instantaneous. It too was amazing and felt like you were in the same room.
I'm assuming the receiving end is the one that converts the 3D model into a stereoscopic rendering with adjusted eye positions. From what it appears in the demo the software is continually adjusting the rendered eye position to keep the eyes focused on the other person's eyes. I suspect those sorts of local microadjustments can make up to a second of latency of movement and sound data transfer feel quite natural still.
@@jsebrech that doesn't make sense to me. There are two discrete steps here, anyway. Step 1: create 3D model. I think you'd do that at sending end, because otherwise you have way higher bandwidth requirements, to transmit multiple camera feeds. Step 2: receiving end "projects" that 3D model onto 2D screen, based on your current head position. Doing this projection locally means the response to your head movements is low latency, which is key to making it feel real. The actual call could have noticeable latency (i.e. receiver's model lags behind the reality at the sending end) and that would make the communication less satisfying, but wouldn't diminish the 3D realism. You also mention stereoscopic rendering - I don't understand that to be part of the technology. I don't see any way to isolate separate images for each eye (headset or glasses). The 3D effect here is achieved simply by adjusting proportions and occlusions, based on head position. That still creates considerable realism, just like if you close one eye and move your head - your environment still seems real and 3D.
That's awesome. I fully agree with you on the fidelity argument, I think the only way this would become mainstream is if there were public video call rooms that could be reserved for specific applications. Like imagine scheduling a call with your spouse who's currently away for work, so you go to your public library because they have a conference room with a Starline-type video setup. Or you schedule a business meeting and go into the office to use your company's conference room. However the one-person limitation for 3D displays is really what's going to hold back this tech. There are only so many situations that are exactly 1-to-1 communication, and much more demand for group calls and shared viewing (like two kids in the same room seeing their grandparent on a video call, and vice versa). So far I haven't seen anything that sufficiently solves this problem.
I predict that this will be like a staple in offices and stuff. There will be a dedicated room with like 5-6 of these and instead of those low quality calls you’ll have these screens, they could even have these in universities for lectures when they get the head tracking thing sorted. Pretty cool tech 👍
This will absolutely be installed in major corporate offices. Will likely start at C suite level and take time to work it’s way into AV/IT standard practices.
@@PSBrathwaite Schools probably not, but loads of companies would want this in their offices. It reduces the barrier for remote communication massively and would make a huge difference for employee satisfaction. You'd be surprised how much money large companies put in their offices, especially to entice employees back in-person after the pandemic.
I loved seeing the reactions to first experiencing the tech. Would love to see more of that. Could you please add the link to the additional video to the description?
Honestly this would be amazing for deployed military personnel to see their families. For kids to actually see their parents in 3D and not a flat image… my only concern is young kids being confused and getting upset that they can’t actually touch mom or dad… But if they had a few of these on military bases and local government buildings where you can set an appointment, go to your local booth and have a nice visit… that’s cool!
I had a virtual pinball setup at one time that used a Kinect camera to track distance. It was really cool as the render moved with your head and made the 3d look really immersive.
The Metaverse was dumb, but this is something I see so much function for. A previous company I worked for would fly people back and forth between cities literally every single day to have meetings. Something like this would be able to help cut down on so much of that. I'd love one myself, I have so many calls during a week, being able to have calls like this with my clients would be amazing. If the price was decent, I'd give these to my clients as part of the onboarding. Talk about having a competitive edge.
Very interesting! I could see the next version being wrapped up as a Google 3D TV. Could have the cameras and sensors in the bezel but watch 3D content without glasses would be really cool then have a 3D Google Duo feature. Although I think the 1 person perspective limit would be a tough sell.
Honestly I really want this: Hear me out, I have a lot of relatives that live across a lot of different cities and honestly facetime is only for shorter conversations but I just imagine how amazing this would feel, feeling close talking to them and just like coming to the closest thing of feeling like I'm with them without having to travel across half the world is great! That's why I think there should be a restaurant chain connecting people across cities where you'd be able to book a table all the way across the world
This is insanely exciting technology. So many people could use this in a world where things like travel are getting more expensive. Great demo - I'm looking forward to seeing how this evolves!
Basically anyone could use this and benefit in someway, it's just the price of it will most likely make it mostly a business tool. I think there are some exceptions like maybe long distance relationships where it would be worth the cost
They way virtual Marques eyes tracked the camera as it moved from side to side.. I NEED ONE OF THESE. Morning Standups from home will be GAME CHANGING. LOL
The demonstration you did was fantastic. I bet google was pretty impressed with that idea. It might not be the full experience, but it still gets the point across well.
This can absolutely come to single camera devices. It's just a matter of time and effort to figure out how to adapt temporal mapping like what we currently do with panoramic stitching on cell phone cameras.
A feature for this that would be really cool is live translating. So if 2 companies are having a business meeting but they speak two different languages, in real time, this screen would be able to translate what they are saying to eachother based on the language preference
⏱Timestamps for this video! 0:02 - Introduction to Google Project Starline 0:47 - First Look at Google Project Starline 1:10 - Demonstrating the Technology 3:57 - Creating a 3D model in real-time 9:14 - Limitations and Future of the Technology 11:28 - Conclusion and Future Prospects 🧙♂✨ Generated with Houdini Chrome extension.
I feel like this could be useful if you're feeling lonely or you want to talk long distances to feel more close as it feels like the person is in the room
These booths could be brilliant.. I imagine them being located in all these rural towns (such as the tiny small towns in greenland where the few citizens live very isolated from EVERYTHING and there's no roads) They could do a 3d video call with their friends/family... and most importantly, contact doctors, psycologists etc. Of course also for companies that have different departments in different citites/countries
@@GlutesEnjoyer They're talking about these booths being used for public use the towns folk can walk to if they wanted to video call a distant relative. Not them having one in their house. Even if it were cheap this kind of thing would be thousands of dollars.
this product is for businesses. conferencing. etc. that's what this product is for. lmao have you even been to greenland? you'd be surprised the level of poverty they have.
@@GlutesEnjoyer I'm just telling you what Nioxic was getting across and nothing more. I never said anything about units like this being practical or cheap. The only real use I can see behind something like this is conference calls for big business. Possibly setup in a big room with multiple smaller rooms within as privacy booths. Or maybe in some ones office. This screams business uses to me.
It's amazing to see new tech being created and demoed. But seeing Marques and the team be more enthusiastic in trying it and sharing it with the world adds magic to the video.
I’ve never seen Marquess been blown away like that with a tech demo. First few seconds you can clearly see him trying to figure out how they were doing this. That’s impressive
It looked like for a second he actually thought he was going to be able to take the apple from that guy.
It sounds a lot like the arcade games that were holograms back in the 80's 90's.
Actually, this is the second time. The first time was when he tried that vacuum cleaner/headphone/air dispenser/mask.
Aye, that reaction is what really conveys the impact.
@@tomsriver2838 I think their first reaction to that was closer to "bruh" than "how in the hell"
Glad to see Google trying new things and actually showing them
They will probably kill it anyways 😂
Don’t they always? Google glasses, etc?
Aaaaand it's cancelled
??? They have always tried new things. Tf r u on about
@@kq5149 they always kill all their services. It's like they are just having fun creating random projects
As always, the adult entertainment industry will pave the way for tech such as this.
All the fancy tech always feels pointless. Until the adult entertainment gets their hands on it, and suddenly it's a million dollar industry.
You made me laugh the most I have since the morning 😂😭
Haraam
"Head tracking"
Took the words out of my mouth! Haha.
I can see this being super useful for telemedicine. A medical-specialist-doctor-expert person can be a world away, but if they can "meet" with you using Starline, you can show them the weird rash on your elbow or your crushed hand or whatever, and they would be able to see it so well, the only thing missing would be touch. That's important too, especially for orthopedic and internal injuries, but you'd be at a hospital that had a Starline booth anyway, so a local RN or doctor could follow the expert's instructions WHILE THE EXPERT WATCHED AND COACHED... I think this will have huge benefits for telemedicine.
Not to mention surgery training! Um, I'll let your imagination take over, but if you're a surgeon intern...!
That's a very good point.
Reminds me of Children of Men/GITS holo displays.
Parallax Hall effect needs to be more prominent than simply being a gesture for phone wallpapers. 😮💨
The vast majority of doctor visits don't need any hands on or visual aspect as it is. I don't see this being majorly helpful in telemedicine.
Internal injuries?? The doctor must be there to examine you. Surgery trainings?? Think about what you said again, man. What kind of surgent will you get by virtual trainings?
Probably the best use I can imagine is nursing homes, hospitals, where one of the people is bound to one place, so the relative could just come to a public Starlight kiosk and dial the right device. Also a great way to communicate with people in medical isolation, during interrogation or with prisoners to ensure the safety on both sides.
Yeah so a phone or zoom call
Only Fans
@@yohansharp3040 way more personal than either- you missed the whole point
@@Jorrich it's the exact same thing as a zoon call. You just have a sorta 3d effect, adds nothing to the emotion imo
Imagine during the recent pandemic, with elderly people in nursing homes unable to see their families?
Incredible tech. Well balanced presentation MB. thank you
megabytes?
@@madhououinkyoma Marques Brownlee
@@alex.papworth shhh 👀
@@madhououinkyoma☠️
@@madhououinkyoma 🤭😉
While working at Google, I had the opportunity to take many of my 1:1 meetings in booths like this. It was wild - you legit remember those meetings more, and no zoom fatigue!
That's crazy Billyfx! I'm definitely feeling a bit jealous you've gotten to try something like this out. Ok... *asks Chatty-G "Tell me how to get a job playing with emerging tech?"*
That's sad
@@Channel-fo6oq ???
Using your position as a RUclipsr to learn about and share things like this is exactly what you should do. We all appreciate you bringing us along!
Super proud of you MKBHD. The fact that Google gave you access to something like this, and being the first outside of Google to see it, is impressive. Shows that all the hard work you have done over the years is paying off. Seriously good stuff
'is paying off'. Say what?
He's not first outside google. He mentioned that We work, Salesforce and TMobile are actively using it.
But seems that he had to keep his review very mild, not much critical thinking/doubts heard, and this looks like a gimmick )..
Google gave him acess, congratulations? Wow the bar is low.
@@leonize2459 how is that low? Did they invite you as well? How was the experience? Please let us know!
So glad they chose you to deliver this type of content to us. Insane tech.
@kennykodex You‘re saying this creator is not a real person?
dupa
Great comment, completely agree!
@@SorrowAvenue how...why do you think that?
@@thecognacsipper I didn't say I did but the OP clearly does as he expresses this clearly in a response. Ask them.
Perpetually being reminded of how neat the 3DS was and how the 3D feature would’ve been pretty neat with more powerful modern hardware
I was constantly thinking about the 3DS, specifically the new 3DS while watching this as well because it had tracking to make the 3D effect better too.
The New 3DS felt a lot like what this is with the glasses-free head tracking 3D. When it worked well it worked *really* well. Project Starline feels like the next evolution. Almost like if the 3DS had dual front facing camera and video chat.
I'm so sad that the 3DS line was discontinued. My favorite console of all time.
@@podracer35 I'm still disappointed that I only ever got an original 3DS and not a New 3DS. The eye tracking would be so useful, especially for games that take advantage of the motion controls. I might get one just for that lol, if I ever start to care enough to spend money on it
@@petemiller2598 yeah, same. It's a shame the 3D was not used enough by third party devs to the point where they made the 2DS XL (which is pretty fantastic, even without the 3D)
Wow, this was probably the closest to getting the feeling of a 3D effect through a 2D screen and video I've seen. Great capture!
It feels alot like the 3ds even through the video, I can't imagine how good it'd look in person!
@@SoarMallardhat required the Screen to be divided into odd and even sets depending on the view. It the whole reason 3DS technically has a 800x240 physical screen but only renders at 400x240 to accommodate the 3D.
This looks like the screen adjusts the viewpoint relative to the head position without needing specialized screens.
IMAGINE this keeping the 3D scans of people after they use it. You could be age fifty and tell it to present you at eighteen 😮
So you scan yourself at the age of 18 and then wait 32 years later to do something specific with it? Who would do that? And both 18 and 50 are adults.
Catching predators never been easier
The porn industry would like to have a word with you.
@@mohanad-kenany or just build a model using old photos in a separate program, so many ethically concerning questions
@@UCjNrKLyRJI-abFA8qiNo92Q what are you talking about people aged 18 are adults...
Very rare to see Marquee blown away like a tech newbie
Casey Newton on The New York Times' tech podcast "Hard Fork" was equally blown away by this. It seems to make quite an impression.
I'd wager the opposite whenever he isn't on about phones and cameras honestly. Pretty common from him.
Umm its obv a sponsored, produced by Google video.
I like how you objectively review products with respect for the efforts that go into creating it, yet still giving your viewers your candid take.
Are you cuber
Bruh
It's made for people that lost someone and need to have their gone person in a recording and being 3D it's amazing to have
I think this could be incredible for virtual doctors visits. Would make them feel much more personal, and greatly increase the experience for both doctor and patient.
Great point. My mom did a "virtual Physical Therapy session" the other day and this would've been soo much better.
Only problem would be that getting this in your house in the first place is probably unreal expensive.
I was thinking therapy appointments for people who move a lot. You'd be able to keep the same therapist while minimizing the detachment that comes from remote sessions
Other than they are not seeing you they are seeing a 3D model of you.
Prisons can really make good use of these for their inmates.
You would need to own one of these
As a senior med school student, I can only imagine how this kind of technology could be implemented in telemedicine soon.
Props to Google for this one.
Too big and expensive to replace your typical Webcam, but this would be a great idea for a private booth at say your local pharmacy. Have a quick Tele-health call with your doctor and have a prescription filled all before leaving.
How would this be useful for telemedicine? Genuinely asking
@@aryav.1108 It probably won't, it does not add anything more than what video call already has (medically wise it even reduces information), but it is more realistic to look at, seems like gimmick for now.. Maybe I am wrong, but it is not practical compared to its benefits, just high fidelity video call... I like 3d movies though, wish that kept on going more... Also regular 2d video call in hi res would be more helpful in medicine, for distance (showing wounds, skin conditions, etc...)...
@@JZabala22 that is today. just like mobile phone is expensive and big a few years before. as tech grow, we will have this feature in our phone
yeah sure tele-health if you mean lesson on female genitalia
This would be really great for remote counseling. I imagine a world where maybe only professionals own their own setup, but then you could go to a center and rent a room to meet with them.
Sounds super cool, read so many sci-fi books with a similar concept. I could see a variety of consumer uses for these Google sites or maybe even a sort of phone booth setup in your local target.
Honey, we have a webcam at home.
Like...Their office?
@@leonidas14775 that doesn’t render 3D though
@@ArcaneCowboy that's cool and all but what about people with severe agoraphobia who can't leave their homes to get that help to turn it around?
You got Google devs to trust your representation of Google Starline, and it actually translated the experience pretty well! Well done.
This is what the Metaverse should be. Making virtual meetings feel like in-person meetings to your brain. Could really decrease “zoom fatigue” and meaningfully improve remote work.
The metaverse will affect the future of work, but many people will like metaverse because it's a new world of opportunities beyond reality
Yeah well META might change back to just Facebook and it’s parenting companies like WhatsApp/Instagram. META is dead and no one bought into the idea. That is why they just fired over 10,000 employees it’s too late. Google is now going to become what the metaverse should’ve been
No. I want the real 3d VR world metaverse.
Dude thinks he knows what the metaverse should be when humankind doesn't even know 💀
metaverse will only work if they use this tech to create a model of you in VR
Think about the precious memories that could be recorded. A mother could speak with her child who's away at college, and 30 years later, they could replay that interaction and feel as if they were back in that moment. Picture a younger version of yourself, speaking to your older self. A father's final message to his son could be played back as if he were still present. Wild right?
Imagine a future where this technology could instantly translate different languages, even imitating the speaker's voice. It would revolutionize communication. I'd love to see this in schools; just imagine a student meeting a penpal from another country "in person".
I would go out my way to use such technology like this if it enabled me to connect with distant family members in a way that feels deeper than a regular zoom call. I am certain this technology will be adopted in hospitals and corporate meeting rooms, but I'd also love to see it in public libraries, households, even dorms.
I am genuinely excited to witness what this tech could do in our lives.
Hatsoff to MKBHD for doing so much research and effort to explain the tech to us! Definitely the best
I'm surprised though that he didn't mention the 3DS at all. The N3DS does the display side the same way with eye tracking.
@@astorMorisson Not with eye tracking
Ofcourse
He is the mkbhd
Not box opener technical guruji lol 🤮🤣🤣🤣
Research? I mean google gave him all the info and talking points...
He is getting money for it
My fiancé is a psychologist. Pre-pandemic she said that a practice like hers would never go remote. Obviously it did and we were able to move from Washington, DC to Vermont. That said, she still spends a week or two in person because so much is lost when remote. I can see a scenario where she sets up a system like this in her DC office giving her clients the opportunity to have a near-match to an in-person experience. The same is true for other areas of healthcare where the meetings are 1:1 and there is a massive value to creating a more intimate human connection.
I am a singing teacher and here to, my practice could justify the expense, I could live where I wanted, but have a studio in an area where there are many clients, or schools could put these setups in practice rooms and bring in teachers from all over.
I expect that it will be a long time before setups like these are part of everyone’s home, but there is a clear, exciting use case for small businesses that have already expanded their reach with remote tools, but are suffering from the current quality of the systems at our disposal.
Thank you, as always for delivering such precise, useful content!❤🎉
yea that would be really cool
My first thought was mental healthcare. I did see a counselor during the pandemic and it was mostly over the phone and that's not at all the same as it is in person. But this would for sure make it more like seeing the counselor/psychiatrist/therapist/psychologist in real life.
This sounds like an awesome use case! My initial thought though is user privacy and confidentiality for things like psychology. I'm sure whatever software is running this technology will be all cloud based to begin with, so making sure we're not just sending Google our most private conversations will be important. Interesting problem and I'm excited to see where it goes!
For some disabled people it would be incredibly helpful but for blind people who needs to rely on all their senses it would be a bad method.
Online mental health work sucks, regardless of the tech facilitating it - the human connection is too important
What an incredibly cool bit of tech. Video chatting always feels a bit off because of the whole lack of presence thing and this looks like something that could help solve that. Neat stuff.
What about witnesses testifying in court?
waaaaaaaaaaaaa
someone figuring out the eye contact thing would be a game-changer. i always thought it would be under-screen cameras that would do this but the ones all around the screen would work too.
This will be a flop technology same like Google's smart glass.
@@fousiyak5388 i don't see this being a consumer-facing product. probably more aimed at firms.
This is something I could buy for my parents living overseas. Amazing, can't wait to see production ready version.
Yes!
agreed
You must be super rich then!
This is something you could buy for my parents too! 😋
@@nadeemshaikh7863 If this thing ever goes to mass production, I see no reason why it should be extremely expensive. It has a few cameras & microphones and a screen. The magic is made with computing.
This kind of tech is really exciting to me as someone in the health sector. Once it's more affordable having these sort of booths in regional/rural health centres would enable practitioners from anywhere to have more meaningful consultations with patients/clients. Things like phone and Zoom counselling over the past few years has become more widespread, which is great, but it's still highly limited in ability to connect with the person you're talking to and in things like psychology the connection between client and practitioner is often as important, if not more, than the treatment modality. If you can get one of these things mobile on the back of a trailer you could enable people driving from small rural town to small rural town and allow them to consult with GPs in major cities for more things than current zoom/telehealth options allow. Very cool possibilities and I hope we get to see more and more improvements and cost reductions asap!
Came here to see if someone would post about the impact to psychologists. This is big. If it can be made cheap enough to ship to each client...
@@sciteceng2hedz358 I imagine to one client would be really expensive, but you could have a psychology center in one big city and have those screens in smaller villages.
Yes, I was also thinking this could allow health care access in remote or under served areas
Yeah but do you really need the 3d capabilities. In my opinion having a big screen that can render the person on the "other side" the proper size and a good enough camera + microphone setup is good enough to make you feel like the person is there. Think about it, if you do a zoom call on your phone or laptop you are mostly looking at a small head. Interacting with a human sized image with a torso and arms is a completely different experience and the technology to do it is already available and cheap. Having the 3D experience is really cool but I don't feel it adds that much
@@FakeButt If you're just talking with the person, that's probably true. But if a health professional was trying to do a remote examination, having the best possible visual representation would be important.
Some part of me really values the little glitching or geometric shimmer around the edges of the models. There's something deeply charming about a not-quite-perfect simulacrum of the participants that is just weirdly compelling. A perfect version would indeed be futuristic, but the little scuffs around the edges of tech like this makes it *feel* futuristic.
Like the static and blue glow in Star Wars holograms.
In the UK right now it's pretty much impossible to get a face to face doctors appointment. They usually just end up calling you or try to give you a "diagnosis" over text instead based on the symptoms you describe without even seeing you. I could see this making a HUGE difference to online doctors appointments and diagnosis
That’s crazy
I mean, why should we have appointments over simple issues? Plus, a phone/video call is much quicker and cheaper
@@AutoMotivate yeah what i was thinking. not even remotely more practical having a 15k special monitor, of which can't fully accurately be trusted for medical purposes as the picture is reconstructed using ai from multiple sources.
Gotta call at 08:00 in the morning...
At least 20% of appointments get cancelled on the day and another 10% are no shows
@@StorySpotlightDaily I agree. I think this tech can maybe, maybe be translated to a be setting. But you are right.
Idk why, but what immediately came to mind is using this tech for helping patients and their close ones have one-on-one conversations that feel like they're in the same room without the risks. Hope this project lives on!
But how is this different from a video call
How does this simulate a physical person more
@@anjolatope-babalola2338 rewatch the video and you'll know
@@anjolatope-babalola2338 It is very different for a couple main reasons, that being said, it is fundamentally just a more advanced video call.
The main two differences are brought up in the video:
Depth, it looks like the person is physically there with you cause you can turn your head and move off axis and look "around" them, for example in the video when he lifts up the shoe, the camera can move down and look up to see the underside of the shoe, even though he isn't directly presenting that part. You can see him freak out about the apple in the video because to him it looked like the guy was physically reaching over the real table in front of him and holding the apple. It does this through having many different cameras around the outside of the display that can see you from a lot of different angles, then AI "guesses" the depth of everything in all the images.
When you look at the screen you are actually seeing two different images layered on each other but both angled to reflect the distance between your eyes and these images are moving to keep tracking where your head turns and moves. This is how it creates a 3D effect, kind of like 3D glasses or VR.
The other main difference is eye contact, the human connection. In a video call if you want to give the appearance of eye contact you have to stare directly into the camera lens, not even looking at the other person. With this device you actually can make eye contact. They don't just look like a person on a screen, they look like they're physically there.
@@haydonwhipp3141
I did not ask you for how it's created a 3d effect, I watched the video
I am not looking for the difference in technology, but the difference in simulating real-world experience, the difference in incorporating real-world senses.
This is basically a more advanced video call. It improves the video call experience but does not come close to mimicking a real-life meeting any more than a video call.
you are wrong. You can make eye contact on a video call. You don't have to look into the camera. The camera applies depth. You can position the camera father away from you and look at the screen, and then you see the person. The camera is what is looking at you and not the other way around. You can also notice a person reaction and facial expression
You do understand. In this case, too, you are still looking at cameras
You miss understood the question, how is would this make a different feeling, how does this simulate a personal or physical meeting better, no matter how good the technology is, you still interact with it your eyed snd only your eyes, it does not actually feel like a real meeting because it is not.
It is a more advanced video call that does not actually solve any real-world problems. It is just cool tech.
This will in no way or form immerse you like a real physical meeting does. VR is even more immersive because you can actually mimic physical interaction with virtual spaces, but that is still way off.
Unless it engages more senses, it is not different
Video calls changed from voice calls because you can now see the person. The next step would be to add smell or touch
Really just had the urge to say this dude constantly pumps out quality and quantity without it feeling forced and he also feels pretty relatable as well.
Very interesting! I can see the comeback of "phone booths", so people can make realistic meetings; think of long distance relationships, families living far or abroad, etc. Not for homes or domestic use, but yes for scheduling calls or meetings.
Also: RUclips with 2 audio tracks?? Amazing for making content accessible for the masses. I love when technology is actually useful.
yea same man. Oil rig workers, military, astronauts
I freaking love watching you grow from cellphone reviews to being trusted by google Devs. Keep it up!
I always thought it would be awesome if the Nintendo 3DS would calculate perspective instead of it being fixed, this shows it can be done though its a way more complex system.
The New 3DS does track your eyes to match the angle you're looking at it from, though that data is used just for the display view angle adjustment and doesn't reach the games. Imagine if you could move your head and see behind stuff in games!
I agree, the original 3DS was designed with only a single sweet spot for 3D viewing, a limitation that was eventually resolved with the New 3DS. However, the true disadvantage of the 3DS was its premature release, before the technology was fully matured.
With the advancements of today's technology, I believe a modern-day 3DS would feature high-definition graphics and the ability to perceive depth around objects.
The 3D photos were another intriguing feature, albeit held back by subpar camera resolution and technology. This resulted in grainy and faded images, which could've been avoided had the 3DS been introduced later.
I imagine this will become more compact over time and we'll see this on laptops and phones some day.
But it would ruin the effect to have the person be tiny lol
@@guyanomaly Imagine discussing a serious topic with a tiny 3D version of your boss. That'd be hilarious 😂
It could be done, but having the cameras closer together will make it harder to produce a realistic depth of field, so it would likely be a noticeable drop in quality compared to this larger one for now(but who knows how well AI might be able to improve upon such a limitation).
@@omgyeti2049 iPhones have actual depth cameras though. So they wouldn’t need stereo cameras.
I have my doubts it would get any smaller. They want that large of a screen regardless if they can shrink it. Then it's just the camera which are quite compact already
This is super awesome. The first idea for this that comes to mind for me is for deployed military. When I was deployed we had sometimes had rooms where we could have video calls with our family over Skype. I could imagine these being setup for soldiers and their families to see each other while deployed
Good job on demoing the depth and how immersive it is. If users understand the complexities of depth and can understand that what's seen on video sometimes is not what you actually see them they'll understand that this would be even more impressive in person.
It's like for me watching Formula 1, some fans even to this day love to hate on the cars "halo" claiming that it affects the drivers vision but in reality your eyes and brain very quickly learn to tune it out because of the depth of where you are supposed to be looking. It's basically the same as how you can see your nose but your brain tunes it out.
It says a lot that Google let you be the one to show the demo. You're being fair and transparent about the whole thing. Great video!
also his skin tone. they've tested it with more than just white people (remember the Kinect?)
Yea unlike Google who is evil.
Wow, this is just plain awesome. The visualisation was super cool😮 This makes teams look like stone-age tech.
Google has alot of technology like this. They just kill it and never let the public use it.
what are you talking.. teams is ultra max pro bleeding edge tech, nothing can come closer..
love how the chat in teams is much worse than MSN was 20 years ago.
2023 and you cant scroll through text properly or copy paste text 😂
@@elowine or search history in any sensible way
It's funny to me that of all the producs to compare this to you would pick Teams that looked like stone-age tech from the first day of its release.
As an artist who works in 3d this would be a game changer, it would allow me to see the real thing before its made instead of the 2d representation.
I can imagine this going mainstream if it makes it into the entertainment industry, imagine a curated movie experience, produced just for this technology, it will be insane!
Probably will be ready in time for Avatar 3
adult entertainment with this lmao
@@many029s Bad example
@@AMAZINGDAVEnope most tech gets mass adopted after the adult industry becomes successful in it. CDs, the internet, VR…
@@AMAZINGDAVE Best example. We love porn
I think there's a distinction to make between the quality of music and cameras and the quality of video calls. Yeah, hearing high def audio would be nice, but it's just... nice. Video calls that make you feel like you're really with the person, though, could be super useful to people who are far away from family and friends who haven't seen each other in years. I think if it's cheap enough, it could have a healthy impact on long distance relationships.
Probably big businesses and organisations first then maybe actual customers. My guess is 3-5 years before we get to buy it.
I dont want anything. Social media destroyed society. We are going to far with all this tech!! Face to face talking.
I think this could be really great for the telehealth and virtual therapy spaces by helping patients feel a lot more at ease given a physical separation.
I feel like this would be great for families to connect with soldiers that are deployed for very long periods.
I don't think I've ever seen Marques this hyped about a piece of tech. Wow, and even on a phone it was truly impressive.
I literally watched that intro 10x just to indulge in that motion graphic glory. Your team makes me want to make stuff like that. Now I'll watch the rest of the video. My impression: definitely agree with the 'just enough fidelity' for the masses. This seems like it would breathe new life into photo booths once they get it working with more than 6 people. That and it can help with an extra dimension of learning / education
And that is why I subscribe to this channel. Nothing but the best, nothing but cutting edge 💪
ok
i just wanna give love to this videos intro specifically the audio track of it , it was great .I legit spent the first couple of minutes playaround with the back button replaying and looping the intro
Honestly, I take heaps of Tech with a grain of salt but to see him react that way to a piece of tech is something I have never seen before, he was genuinely blown away.. That made me really want to see this myself.
I've been amazed by the reaction to this tech at Google IO. I've been listening to podcasts and the people that got to try out project Starline have been blown away
Can definitely see this being used in the medical field. We've already seen a lot of doctors move to virtual visits when it makes sense and this technology would only expand the types of visits that can happen virtually.
Nah.. I'm doctor and I can tell you that one of the most important part of diagnosis is the "touching" and the "feeling" of the patient.
Nah… I’m a doctor and I can tell you that I have never diagnosed someone by “touching” and “feeling” the patient. I never even look at them before diagnosing them.
@@hankrik3179 Diagnosis and saying an opinion are two different things! Google 's search doctor? 😅
@@hankrik3179Nah, I'm a doctor and I've never diagnosed someone.
@@tedigrizli nah I’m a doctor and I am not even a doctor.
I could see this being useful for larger international companies. Not only to hold more effective virtual calls but also to interview prospective candidates from afar.
I don't know about that. You would have to give one of this (probabbly) expensive divices to each employee and most people don't even turn the camera on for calls.
@@Kosme88 I’m more so thinking about having the tv and sensor suite on a rolling cart that you can put in conference rooms
When catching up with family overseas, even using zoom still feels so distant. I feel like something like this could help me have deeper and more pleasant conversations with family.
I agree. Remember those days when the only internet hotspots were at "cybercafes"? I'd go to a "Starline cafe" and pay per minute to really catch up with family while I'm overseas. Facetime and Zoom are great, but they only go so far, and maybe because they are so limited in both size and clarity-like peeking through a keyhole, if one person is using a phone-people don't bother to make sure the lighting or sound or camera angles are okay. Going to a booth where all that is already dialed in for you means you'd also sit up and pay more attention to the conversation. (My adult daughter will set her phone down on the kitchen counter for ten or fifteen minutes at a time while we are talking, so that I'm staring at the ceiling! Better than nothing, but it would be nice to have an alternative to "super-casual just whatever" video chat.
Like, really really nice. Depending on the occasion and the person with whom I am chatting.
I'll bet my 90+yo dad would be able to have a real conversation with me in a Starline booth: I would be life-sized, not phone-sized or laptop-screen-sized, and the 3Dish super-high-fidelity would hold his attention as if I were really present with him.
That's another huge potential market. I wish every elder-care facility had a Starline booth, and every major city in the world had at least one Starline cafe. I'd buy a membership to get frequent-user discounts...
honestly im way more impressed than i expected to be. I cant wait to see what tech there is in the future.
The great thing is that 3D chat is now possible on the Lume Pad 2, a tablet with a 3D display. I’ve tried it and it’s a very surreal experience, so something very similar to this has already arrived in consumer devices for the first time and it’s really cool
@@jnfunvufb I mean Google doesn't really care. There's like a 95% chance that this project gets scrapped and never sees the light of day in a year or two. It's still nice that big tech companies and their employees are coming up with unique designs and ideas, even if it doesn't directly create revenue.
Loved this ❤
😱 wtf notion god
@@kycheng wft productivity god
Yes
wtf wasteman! (jk jk
You wanna try it productively on some websites ?😏
As someone with monocular vision, that demo you showed was stunning. It looked super 3D to me. Obviously looking through a screen at another screen doesn’t help, but it’s already about as convincing as a 3D video game to me.
Right? I also have this problem and it's very sad I can't experience 3D like most people
I might actually be interested in this. Thanks for the preview!
I could totally see companies buying a bunch of these for their meeting rooms for when they want to communicate with offices in other locations.
See HP Presence by Hewlett Packard. It's a non-3d version of this. Been around for years for corporate communication
Only problem, is that I think it only works for one person. The TV screen gives you head tracking, but it can't do it for two screens without some form of headset, etc.
@@codypieper728 it should only be used for one person in the beginning I think. Mostly just executives and office heads talking to each other.
incredibly creative how you managed to get the sense of it on video. that cardboard with cameras was absolutely genius.
Imagine watching RUclips of the future like this
This tech really has the wow factor- like the future is paying us a little visit and showing us the shape of things to come.
I wanna say 12-15 years ago I saw them doing this in a tech demo at UNC chapel hill. They were using a ton of Xbox connect cameras and unbelievably powerful computers.
The resolution was much lower and you had limited movement before the parallax effect stopped working, but it's cool to see it actually being developed.
Y
@illestrated4191 What is the purpose of this comment?
@@SorrowAvenue my boy the comment cop
@@SorrowAvenue statement sheriff
@@SorrowAvenue lmfao
5:30 Yooo Marques going Ultra instinct Sicko mode. Lol.
I’ve watched this a few times and I think this tech has potential for some brilliant applications. I do online guitar/music lessons and I keep thinking about how this would be such a beneficial tool for the students and the teachers.
It is rare to see Marques geeking out over technology. He sees so many new products, and to know this one made him giddy tells me how impressive it really was.
This is really cool. There's a kind of intangible fatigue that comes with zoom meetings currently and it's I think partly because it's this lack of sense of presence. Whether it's this or VR or some mix, I think video conference thing still has a long way to go
This sounds like a great way to do virtual interviews, for jobs. No commute and you get to do more realistic body language. Could eliminate anxiety in some people.
Funny thing is the awkward zoom interviews actually make me more comfortable in interviews. So this will bring back my anxiety like I had back when I had to do in person interviews.
Agreed with @prosper, this would be so realistic it would make anxious people anxious again.
@@prospersikhwari5289 we need to put ourselves in those uncomfortable situations tho. Anxiety is healthy, despite what the pharmaceutical industry wants is to believe. One of the worst mistake of my life is getting on anxiety meds. We are getting too comfortable hiding behind tech, and we are all guilty
This is really neat. One thing that strikes me interesting is that this is a very hardware intensive piece of tech, and feels more like something that Apple would be developing, probably in secret, rather than Google. It’s interesting how far Google has come in terms of hardware, and where they might be going…
The coming glasses
Actually I think the AI part is even more than hardware
This could be such a difference for people working in health care like a psychologist/psychiatrist. Like Marques if feels like someone is there next to you. Sensing that a psychologist is there for you include seeing someone in good clarity and having the feeling that someone is there for you. And looking in the future and the possible threat of a new pandemic (recent human bird flue infections). a booth like this could even be a home office where you feel that you are working with colleagues that just pop in to talk to you for meetings.
well the slight problem would be that no one would buy this just to see a psychologist, which means that the booth will have to be at the meeting location, but if one person is at the meeting location, whats stopping the psychologist to be at the same location? very niche situations that sound good but may or may not be worth it
Rarely seen you this enthusiastic about something, this tech must be really amazing
I can see a future version of this that uses a large ultrawide curved screen you sit in the middle of. It can identify and render multiple people and place them along the screen as if you were sat infront of a row of people. It would be a great way to do larger remote meetings.
Bro i feel like You forgot something important today..
@@ne0395 Such as?
@@TheDarthChief I think he's trying to say that stuff like zoom calls already exists. And to be fair, this would be a lot more expensive, but it would be way more immersive, and that's the point. I'm thinking jedi council room but a screen instead of holograms lol
@@lukeevans2353 Ya that's what I'm getting at. Some Avengers secret council type stuff.
Apple's Vision Pro steals the show in this one
I love this! You likely could have captured the full effect with a stereoscopic camera. Then, it could be made into a video for VR headsets.
Exactly my thoughts, maybe a separate video since not everyone has a vr headset and also might confuse some people.
I remember seeing this tech showcased on two minute papers more than a year ago. It's an interesting benchmark imo, to go from idea to a tool that's ready for the enterprise.
Sounds like an amazing experience, and this was by far the best video I have seen explaining it. As for use cases, I personally would really like to use such a thing to connect with loved ones who live very far away.
Yeah I was thinking this would be great for my wife so that she could feel closer to her family. Tho we would have to buy 2 lol. I feel like that’s just too expensive
Google will kill it and we will never see it again like most of their mindbending technology.
@@Print2shoot Yes, was rethinking bout the price too. Just brainstorming, but could be a cool investment for libraries, installed in a private room. Though it might be too niche. Might be worth a pilot though.
That demo was incredible! So cool to see google trying crazy new things
This is a much more reasonable expectation for meetings than what Meta are trying to achieve. I can see this actually being used in larger companies, particularly those with offices across the globe. Probably not viable until it allows for more than one person on either side, but better to simulate an actual meeting with an actual person than having to stick an uncomfortable headset on.
Same thing killed Google Glass. Cool tech will never trump cool looking.
Looks amazing. I would like to see it work over distance to see if there is latency. There's a lot of processing going on, and if you add in network latency, I think the illusion could be broken if you perceive delay.
Many years ago, I used HP Presence, which was a similar non-3d version of this, and we needed a dedicated satellite uplink to keep the connection instantaneous. It too was amazing and felt like you were in the same room.
I'm assuming the receiving end is the one that converts the 3D model into a stereoscopic rendering with adjusted eye positions. From what it appears in the demo the software is continually adjusting the rendered eye position to keep the eyes focused on the other person's eyes. I suspect those sorts of local microadjustments can make up to a second of latency of movement and sound data transfer feel quite natural still.
Satellite has awful latency so not sure how that tracks
@@jsebrech that doesn't make sense to me. There are two discrete steps here, anyway. Step 1: create 3D model. I think you'd do that at sending end, because otherwise you have way higher bandwidth requirements, to transmit multiple camera feeds. Step 2: receiving end "projects" that 3D model onto 2D screen, based on your current head position. Doing this projection locally means the response to your head movements is low latency, which is key to making it feel real. The actual call could have noticeable latency (i.e. receiver's model lags behind the reality at the sending end) and that would make the communication less satisfying, but wouldn't diminish the 3D realism.
You also mention stereoscopic rendering - I don't understand that to be part of the technology. I don't see any way to isolate separate images for each eye (headset or glasses). The 3D effect here is achieved simply by adjusting proportions and occlusions, based on head position. That still creates considerable realism, just like if you close one eye and move your head - your environment still seems real and 3D.
As long as the latency is the same as in normal video calls it should be fine.
That's awesome. I fully agree with you on the fidelity argument, I think the only way this would become mainstream is if there were public video call rooms that could be reserved for specific applications. Like imagine scheduling a call with your spouse who's currently away for work, so you go to your public library because they have a conference room with a Starline-type video setup. Or you schedule a business meeting and go into the office to use your company's conference room.
However the one-person limitation for 3D displays is really what's going to hold back this tech. There are only so many situations that are exactly 1-to-1 communication, and much more demand for group calls and shared viewing (like two kids in the same room seeing their grandparent on a video call, and vice versa). So far I haven't seen anything that sufficiently solves this problem.
It'd be like those video call phone machines from the pokemon anime
The presentation quality on your videos at the moment is just insane. Probably one of the best if not best on youtube.
Totally agree!
I predict that this will be like a staple in offices and stuff. There will be a dedicated room with like 5-6 of these and instead of those low quality calls you’ll have these screens, they could even have these in universities for lectures when they get the head tracking thing sorted. Pretty cool tech 👍
Not so sure about that. In many areas, especially IT, hardly anyone turns their camera on.
This will absolutely be installed in major corporate offices. Will likely start at C suite level and take time to work it’s way into AV/IT standard practices.
But why? Why would any corporation or school pay extra for this sht when they don't HAVE to and save thousands by not doing so?
@@PSBrathwaite dude calm down, it was a prediction, this hasn’t happened yet. No need to get loud
@@PSBrathwaite Schools probably not, but loads of companies would want this in their offices. It reduces the barrier for remote communication massively and would make a huge difference for employee satisfaction. You'd be surprised how much money large companies put in their offices, especially to entice employees back in-person after the pandemic.
I loved seeing the reactions to first experiencing the tech. Would love to see more of that. Could you please add the link to the additional video to the description?
yes please!!
Honestly this would be amazing for deployed military personnel to see their families. For kids to actually see their parents in 3D and not a flat image… my only concern is young kids being confused and getting upset that they can’t actually touch mom or dad…
But if they had a few of these on military bases and local government buildings where you can set an appointment, go to your local booth and have a nice visit… that’s cool!
I had a virtual pinball setup at one time that used a Kinect camera to track distance. It was really cool as the render moved with your head and made the 3d look really immersive.
The Metaverse was dumb, but this is something I see so much function for. A previous company I worked for would fly people back and forth between cities literally every single day to have meetings. Something like this would be able to help cut down on so much of that.
I'd love one myself, I have so many calls during a week, being able to have calls like this with my clients would be amazing. If the price was decent, I'd give these to my clients as part of the onboarding. Talk about having a competitive edge.
Imagine shopping for clothes at the mall and having this tech suit you up virtually without having to try on everything. That's a game changer
You can do that with ar rn
That’s actually already a thing
I'm not talking about AR on a tiny phone, I'm talking about replacing the mirrors at clothing stores.
Imagine malls still existing in the future. That would be surprising
Sounds like a huge privacy concern, tbh
Very interesting! I could see the next version being wrapped up as a Google 3D TV. Could have the cameras and sensors in the bezel but watch 3D content without glasses would be really cool then have a 3D Google Duo feature. Although I think the 1 person perspective limit would be a tough sell.
Or 3D movies in the theater
Honestly I really want this: Hear me out, I have a lot of relatives that live across a lot of different cities and honestly facetime is only for shorter conversations but I just imagine how amazing this would feel, feeling close talking to them and just like coming to the closest thing of feeling like I'm with them without having to travel across half the world is great! That's why I think there should be a restaurant chain connecting people across cities where you'd be able to book a table all the way across the world
This is insanely exciting technology. So many people could use this in a world where things like travel are getting more expensive. Great demo - I'm looking forward to seeing how this evolves!
Basically anyone could use this and benefit in someway, it's just the price of it will most likely make it mostly a business tool. I think there are some exceptions like maybe long distance relationships where it would be worth the cost
This is really cool, the fact that you showed us that demonstration was great
They way virtual Marques eyes tracked the camera as it moved from side to side.. I NEED ONE OF THESE. Morning Standups from home will be GAME CHANGING. LOL
The demonstration you did was fantastic. I bet google was pretty impressed with that idea. It might not be the full experience, but it still gets the point across well.
This can absolutely come to single camera devices. It's just a matter of time and effort to figure out how to adapt temporal mapping like what we currently do with panoramic stitching on cell phone cameras.
Watching MKBHD at 9 in the morning is such a great feeling
Love that you gave Google a way to record their own tech 😂. Practically it's a gigantic Nintendo New3DS. Seems pretty cool thanks for the video ❤
Would've been so much cooler if the head tracking on the 3DS changed the viewing angle of the game along with your head tho 😅
The new 3ds did headtracking but didn’t change the angle. But the ProArt Studiobook 16 3D OLED will do that, pretty cool tech.
A feature for this that would be really cool is live translating. So if 2 companies are having a business meeting but they speak two different languages, in real time, this screen would be able to translate what they are saying to eachother based on the language preference
⏱Timestamps for this video!
0:02 - Introduction to Google Project Starline
0:47 - First Look at Google Project Starline
1:10 - Demonstrating the Technology
3:57 - Creating a 3D model in real-time
9:14 - Limitations and Future of the Technology
11:28 - Conclusion and Future Prospects
🧙♂✨ Generated with Houdini Chrome extension.
I feel like this could be useful if you're feeling lonely or you want to talk long distances to feel more close as it feels like the person is in the room
These booths could be brilliant..
I imagine them being located in all these rural towns (such as the tiny small towns in greenland where the few citizens live very isolated from EVERYTHING and there's no roads)
They could do a 3d video call with their friends/family... and most importantly, contact doctors, psycologists etc.
Of course also for companies that have different departments in different citites/countries
Very few people In Greenland have the money for something like this
@@GlutesEnjoyer They're talking about these booths being used for public use the towns folk can walk to if they wanted to video call a distant relative. Not them having one in their house. Even if it were cheap this kind of thing would be thousands of dollars.
@@Slane583 yea and I'm telling you that's absolutely ridiculous fiscally. they have phones.
this product is for businesses. conferencing. etc. that's what this product is for. lmao have you even been to greenland? you'd be surprised the level of poverty they have.
@@GlutesEnjoyer I'm just telling you what Nioxic was getting across and nothing more. I never said anything about units like this being practical or cheap.
The only real use I can see behind something like this is conference calls for big business.
Possibly setup in a big room with multiple smaller rooms within as privacy booths. Or maybe in some ones office. This screams business uses to me.
It's amazing to see new tech being created and demoed. But seeing Marques and the team be more enthusiastic in trying it and sharing it with the world adds magic to the video.
It’s amazing, it looks like having a 5D theater at home for video calls, it’s actually the same effect but without glasses
Even better effect, because it track your head and eye, you can move your head to look things different perspectives on your liking
@@dancingpig168 yeah, a fantastic technology! We have to wait that it becomes smaller and more for everyone
@@sergioa.3752 Yeah! Imagine when this is built into phones and computers!
@@tbuk8350 It might take a while, we’re still fighting to have 1080p webcams and 120hz screens