Pointing to the future of UI | John Underkoffler
HTML-код
- Опубликовано: 9 сен 2024
- www.ted.com Minority Report science adviser and inventor John Underkoffler demos g-speak -- the real-life version of the film's eye-popping, tai chi-meets-cyberspace computer interface. Is this how tomorrow's computers will be controlled?
TEDTalks is a daily video podcast of the best talks and performances from the TED Conference, where the world's leading thinkers and doers give the talk of their lives in 18 minutes. TED stands for Technology, Entertainment, Design, and TEDTalks cover these topics as well as science, business, development and the arts. Closed captions and translated subtitles in a variety of languages are now available on TED.com, at www.ted.com/tra....
Follow us on Twitter
/ tednews
Checkout our Facebook page for TED exclusives
/ ted
6 years, I haven't got it yet
+YASIR SAHEED Maan... All liers ! :P
9 years and nothing?
On a more serious note, the entry poing of these kind of systems are already on the market. The wii remote is doing some amazing things. The ps3 hand controller could be moulded into a glove and the xbox does away with all peripherals and only uses your body movements as input.
Couple this with the Oculus Rift and think of the possibilities.
Now you can be tired in vr!
huzzah. Not only is it cool, and innovative, but think of the shoulder muscles that nerds of the future will have! Great stuff
does no one else find this fascinating? it shows how far technology has come forward. I love it.
Mr. Underkoffler and his company needs to get on making this work with the Kinct and/or Leap motion controllers.
The future of UI?
"Okay, Google..."
Its a shame we didn't get exactly this, I could see there being a use for organising large walls of files to pick out a pattern that may not be as evident otherwise, for example. For better or for worse, we now have user interfaces that require learning a large number of gestures (looking at you, iPadOS)
Some of the things are here. Hand tracking on VR headsets, Leap Motion, it's just not as commonplace as it should be. Why are we still using those damn TV remotes?
It's cool because I've seen this before. Just a few days ago the people who are working on this went to my school and demoed it for us.
so its now 5 years later, where do i get it?
Love the way the whole development by Xerox - Research at Palo Alto of the first GUI, TCP/IP and Object Orientated Languages was not mentioned and the subsequent underlying code being given to Steve Jobs. Funny how time changes history
For Symbolics machine - OS called Genera - exactly agrees with this.
The OS is the interface
The Minority Report system is awesome, as people complain these days that computing is restricted to a single space, this system allows us to operate ANY WAY WE WANT. I can cook when Im computing, I can compute when I'm taking a shower, and I dont have to press any buttons!
@billyshake I know, just in my short life of 20 years the world has left so much behind. It boggles my mind when I take a look at the many technologies that have taken shape just in the last decade. So exciting, good thing I'm majoring in computer science :D
Google Translate:
On these interfaces have already talked about 10 years ago, and even, as we remember, in the "first" movie about it (Lawnmower Man) all it was. Then there was still a lot of films - Minority Report, where it is a (!) Interface, and hundreds of others.
But, IMHO, these gloves and such an interface at all - will never popular and never will replace the existing, familiar. For, because waving lot harder than moving a finger
look up leap motion, he was so right when he said "in 5 years". revolutionary stuff
Progress made, with the dued improvement in the future. We were waiting for something like this, right people? So lets root this on!
I agree with "unsteac", but imagine if this becomes mainstream. Can you imagine the potential this would have in the education field. How much more exciting and powerful learning will become.
Looks cool, but seems to be less efficient than mouse and keyboard.
My daughter was just asking me if these types of interfaces were "real." Well, I've seen the future, so now I can confidently say, yes Ana, they are real. In fact, this how we'll all be eventually interact with the ubiquitous computing that will surround us. A fascinating look at the future of user interface that every parent should watch.
Year 2014. Waiting for year 2015 when this is going to be made available commercially, and something tells me I am going to be disappointed.
Indeed.
This technology replaces the mouse and keypad, but the user is still waving their arms around while looking at a monitor.
Touch screens and 3D holograms are far more natural and interactive.
I will make a note in my diary to watch this video again in 5 years.
Good for these researchers, I find these new interfaces very impressive and I'll be excited when they come to market at a reasonable price...many, many ways to benefit from these technologies when you sit down and think about it!
Impressive work ! I can see the medical applications, design ...etc for navigating into 3D medical scans, building with ergonomics in mind.
@jathgnos Why sit? There's a growing trend to standing while using a computer, and it's healthier. This goes in line with the trend to a healthier minimalist future. A few hand motions means less exercise you have to do later. The key is that the hand movements will be more productive than even the small hand movements of using a mouse right now.
Oh man this will be great!Sorry if I'm simply impressed those with more experienced in these kinds of things might not be.But I haven't seen that many people actually trying to innovate and make those ideas thought science fiction reality.It's nice to know that drive has survived.I think he's optimistic with the time frame though.I expected by now that computers would come standard with your house but...
I think the big issue will be for software design to embrace the technology. If the hardware for a '3D interface' adds, say, $300 to a computer's cost but only a few applications or games can take advantage of it, those systems won't sell and consequently, new programs will not be designed for that technology.
There is a big gap between being a novelty with a few obscure uses and becoming a universal standard for personal computers. But I hope it does become mainstream in the near future.
this is really interesting , but is it more efficient to work like that or to work with a mouse and keyboard , or even a touch screen ? workflow efficiency is something that it should always be considered
3:10 iBoys always ready to clap at any announcement of feats
well i was blown away with the "sixth sense" unit featured on TED earlier in the year (or late last year). But, this! I think the ultimate goal would be for the 2 technologies to coencide and create a truely "organic" fusion. Lets face it, we want gestures not hardware to control what we do. I remember 5 years ago, Virtual Reality seemed like only fantasy within a room specifically built, costing a lot to do the very basics. Now, we are looking at VR in every home!
We should congratulate scienc
This interface, or a similar variant for the Motion Leap would be excellent! I hope they are already on the drawing board! :)
@VitriolicAC Well, I think the story goes that Xerox's research job was introduced to Steve Jobs who saw that it will be the future (unlike the decision makers at Xerox). So Xerox didn't ever actually sell any computers and Apple may have been the first to actually sell a computer with a graphical UI.
Just like they didn't invent the mobile phone or touch UI but are now doing very well with the iPhone(s).
i wish they had more close-ups of his hand gestures
Are you kidding me?
The future of computers, and for nearly a minute, the video editor is fixated on the goddamned POWER POINT!
I love TEDtalks- I am a daily subscriber.
But I suspect one of the reasons it is not yet mainstream is that the editors (or real-time directors) haven't a friggin' clue or care about what they're doing!
TED is amazing. It needs video coverage (and by extension, proponency and archiving) that conveys its impact.
Bottom line? When in doubt, go to the wide shot. Please.
@lanmancz - Yeah that seems so much crazier then pushing a little hunk of plastic around your desk and clicking on it.
@whatnameisavailablee
yes it is. its the way we talk to the computer as in the computer getting data not just information it knows nothing to do with
The first killer app? Probably a music player, e.g. flip through your record collection, sort by artist, style, etc.
@zoneykid He was referring to the earlier System operating systems in the eighties.
@zoneykid he is talking about the overlay was build from scratch its core is unix yes but the rest of it is not.
It will really requires different OS design and hardware compared to we use now...Its also can change programming software and websites.
@renesis317 Right, cause there's no issue at all with accidentally turning on your stove and unlocking your doors. What kind of interface does your fridge have? I pretty much just open and close it.
Though to be absolutely fair, it would be a pretty damned fun thirty minutes.
@TacticusPrime Haha! But that's probably the best way to get it to really take off.
this would probably revolutionize construction.
I watched this yesterday and have had some time to think about it... maybe in certain applications (like at stores, museums, theme parks) this technology will be useful, but if it comes down to me having to choose between walking over to various shelves to grab containers instead of using my mouse and clicking on a folder ("virtually" the same thing (pun intended ^.^)), then I'm opting for the mouse...
kinect didn't come out till november 2010 .. this was uploaded in june 2010
There are 2 ways to go about it:
1) Easy, intuitive and inefficient
2) Complex, non-intuitive and efficient
One example would be the iOS on the iPhone and Terminal on Linux. Terminal needs a bit of learning and practice but once you do, your productivity increase like a ninja.
The irony is that I've been working on TONS of not only new applications that would demand this interface and even MORE elaborate body gear and 3D minded devices, but even steering elements in the software industry that the very DENOMINATOR of information handling and OS interaction would make a 2D monitor with a mouse/keyboard, not only counter-productive but IMPOSSIBLE! Even with all that being said, *I* myself even feel that it'll STILL take a few DECADES for this UI to be mainstream!!
@zoneykid Uh.. he was talking about the original Macintosh home computers, and the old (pre-OS X) versions of Apple's OS. Apple didn't switch to a Unix-based OS until the advent of OS X. All the previous versions, are, as he says, based solely on Apple code. Considering the Macintosh home computer came out in 1984 and OS X was released in 2001, his claim is correct...
@zoneykid It was written from the ground up / started from nothing. He's referring to the old Mac operating system, written in the 80's. Not the current version which is OS X and is indeed built on top of a Unix flavour. Check out Andy Herzfeld website Folklore for some great stories on the development process of the original Mac operating system.
every action generates a reaction.
A gesture based system though intrusive, will indubitably engender
calorie consumption. Need I say more?
12:20 "Great art is always a gift" - annoyingly John doesn't reference the quote - anyone know who said this?
@lanmancz imagine ur case linked up to a projector and a wall in ur house as your interface... i could certainly imagine myself sitting on the couch tossing documents around the wall....theres nothing more useful than having multiple images infront of you to see the whole picture. imagine creating mind maps on your wall, with such space comes more visible detail
Brilliant talker
2013 checking in here....he's got 2 more years and this stuff is in our mobile phones....
@untseac did you watch 'til the end? he said they're working towards getting rid of the gloves
@zoneykid he's talking about the original OS. Circa 1980's - and he's using it as a metaphor not a literal example.
I think it will be more of an extension than a replacement
I think most people understand that, I mean they at least are interested enough to watch TED talks in the first place, I don't really hear too many people saying it isn't worth researching, rather I hear people mention that for long term use it could perhaps be impractical for say "office" work.
I'm still waiting for the UI where I can control a computer by plugging a cord into my skull.
well coming to the end of 2014, and it doesn't look like there is much hope of this vision being here by next year. However, significant progress has been made. Everyone has heard of Microsoft Kinect, which for some reason people weren't really interested in with the Xbox One. But that enables proper 3D interaction. Leap Motion does the same sort of thing, and was actually built in to a bunch of laptops. So we're part of the way there. People just don't care enough about this sort of thing yet it would seem. All it will take is one killer app though ...
I think Chris has asked a very important question, indeed, "When?" We want it on our computers, not in TED.
remixing will be amazing!
@VitriolicAC Wasn't the mouse and the graphical UI developed in Xerox's Palo Alto research center way before the introduction of the Macintosh?
To those of you saying that you'd rather use a mouse and keyboard for use with office software, I don't think this technology is intended to replace conventional input devices for all applications.
@TZMSocialEvolution I have no problem seeing why this would be better for a lot of computational operations, particularly the example of working in architecture. But why would it be better for reading, or watching movies, or browsing the web? It's not a matter of naysaying for the sake of it; it's a question of whether this is actually a "scientific advance," as you say.
I think that this could be used by 3D-artists, gamers, Graphics artists and many more. I don't believe that this technology will be something that "anyone" can buy within 5years but I can see why this would get popular when it does come out on the public market.
@untseac the power glove was advertised as a gaming accessory, and the technology featured in the video is designed to be another way of manipulating a computer's UI. It's also soon to be glove-less, so it's pointless comparing it to the power glove. I don't see it being used by every person, but schools, businesses, and the military could definitely benefit from it. Just 'cause the 'average joe' won't use it doesn't mean it's going to fail.
I like the concept and I think it will be very useful for large data centers and places that he mentioned, however practical every day use might be a harder sell. Say you work at a job where you use a computer 8 hours a day, you wouldn't wanna be moving around like an orchestra conductor that entire time, it would be a workout. I'm not talking shit, I love the idea and I can totally see it use. I'd just rather use a mouse and keyboard instead for extended periods.
commercial computers that perceive the real world? yes please!!
@CarbonatedCube I think it was similar when they first came out with a mouse and a light pen in the 60s.. it took decades for these UI to become useful.
I agree with you that this UI won't be of any use except for a toy, let alone entering the market in 5 years. It is interesting to see something new in action though.
I can see how this might be used (army, NASA, teaching in schools, city planning, future of Warhammer, gaming arcades) but I don't think that this is the future of the personal computer.
Eerie and wonderful
the interface is not allways the os if you take a look at linux the gui is seperate (and even optional)
+Fennec Fox (FennecTECH) yes and no, the gui is the graphical user interface. and yes, your graphical user interface is optional.
But you will always get an interface (probably the command line if you don't get a gui)
i suppose your right
@TZMSocialEvolution Then it remains to be seen if this UI is actually better than the keyboard/mouse paradigm. Seems like you were saying it's just an advancement, but until it shows itself to be better, I'll personally remain skeptical as to whether it should be implemented for the majority of PCs.
pretty neat stuff.
If only we were all urban planners that needed to play around with shadows of structures, or doing whatever work needs to flip photographs around all day, or generally doing work without requiring the simple precision and ease of a wireless mouse.
Fascinating!
Half of TED talks seem to be about optimization, of energy, space, or time. So why do these interfaces always lead towards using more energy to use by moving your arms about constantly. Needing large screens, which are much more costly and require low resolution to become buyable. The reason the mouses replacement for laptops was a touch-pad is because it required much less movement. That is also why on the large-scale large touch-screens never sold well, and that also includes current tablets.
Fantastic.
Well the first thing needed is a monitor that can grab all the singles from the hand and input them into the machine But then when your windows Hang Up then what? Slow Motion Sign Lang?
@Digeridude
Well, you could just use your arms to move a cursor around and it could work the same as a mouse.
And just think about how BUFF your arms will get.
@martyyu 3D manipulation made easy, manageable, and uncomplicated. I don't think he was completely there, but I didn't have too much trouble following him. Currently we use interfaces that operate on a 2D plane, or awkwardly try to replicate 3D planes that must be navigated using controls built for 2D.
now that is the kind of imagination we need, if you can imagine it, it can happen.
@sesoma0 well considering a huge number of people are already using a system very similar to this in the form of the Nintendo wii 5 years may well be possible.
5 years!!!
Nope
Okay, bro! You just made me google and "youtube" that guy! That guy's brain was obviously working HARDCORE overtime! Thanks for making the reference!!!
these types of technologies take years to become practical. give it time and and the mouse and keyboard will look like antiques eventually.
@billyshake it damn right is, the only problem with negative insanity is that it usually tends to slow down, if not, block the progress of such great endeavors. People need to work together and not depend on ancient dogmatic belief systems to guide and rule their lives. You have to be free in order to change and progress.
Leap Motion will let you have this system, all in one tiny box on your desk for $70, next year. The future in within reach.
Yeah, dude, I know! I completely rejected that when I first saw this video! I thought that a guy this smart was SO wrong because he is entrenched in a mindset that THIS is the future, and all of his premises that he used in this presentation, I feel to be 100% TRUE. The problem is that the interface will NOT replace the mouse/keyboard until they become 100% UNBEARABLE, meaning that ALL programs would have to *demand* this interface, as opposed to just being a cool toy.
I play with this stuff for a while. Just download the template. Go to buzfeed.com and search for futuristic interface. it's a graphic layered kit you can animate, use for mockups, FB profiles, pranks, CD covers, posters, etc. Pretty cool actually...
@Undeterminable From a games design perspective Natal is trying to do just this but we've yet to see the results from that. It just won't include the gloves.
SO wait... what I could previously do with a mouse sitting down I can now do standing up wearing gloves. Great!
This wont be interesting until the use of a LCD screen turns into the use of actual Holographs. The Hand gesturing and Interfacing is the easy stuff, the Presentation and actual Holohraphic object orientation is the hard thing, but it will come, definitely will come
yup, but I see no commercialisation at all by now. The system shown can really improve ways we arrange our data by intuitive interfaces, every people, teachers, students, employees would dearly need it, but can you get it into market faster? Even Johnny Chung Lee did not make something near this. he would just make something finger-detection which is way not even a finger-orientation recognition thing.
@martyyu Well, I know how easy it seems in a game designed to utilize the current keyboard/mouse, but with a 3D modeling programs, the shortcomings become a lot more obvious. Rotating and moving an object along three planes can be completely frustrating; a 3D interface and controls to match could make it as if you were crafting things out of clay right there in your workshop.
I need that! It's amazing!
No it won't lol, Civilization V on this? Wooooooo :)
This is amazing
With that you'll have a lot of office-workers with big shoulder-muscles! And co-workers with just one eye..... It's nice to navigate through your files just like that, but wouldn't it be easier (and faster) without spending so much time on big movements? If we wanted to do sport at work, we could have kept the shelfs and closets and just stand up and get the damn file. Keyboard, mouse and of course touch-screens are still more efficient. And you can scratch your head without deleting anything.