Lets brainstorm the ultimate input device...
The mac is 20 years old and we (most of us anyways) are still using QWERTY keyboards and mice, despite their tendancy to cause carpel tunnel syndrome and their inefficiencies. What improvements could be made?
I'll start with an idea for the pointing device:
If Mac OS X had image recognition software that could run in real time and analyze video of the users eyes taken from an iSight, it might be possible to figure out where they were looking on the screen. If this could be done to near pixel level accuracy, then wallah, throw away your mouse, put both hands on the keyboard and work more efficiently. When you need to click on something, just look at it and blink, or press the foot pedal, or a special "click" key on the keyboard or whatever - but no need to interupt your work by taking your hands off the keyboard.
On a bit of a technical note, I imagine one way to acheive this (on single monitor systems anyways) is to display a colored dot in each corner of the screen and then look at where the reflection of those four dots are in the image of the pupils of the viewer. Find the center of the pupil relative to the dots, compare the coordinates to an interpolated calibration set of measurements and you've found where they are looking. Now accuracy, speed, processor load, and dealing with multiple monitors or multiple viewers could be issues. But wouldn't this beat point and click?
I'll start with an idea for the pointing device:
If Mac OS X had image recognition software that could run in real time and analyze video of the users eyes taken from an iSight, it might be possible to figure out where they were looking on the screen. If this could be done to near pixel level accuracy, then wallah, throw away your mouse, put both hands on the keyboard and work more efficiently. When you need to click on something, just look at it and blink, or press the foot pedal, or a special "click" key on the keyboard or whatever - but no need to interupt your work by taking your hands off the keyboard.
On a bit of a technical note, I imagine one way to acheive this (on single monitor systems anyways) is to display a colored dot in each corner of the screen and then look at where the reflection of those four dots are in the image of the pupils of the viewer. Find the center of the pupil relative to the dots, compare the coordinates to an interpolated calibration set of measurements and you've found where they are looking. Now accuracy, speed, processor load, and dealing with multiple monitors or multiple viewers could be issues. But wouldn't this beat point and click?
Comments
Originally posted by peteman
Wouldn't this beat point and click?
No.
Peteman, in case you were serious about your ultimate "optical mouse", do you have the eye discipline to not look at anything but the pixel of choice? Its like when a buxom woman walks into a room. Dont look at her boobs, dont look at her boob, dont look at her boobs...doh!
Two words: anal joystick.
Originally posted by shetline
Ultimate input device?
Two words: anal joystick.
I can see it being advertised...clicking also strengthens your PC muscle!
They are testing devices on monkey that you can control the cursor with your brain, once this is refined and any hazards work out this will be awesome...although I'd guess you need surgery to have it work and that would suck.
Originally posted by reynard
Peteman, in case you were serious about your ultimate "optical mouse", do you have the eye discipline to not look at anything but the pixel of choice? Its like when a buxom woman walks into a room. Dont look at her boobs, dont look at her boob, dont look at her boobs...doh!
Hmm, put it this way: Do you ever click on something that you are not looking at? Sure when you are scrolling or doing repetitive clicks maybe, but for general mousing I bet you'd have a hard time navigating a GUI with a mouse or any other input device while your focusing on the buxom woman who just entered the room.
Originally posted by peteman
...
If Mac OS X had image recognition software that could run in real time and analyze video of the users eyes taken from an iSight, it might be possible to figure out where they were looking on the screen. If this could be done to near pixel level accuracy, then wallah, throw away your mouse, put both hands on the keyboard and work more efficiently. When you need to click on something, just look at it and blink, or press the foot pedal, or a special "click" key on the keyboard or whatever - but no need to interupt your work by taking your hands off the keyboard.
...
They already have technology to do that. I think it uses a laser. But where you're looking is not where you want you mouse to go. People blink all the time too so that mouse would click all the time.
Originally posted by Scott
They already have technology to do that. I think it uses a laser. But where you're looking is not where you want you mouse to go. People blink all the time too so that mouse would click all the time.
Last I heard that technology was in cameras to focus on the subject the photographer is looking at, but I never saw it used with a computer before.
If not that then maybe like on Andromeda where you can jack your brain into the AI?
We have just such a system in my research group, implemented initially by yours truly.
Oh, and it's MacOS X only. The Windows graphics architecture won't let you accomplish the critical part.
A standard FireWire camera, a simple little app, and a brightly colored thimble is all that's needed, no calibration necessary, anyone can use it.
I gave a demo at UIST'03 in November in Vancouver, and people couldn't believe how simple it was to use... and that was on my 15" 1.25GHz PowerBook G4.
On a dual G5, it hardly affects the rest of the system at all.
Originally posted by reynard
A firewire port on your neck to connect your brain to the computer??? Are you serious?? Firewire your brain to a computer--thats beyond ridiculous. You would need a fiber optic connection at least. Well, there is firewire 1600 and 3200 coming out. They may provide enough bandwidth for some people's thoughts.
reynard,
Don't you understand sarcasm? That's what the meant at the end.
Originally posted by Kurt
reynard,
Don't you understand sarcasm? That's what the meant at the end.
speech reecognition in a superb form.
i just want to lean back and have a good time... i could use my hands and eyes for other stuff... but: the keyboard and mouse has to stay for the simple reason that when i'm on the phone and want to make some notes i don't like to make a phone-conference with my computer and customer *lol*
edit: i thought about this: there has to be an application to automatically make notes from phonecalls - for a start this can write down and save what is said with a speech recognition that can find out which voice is yours and which is the one of the other person.
also - the applications have to be changed... instead of clicking somewhere the input fields need an identifier which can be said as a placement command. hmmm or we need a combination of a pointing/grabing device and speech recognition to replace the keyboard...
whatever - i like the pointing device in minority report... we also need bigger screens... do we say: dual-3d-projector or something
Originally posted by Scott
... People blink all the time too so that mouse would click all the time.
Not a blink, but a wink. That way you would have a left wink and a right wink. Of course Steve would never approve of a dual wink input device.
Not to leave the ladies out, Apple can build something to _accommodate_ them too.
Originally posted by reynard
Firewire your brain to a computer--thats beyond ridiculous. You would need a fiber optic connection at least. Well, there is firewire 1600 and 3200 coming out. They may provide enough bandwidth for some people's thoughts.
You must be joking. For most people's thought bandwidth a 9600 baud serial cable is overkill.
Originally posted by Krassy
whatever - i like the pointing device in minority report...
*AHEM*
See my earlier post.