Advanced Multitouch: Writing Without a Stylus and More

[MacRumors]

http://www.macrumors.com/images/macrumorsthreadlogo.gif (http://www.macrumors.com)

More Apple patent applications published today rehash previous patents applications (http://www.macrumors.com/2007/11/22/advanced-multitouch-gesturing-patents/) that were revealed in November. Still, the technology behind the advanced multi-touch are impressive enough to bear repeating.

http://images.macrumors.com/article/2008/02/21/121516-Picture 8.png

The patent, originally published in November 2007, describes methods for interpreting a remarkable amount of gestures that allow for a rich vocabulary of gestures -- such as interpreting the use of an imaginary stylus. The possibilities are best summarized by this description from PCJoint: (http://pcjoint.com/multitouch-20-comes-to-apple-devices/):- Need to move a cursor across the screen? Just slide your finger and it goes.
- Want to enter text? Just start typing and the text is there. You even get the touch feedback as if really pressing the keys.
- Need to erase some text? Use the backspace or just slide the finger backwards
- Have to write or draw something? Just pretend you hold a stylus or pen in your hand and start writing/drawing.
- If that is still not good enough, pick up the real stylus and start writing with it.
- All these cool touch gestures that Apple has implemented in iPhone and is exploring further? You know, scrolling, zooming, rotating & moving objects, etc; They are here too
- 3D object manipulation? Select a few 3D objects on the screen and use all 5 fingers on both hands to play with them.
- Want to take a break to relax and afraid to put your hands on the touch surface? Don’t worry Multi-touch 2.0 thingie knows that and does not pay attention to your resting palms or fingers
The surface used would be a larger curved surface, pictured above, resembling Fingerworks' TouchStream keyboard (http://www.macrumors.com/2007/11/01/apple-researching-touch-surface-keyboard/).

Article Link (http://www.macrumors.com/2008/02/21/advanced-multitouch-writing-without-a-stylus-and-more/)

[Grimace]

Put it on a multi-touch tablet and I'll pay $3299

[happydude]

Put it on a multi-touch tablet and I'll pay $3299

yah, no doubt. this is some pretty awesome technology. i'm sure we won't be seeing it in the immediate future, but the mid future looks pretty awesome!

i like the wording here: "Don’t worry Multi-touch 2.0 thingie . . ."

[twoodcc]

Put it on a multi-touch tablet and I'll pay $3299

i'm not gonna pay that much. but yeah, put it on a tablet, please

[justflie]

wowzas. I'm not quite sure how the writing without the stylus would work, but everything else looks fantastic. This type of product would be the next BIG thing (like all the iPhone buzz) that gets a ton of press.

[Shervin]

if Apple get this on MacBook Pro instead of the normal keyboard

I will just pre-order it right now...
sound so cool and official...

[Otaviano]

Apple should team up with Adobe and bring a mutli-touch Mac to the market as Adobe releases a compatible version of photoshop.

[sterlingindigo]

i'm not gonna pay that much. but yeah, put it on a tablet, please

Thank you!

[MrT8064]

so will we see this on the 2010' iMac?

[sterlingindigo]

Apple should team up with Adobe and bring a mutli-touch Mac to the market as Adobe releases a compatible version of photoshop.

Yes, anyone use Bamboo products by Wacom with Adobe (with Mac)? http://www.wacom.com/bambootablet/

[PDE]

I used to use a fingerworks touchstream keyboard and it's really great, but it take time to get used to. I'm sure Apple will develop it further so that eventually it can be used in a mainstream way. It's amazing to type on and be able to switch to gesture mode without lifting your hands. Once you get used to not having the physical feedback, it's a floating, seamless experience. Not for everybody, but definitely something that could be offered as an option.

I'm so excited that Fingerworks' technology is being popularized by Apple!!!

[amac4me]

This is so cool. :cool:

Chalk me up for a Mac with these features. I'll buy they day they are released.

[puckhead193]

Wirelessly posted (BlackBerry8130/4.3.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 VendorID/105)

I think apple is trying to invent the mouse and from the looks of it I can't wait to see this in Macs and iphones

[aaronsullivan]

It's fun to see Apple gradually preparing people for this with the MacBook and iMac and now every keyboard with the flat surface keys. Makes me think this could happen pretty fast. I mean, the MacBook Thin has the gestures... I could see this coming in 2009 even. As far as learning goes for the user, it's not that much of an adjustment.

[JC4]

Looks great. Bout time someone figured out how to merge the mouse and keyboard, so only on input device on my desk, plus not having to reach for the mouse all the time.

Where do I place my order?

[QuarterSwede]

You can definitely tell that Apple wants to make the "PC" world obsolete. If this came out and worked better than what we currently have, it'll change the computing world.

[elppa]

Doesn't look any more impressive than Surface to me. :)

[dernhelm]

A keyboard that eliminates the need for a mouse...

Yeah, I would buy that. Especially on a laptop.

This just gets better all the time.

Doesn't look any more impressive than Surface to me. :)

...And at only 0.001 times the cost!

[lazyrighteye]

Pretty neat to see (at time of posting) a 24 positive, 0 negative rating.
Pretty fascinating tech.
Can't wait to see this full-blown 'thingie' implemented in a Mac.

[tgildred]

Doesn't look any more impressive than Surface to me. :)


haha... I agree. Why would I want to seamlessly interact with my Mac via a small tablet or keyboard shaped peripheral when I could walk over to my coffee table and do the same thing for thousands of dollars more?
:)

[guzhogi]

I like how you can use a stylus or not. Some people may find using a stylus easier than your hands. Given that choice, many people should be happy. If you want to use your fingers, that's fine. If you don't like using your fingers, you can use a stylus & vice versa. From the picture, it looks like the screen's going to be different from the keyboard/writing area. That's fine. But I would still like something like the iPhone/iPod Touch where the screen & where you touch is the same thing.

I remember of an article I read about this OLED keyboard where each key has its own monitor and shows program-specific keys. Kinda cool. Also the consoles used on Star Trek. Those are cool. I remember in one episode of Voyager (I think "Year of Hell") where Tuvok becomes blind so he asks the computer to make his console tactile feedback. Pretty cool.

[iBunny]

Looks like a Helm console from the USS Enterprise (Star Trek)

:D

[applefan69]

Hows this for an idea f a macbook?

It's just like a regular macbook.... except

Where the track pad is, and for MOST of the keyboard (like going up to the number keys) is just one giant multitouch pad... It'd have to be completely revolutionary though. THEN, above that, at the top, where, like F1-F12 keys are, there would be well... basically function keys :p and they would be useful for things like...

F1 = turn multitouch pad into a keyboard (so that it now, functions like a keyboard and if you start typing on it, it'll be just like typing on a keyboard)

Other ideas of that sort. Idk, it's be weird and maybe feel gimmicky at first, but if apple could pull it off, it could be the futre of computers.

[crees!]

Doesn't look any more impressive than Surface to me. :)

Heh. Surface has a full-size computer with cameras in it now. It's nothing like this.

[macintel4me]

All I can say is "WOW"! I love it when a technology shift elimates traditional tradeoffs. Simply wow!

[applefan69]

Heh. Surface has a full-size computer with cameras in it now. It's nothing like this.


Yah, to my understanding, surface needs t have cameras and sensors, and special lighting conditions etc.

BUT... this is nothing more then just a screen or surface, that can detect multiple touches at the same time.

Then along with that, is just an amazing OS/firmware that apple has written that uses the touches it detects, and well interprets them to do things.

[mainstreetmark]

I wonder how the tactile feedback for the keyboard would be. I'm a pretty sloppy typer to begin with, so I imagine they have some form of iPhone keyboard tech going on under the hood. But, what, does it click or something everytime a key is registered?

Very exciting. I suspect the next generation notebook will have a wide trackpad, and that Air's trackpad is only the first step. It's not really all that good, after paying with it.

(Wow! Hardly any MBP whining, but not none)

--
edit:
In fact, how will you even know where the keys are? Will a KB pop up where you're typing? that'd be kind of neat. Automatically scaled to your particular typing habits.

[mooncaine]

Unless I can arrange the keys similarly to how they are arranged on my curved, ergonomic keyboard, it'll be useless to me. I hope they put enough corner-pins in there to let me put the keys in just the right spot for my hands. Now THAT would impress me.

[applefan69]

I wonder how the tactile feedback for the keyboard would be. I'm a pretty sloppy typer to begin with, so I imagine they have some form of iPhone keyboard tech going on under the hood. But, what, does it click or something everytime a key is registered?

Very exciting. I suspect the next generation notebook will have a wide trackpad, and that Air's trackpad is only the first step. It's not really all that good, after paying with it.

(Wow! Hardly any MBP whining, but not none)

also im wondering... what about people who dont knwo where all the keys are? What about people that NEEd to look at the keyboard?

I mean most of us computer users are quite good typers, and we never have to look down we just simply know where every key is.... but what about those who cant do that? How will they know how to type on this trackpad?

[bj3949]

Why can't we have a MacBook Pro with a multi-touch screen??
Why is no one pulling for this??
An iPhone-esque MacBook Pro.

Reply with your thoughts please.

[AlphaAnt]

Looks like a Helm console from the USS Enterprise (Star Trek)

:D

You know, when they were rumored to be bringing back the Newton, my first thought was that they should just make them like the datapad from Star Trek as well. They use the same interface style, after all.

Tech from Star Trek = Very Good Thing

[macintel4me]

Unless I can arrange the keys similarly to how they are arranged on my curved, ergonomic keyboard, it'll be useless to me. I hope they put enough corner-pins in there to let me put the keys in just the right spot for my hands. Now THAT would impress me.

Can you imagine move "keys" around in a similiar fashion you can move icons around on the iPhone/iPod touch!!? That would be AMAZING.

[MLeepson]

I mean most of us computer users are quite good typers, and we never have to look down we just simply know where every key is.... but what about those who cant do that? How will they know how to type on this trackpad?

I'm assuming (after just looking at the article, not the patent) that the virtual keyboard would appear after putting your hands in the home row (ASDFGHJKL) position (kind of like in the picture).

Also, If this were to be implemented, it probably would be implemented on a full computer, not just a track pad.

[notjustjay]

I hope that "multitouch 2.0 thingie" is the official product name :D

iThing 2.0. Coming soon to a MacWorld near you.

[ebouwman]

i'm not gonna pay that much. but yeah, put it on a tablet, please

Oh come on, just look at wacom tables. One of their smallest ones is almost $230 (http://www.wacom.com/intuos/4x6.cfm) thats only 4x6 inches and what this looks like is at least 12x6.

So lets just use the 2.4 Ghz 15 inch as an example (as it'll probably use more processing power). So thats $2500 plus the costs of the extra hardware. Pretty soon you're looking at that $3300 price point.

Apple should team up with Adobe and bring a mutli-touch Mac to the market as Adobe releases a compatible version of photoshop.

Photoshop is already compatible with similar things like the wacom tablets. Tablets are awesome for photoshop and it probably wouldn't be hard at all to translate that potential to this... ...keyboard thing

I remember of an article I read about this OLED keyboard where each key has its own monitor and shows program-specific keys. Kinda cool. Also the consoles used on Star Trek. Those are cool. I remember in one episode of Voyager (I think "Year of Hell") where Tuvok becomes blind so he asks the computer to make his console tactile feedback. Pretty cool.

I think that it'd be really cool to do something more like star trek, almost a cross between that OLED keyboard, this apple keyboard thing, and the iPhone. Also for people who want tactile sensation they could make it vibrate a little bit when you hit the keys, i know one of the LG phones does this with it's touch sensitive buttons.

So kind of make a big iPhone like keyboard, so that buttons can appear or disappear. It also would be cool for gaming because you could completely customize your control scheme rather rather than working around using the keyboard.

[MrCrowbar]

Damn, that looks promising. The hardware part shouldn't be the problem anymore I guess. Expcept that tactile feedback part... Can't wait for that. The Display Keyboard Mouse Interface is getting boring. :)

Imagine the iMac using this. The computer could be even more "in the display", including the human interface.

[flir67]

I think is will be the new multitouch keyboard that will double as a touch device for other programs such as photoshop and music productions.

[swingerofbirch]

What does it mean that it gives touch feedback as if really using a keyboard?

[brad.c]

Now that's what I'm talking (http://forums.macrumors.com/showthread.php?p=5003993#post5003993) about. Just yesterday, too. Hmm.

[guzhogi]

You know, when they were rumored to be bringing back the Newton, my first thought was that they should just make them like the datapad from Star Trek as well. They use the same interface style, after all.

Tech from Star Trek = Very Good Thing

Yeah, Star Trek has a lot of cool technologies. Plus, it kind of predicted some technologies:
-original communicator: cell phone
-holodeck: virtual reality

Now all we need are replicators, a real holodeck & transporters.

[kuwisdelu]

Why does everyone assume any kind of tablet-like device must use tablet-compatible software? I think the thing that would make this really take off is for Apple to produce, say, 10.6 interpret the gestures to be compatible with any application that would normally use ordinary input, just like you don't need special compatible software to use a trackpad instead of an ordinary mouse.

I'm excited.

[dubhe]

This is cool, but I hope it doesn't have to be in a bendy surface, otherwise my laptop is going to be a funny shape :confused:

Bring me new MBP, my PowerBook is in dire need of replacement!

[BrownManUPS]

I saw a TEDtalk on this, by a very cool scientist:

Jeff Han (2006) (http://www.ted.com/index.php/talks/view/id/65)

[kuwisdelu]

What does it mean that it gives touch feedback as if really using a keyboard?

Some people find it difficult to type without the feeling of the buttons actually feeling like they're being pressed like on an ordinary keyboard. I don't really understand why, as I've tried typing on a completely flat desk surface, and it feels fine to me. I'm not sure what's so confusing about it to people. But such a feature that would give the tactile illusion of actually pressing a button would silence some critics of a virtual touch keyboard.

[FleurDuMal]

omgwtf?!?! i want a mbp update!!! i h8 u apple!!!1 :mad::mad::mad::mad:


Just before anyone else did...;)

[asdavis10]

Already sounds light years ahead of the touch capabilities that are rumored to be implemented in Windows 7. Just imagine your laptop with no physical keys. Just one large multi-touch flat surface allowing you to do everything. Not to mention the new functionality you would get in a tablet form. I still would prefer a laptop over a tablet but its exciting to think about what could be coming. I still think these features are at least 2 years or more away. Apple has other technologies that they want to market first. But even 2 years would put it out at least a year before Microsoft releases their next OS. I think that Apple will bundle this advanced multi-touch functionality with a totally new OS. I don't see it being in the next OS as development had already been start before the release of Leopard and well before these patents were filed. So maybe another 2 OS's before we get this. Goodbye keyboard and mouse. Hello one nice multi-touch input device.

[mambodancer]

See my post here...

http://forums.macrumors.com/showthread.php?p=4682841#post4682841

[EagerDragon]

Could go on a tablet, but there is a shape similarity with some of the ergonomic keyboards. It would be possible to use a clear smoth but curved surface using OLED that takes all the keystrokes when typing and accepts gestures at other times depending on what is on the actual monitor. Similar to iPhone displaying buttons or other selectors based on the operation at hand.

I would welcome both, a tablet and a virtual keyboard / multitouch interface to a desktop system (device sits on lap or other convenient location).

Cool, but we may never see it, for now just vaporware.

[EagerDragon]

so will we see this on the 2010' iMac?

If they are going to market this or something similar, it has to comeout before Windows 7 or Apple would look to the masses like is copying M$.

To my knowledge Multi-touch (in a different form) is suppoced to be part of Windows 7. I seem to remember Bill said that.

[steerpikegg]

This sounds a bit like the technology from Minority Report (the film) to me.

Let's hope Apple don't start arresting people for stuff they haven't done yet :)

[EagerDragon]

This sounds a bit like the technology from Minority Report (the film) to me.

Let's hope Apple don't start arresting people for stuff they haven't done yet :)

Like the RIAA does?

[Billy Boo Bob]

I'd certainly be very interested in this as is, but I will be really impressed when one day (year) they can wrap a flexible LCD screen under the cover and make that the basis for a tablet type item. :cool:

[God^Cent]

Wirelessly posted (BlackBerry8130/4.3.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 VendorID/105)

I think apple is trying to invent the mouse and from the looks of it I can't wait to see this in Macs and iphones

Last I checked Apple invented the mouse:apple:

[!¡ V ¡!]

What next, interactive 3D OS? <-- similar to the Matrix or Johnny Nemonic.

How much power is being drawn to keep this touch screen active, unless there is a sleep mode where it tunes down and activates when touched to conserve power on a portable.

Touch screens is just an evolution of present input devices we have, for better or worse it will only be implemented further into future products by many vendors.

The idea sound neat, however the mass-market (international) will hold Multi-Touch fate. :)

[!¡ V ¡!]

This sounds a bit like the technology from Minority Report (the film) to me.

Let's hope Apple don't start arresting people for stuff they haven't done yet :)

Cannot believe I forgot to add this movie to the list of fantasy technology. ;)

Does predictive text count?

[Lepton]

i'm sure we won't be seeing it in the immediate future, but the mid future looks pretty awesome!I dunno, their line of displays has not been updated in a millenia. WHY? I have A guess.. Something big is coming.

[funkypepper]

Looks like a Helm console from the USS Enterprise (Star Trek)

:D


I want this with LCARS !

:D:D:D:D

I've always dreamed of that..

[FX120]

Last I checked Apple invented the mouse:apple:
If you want to be ignorant, sure.

Anyway, I think this thing would be useless without an LCD behind it.

Oh, and Microsoft surface isn't constrained to the coffee table type device, in theory it works with any capacitive touch screen.

[MacFly123]

Can't wait, looks awesome. I really don't think we will see this for about 2 years though. Right now Apple is gradually training us with little samples of Multi-Touch being put into the products and then in about 2 years when they release 10.6 they will fully implement it with these devices and the laptops will probably be keyboardless and just have a surface like this.

Now I do wonder about one thing... Windows is going to be adding this to Windows 7 and I know they will not be able to implement is as well as Apple already is with hardware. But isn't anyone concerned about standardization??? Right now as far as mouse and keyboard all OS's basically function the same. But with each having their own Multi-Touch, each OS is going to have totally different chords and gestures and it will be really confusing to go from one OS to another unless they standardize these chords and gestures. Anyone have thoughts on this???

[i.maverick]

Wirelessly posted (BlackBerry8130/4.3.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 VendorID/105)

I think apple is trying to invent the mouse and from the looks of it I can't wait to see this in Macs and iphones

reinvent
:cool:

[MacFly123]

Anyway, I think this thing would be useless without an LCD behind it.

Oh, and Microsoft surface isn't constrained to the coffee table type device, in theory it works with any capacitive touch screen.

Sounds like it would display things somehow. And for all you feedback people, Apple had patents a while ago about how parts of this thing would raise when needed like keys either with mechanics or by being filled with gel or air or something like that.

I dunno, their line of displays has not been updated in a millenia. WHY? I have A guess.. Something big is coming.

I don't think so lol. But they are pissing me off by not updating them because I need to buy a Mac Pro soon :(

Last I checked Apple invented the mouse:apple:

No they did not. They pioneered it just like Multi-Touch but they did not invent either. Ever heard of Xerox? ;)

Now someone said this can't be out in the next OS. I highly disagree. Apple still has almost 2 years till their next OS is due and that is plenty of time. They have been planning this in stages for years. Notice CoverFlow in everything now? Notice the iPhone and iPod Touch? Notice how they have made all their keyboards basically flat now? Notice how the laptops are getting Multi-Touch trackpads? This has all been planned and is leading to full implementation with these devices by 10.6. If they don't do it by then Microsoft will beat them to it with Windows 7 and all the training Apple has done will be in vain because people will learn a different style of Multi-Touch. You are also going to see the rest of the iPods go to Multi-Touch screens with the Nano and an iPhone Nano.

I am a bit concerned with standardization with everyone having their own style of Multi-Touch as I said in my previous post. If they don't standardize it somehow it will be really confusing to users on different systems.

[Ja Di ksw]

This sounds a bit like the technology from Minority Report (the film) to me.

Nah, that's Johnny Lee (http://youtube.com/watch?v=0awjPUkBXOU) who is giving us that stuff.

[YELLOWSOUL]

So this why the mac book pro hasn't come out yet....interesting...;)

[7on]

ever since I owned a Palm m515 I've said this was the future. Hooray that the world is catching up with me.

[SiliconAddict]

Again, much of this is going to be crapcanned due to prior art. Prior art that has been in place for years. Who does Apple think they are? I fully expect them to try and patent the finger next.
I think Jobs went Ape dung when Creative came at them for the iPod interface. We started to see a pickup in Apple patents soon after that. Right now I'm wondering if there is an internal web interface to submit patents inside Apple's intranet. At this rate they are going to outpace IBM soon. :rolleyes:

[SiliconAddict]

Originally Posted by God^Cent View Post
Last I checked Apple invented the mouse

No they did not. They pioneered it just like Multi-Touch but they did not invent either. Ever heard of Xerox? ;)


Thats mean. That's like letting a child know there is no Santa. Can't you let the fanboys have their fantasy? It makes them feel all happy and safe. ;)

[tgildred]

If you want to be ignorant, sure.

Anyway, I think this thing would be useless without an LCD behind it.

Oh, and Microsoft surface isn't constrained to the coffee table type device, in theory it works with any capacitive touch screen.


yeah, and in theory communism works... IN theory.

:)

[Delicious-Apple]

Can't wait, looks awesome. I really don't think we will see this for about 2 years though. Right now Apple is gradually training us with little samples of Multi-Touch being put into the products and then in about 2 years when they release 10.6 they will fully implement it with these devices and the laptops will probably be keyboardless and just have a surface like this.

Now I do wonder about one thing... Windows is going to be adding this to Windows 7 and I know they will not be able to implement is as well as Apple already is with hardware. But isn't anyone concerned about standardization??? Right now as far as mouse and keyboard all OS's basically function the same. But with each having their own Multi-Touch, each OS is going to have totally different chords and gestures and it will be really confusing to go from one OS to another unless they standardize these chords and gestures. Anyone have thoughts on this???

There is a group out there somewhere trying to standardize gestures for MultiTouch technology but I simply can't find it now that I want to post the link!!

[surferfromuk]

I say stevie and apple should go 'all out' and build this thing into a truly mondo-blowing paradigm shifting information manipulation device.
if they don't then why bother being Apple in the 21st century.

In fact didn't a certain Steve Jobs once say that he wanted to put a dent in the universe or why bother - well this is his chance.

Bet the farm on it - sh$t or bust I say

Certainly I'd buy one tomorrow in a flash and I have no new mac plans for at least two years.

[badNameErr]

How long will these patents last?


"...Apple patents use of hands. News at 11..."

[MacFly123]

Thats mean. That's like letting a child know there is no Santa. Can't you let the fanboys have their fantasy? It makes them feel all happy and safe. ;)

Hey, I might consider myself a fanboy too, but I'm not oblivious to the truth lol.

[MacFly123]

yeah, and in theory communism works... IN theory.

:)

LOL nice. Last I heard they still haven't even figured out how to do it without the cameras which is why it is in a ridiculous giant $10,000.00 table instead of a real device. Go Microsoft lol :rolleyes:

[Roller]

No they did not. They pioneered it just like Multi-Touch but they did not invent either. Ever heard of Xerox? ;)

Actually, the mouse was invented by Doug Engelbart at the Stanford Research Institute, although the moving ball mouse was developed at Xerox PARC about four years later.

[MacFly123]

There is a group out there somewhere trying to standardize gestures for MultiTouch technology but I simply can't find it now that I want to post the link!!

I'm glad to hear that and I would love to see it. I think that is going to be really important or it will all be one giant mess of a war to train people in each their own version of Multi-Touch and push users away in frustration.

[hiptobesquare]

Lot of good comments on here.

This is potentially exciting stuff.

I Liked the concept of the axiotron ModBook, where they lay the screen face up on the base of a MacBook.

Ever since the MBA hit, I have been thinking that a similar treatment to the MacBook Air, with iPhone's multi-touch would be WAY BETTER.

Solid state memory, no hinge, no double casing, thinner than MacBook Air, since it does have two folding pieces, but probably not quite as thin as just the main bottom case of the MBA. Screen face up, glass surface from edge to edge, with no raised border, like the iPhone. Also accelerometer equipped to change screen orientation to portrait view, perhaps even for all four directions, or even three, like the iPhone/iPod Touch.

Type directly on the screen, with an iPhone-like, but screen-sized keyboard, or a bluetooth external keyboard/mouse, which could be replaced with a bluetooth multi-touch input pad, using the described Advanced multitouch technology in a device the size of a keyboard. (it could even have backlit morphing key indications, similar to Kameleon universal remote controls)

More than one USB, and at least one firewire, or whatever next generation wired-peripheral bus protocols would be nicer than just one USB port, but that is do-able. As well with built in cellular network access, in addition to wifi. (even screen or voice-operated phone capabilities, with audio via bluetooth headset)

I would love it if it had a beveled charcoal-colored edge on the front side, like the iPod touch, and a black satin anodized aluminum back with a tapered profile, much like current MacBook Air, but dark, instead of silver.

THAT would be one heck of a PADD-like device. (Star Trek TNG, etc.. thin data tablet) and with some sort of well-integrated docking solution, could instantly be paired with desktop style multi touch or traditional input devices, larger video output or projection, or wired data transfer capabilities with storage arrays, and battery charging, if it doesn't employ inductive charging by that point.

I could see that technology also making it into multi-touch equipped iMacs, similar to a non-portable, and more feature packed version of what I just described, with input on the glass screen, or a multi-touch pad in place of a traditional keyboard.

Such devices as cell phone/hand-held devices, like iPhone/iPT, and even built into things as kiosk interactive displays, or other things where computer technology can act as a front end user interface for various machines and devices, just to have a gesture and typing interface right on a multi-touch screen. USS Enterprise, indeed.

[MacFly123]

Actually, the mouse was invented by Doug Engelbart at the Stanford Research Institute, although the moving ball mouse was developed at Xerox PARC about four years later.

Thank you. So I was right about what is today our mouse, but a little off in the initial :)

[applefan69]

Can't wait, looks awesome. I really don't think we will see this for about 2 years though. Right now Apple is gradually training us with little samples of Multi-Touch being put into the products and then in about 2 years when they release 10.6 they will fully implement it with these devices and the laptops will probably be keyboardless and just have a surface like this.

Now I do wonder about one thing... Windows is going to be adding this to Windows 7 and I know they will not be able to implement is as well as Apple already is with hardware. But isn't anyone concerned about standardization??? Right now as far as mouse and keyboard all OS's basically function the same. But with each having their own Multi-Touch, each OS is going to have totally different chords and gestures and it will be really confusing to go from one OS to another unless they standardize these chords and gestures. Anyone have thoughts on this???
naw microsoft will probably copy everythig apple does, making whatever apple does the standard :)

[asdavis10]

Now someone said this can't be out in the next OS. I highly disagree. Apple still has almost 2 years till their next OS is due and that is plenty of time. They have been planning this in stages for years. Notice CoverFlow in everything now? Notice the iPhone and iPod Touch? Notice how they have made all their keyboards basically flat now? Notice how the laptops are getting Multi-Touch trackpads? This has all been planned and is leading to full implementation with these devices by 10.6. If they don't do it by then Microsoft will beat them to it with Windows 7 and all the training Apple has done will be in vain because people will learn a different style of Multi-Touch. You are also going to see the rest of the iPods go to Multi-Touch screens with the Nano and an iPhone Nano.

I am a bit concerned with standardization with everyone having their own style of Multi-Touch as I said in my previous post. If they don't standardize it somehow it will be really confusing to users on different systems.

I did say it won't be out in the next OS and your comments really don't prove how it will. What Cover Flow has to do with patents for an advanced multi-touch system is beyond my comprehension. As well as flat keyboards signaling the arrival of advance tablet computing. Cover Flow is in everything now because it is a feature that Apple developed and was received well by consumers. Smaller keyboards can be attributed due to the fact that consumers want smaller peripherals. Don't just look at Apple, compare the size of keyboards produced by Dell, Logitech, etc. And as for your statement of how all laptops are getting multi-touch trackpads, well, your wrong if your talking about the trackpad of the MBA. Now if you referring to two-finger scrolling, then that doesn't count. Most laptops, Mac or PC, can recognize two points of contact. Windows 7 isn't due til late 2009 which is a rush date from MS's original release date of 2011. Only because Vista is such garbage that they're stepping up development. They are most likely going to have to scrap some features to accomplish this. Add that to the fact that Windows is designed as more of an enterprise OS than a personal computing OS. Corporations don't care about multi-touch capabilities and the tablet form factor. This means that Apple doesn't have to rush to bring this out. Jobs has said quite clear that he wants to push out a new OS every 18 months. Thats too soon for development, post Leopard completion, of an entirely new OS experience. Not to mention the new hardware that will need to be developed to support this. Apple is gradually giving it to us but we are far from what this new patent is describing.

[badNameErr]

Cover Flow is in everything now because it is a feature that Apple developed and was received well by consumers.

Nitpick: CoverFlow wasn't developed by Apple.

http://en.wikipedia.org/wiki/Cover_Flow

[asdavis10]

Nitpick: CoverFlow wasn't developed by Apple.

http://en.wikipedia.org/wiki/Cover_Flow

Your right. I just simply meant developed into the OS.

[MacFly123]

naw microsoft will probably copy everythig apple does, making whatever apple does the standard :)

Well ok, and I get you. But honestly they are both already working on their own so it won't play out quite like that this time.

[badNameErr]

I just simply meant developed into the OS.

Ah, cool.

[MacFly123]

I did say it won't be out in the next OS and your comments really don't prove how it will. What Cover Flow has to do with patents for an advanced multi-touch system is beyond my comprehension. As well as flat keyboards signaling the arrival of advance tablet computing. Cover Flow is in everything now because it is a feature that Apple developed and was received well by consumers. Smaller keyboards can be attributed due to the fact that consumers want smaller peripherals. Don't just look at Apple, compare the size of keyboards produced by Dell, Logitech, etc. And as for your statement of how all laptops are getting multi-touch trackpads, well, your wrong if your talking about the trackpad of the MBA. Now if you referring to two-finger scrolling, then that doesn't count. Most laptops, Mac or PC, can recognize two points of contact. Windows 7 isn't due til late 2009 which is a rush date from MS's original release date of 2011. Only because Vista is such garbage that they're stepping up development. They are most likely going to have to scrap some features to accomplish this. Add that to the fact that Windows is designed as more of an enterprise OS than a personal computing OS. Corporations don't care about multi-touch capabilities and the tablet form factor. This means that Apple doesn't have to rush to bring this out. Jobs has said quite clear that he wants to push out a new OS every 18 months. Thats too soon for development, post Leopard completion, of an entirely new OS experience. Not to mention the new hardware that will need to be developed to support this. Apple is gradually giving it to us but we are far from what this new patent is describing.

I invite you to open your mind a bit and see that the things Apple has been doing the last couple years isn't just coincidence.

CoverFlow is the most obvious implementation to introduce Multi-Touch into the GUI of the OS. Many people have noted that.

This patent doesn't talk about tablets at all, it talks about a keyboard type peripheral and I promise you it isn't just coincidence or consumer demand that made Apple introduce an almost flat laptop style keyboard for desktops. I have never seen a keyboard like this for desktops. If there were it wouldn't have been such a big deal when Apple released it with the iMac. This is a step toward the device the patent refers to.

I am not referring to two-finger scrolling on the laptops. The MacBook Air does have Multi-Touch in the trackpad unless you want to disagree with Apple on that, and you watch the rest of the laptops get it very soon as well. Right now the MacBook Air can read at least 3 points of input. This is again, a step toward more advanced 5 or 10 point Multi-Touch The desktops will then follow with the type of device this patent describes.

The entire OS would not have to be redesigned. As you can see that they are already implementing it with the MacBook Air in the CURRENT OS and GUI. The only thing that will change is the degree to which they are implementing it which is in stages. The final stage will give you the options we just saw of: "Normal", "Basic", and "Advanced Multi-Touch" in the system preferences. Steve wasn't just spewing words when he said Apple pioneered the mouse, the click wheel, and now they are bringing Multi-Touch to the market. The iPhone and iPod Touch are the products that are steps toward this movement.

As much as I don't care for Microsoft, they are starting to catch onto the consumers and the digital life. If Apple wanted to just take their sweet time and not worry about implementing Multi-Touch because Microsoft will probably delay again then they wouldn't be in the process already as we can see. I'm sure they want to get as far ahead as they can, and they have been waiting and strategizing for the "Vista Window of Opportunity" (no pun intended) for that to happen.

I don't think Apple will create an entirely new OS for this. They will build on the solid foundation they already have as you can see that they are already starting with the MacBook Air... Somehow they found time to get all that into the software already. And again they are already preparing the hardware RIGHT NOW with the MacBook Air and the other laptops will obviously follow.

So, I see no reason at all that Apple couldn't and wouldn't have this "Normal", "Basic", and "Advanced Multi-Touch" in 10.6. It is perfect to transition the user with the options. And then maybe the next OS after that really gets a face lift etc. But when the laptops are already headed there it is only obvious people are going to say..... What about the desktops??? Well, that is where this patent device comes in. Not that far of a stretch!

[ghettochris]

i have a gyration mouse, and i thought it was the most amazing thing ever, but you have to set it down to type well, or one finger peck with the hand holding the mouse. i thought how it would be nice to have a trackpad where the num pad would be on an extended wireless keyboard. then i thought, why not have they key surfaces be one big multitouch pad? nothing different with the keyboard, it would just be able to see when you fingers were touching, but not pressing keys. then i saw apple had a pattent for it. nice

[asdavis10]

CoverFlow is the most obvious implementation to introduce Multi-Touch into the GUI of the OS. Many people have noted that.

That statement couldn't be further from the truth. Cover Flow in OSX doesn't use multi-touch at all. As for Cover Flow on the OS of the iPhone and iPod Touch, it only uses one point of contact. Doesn't quite meet "multi-touch" criteria. Not a good point to try and prove your theory. Bottom line, the multi-touch device that this patent describes is like a quantum leap in multi-touch capabilities compared to what is currently available. And the masses are not ready for it yet. Apple will continue to give it to us in smaller portions before this comes out. A few more years my young padawan.

[winterspan]

Doesn't look any more impressive than Surface to me. :)

Keyboard sized multi-touch input panel vs. enclosed interactive table complete with 100 watt LCD projector, desktop PC, and overhead cameras ??

hmm... what to choose... what to choose... :p:p

[MacFly123]

That statement couldn't be further from the truth. Cover Flow in OSX doesn't use multi-touch at all. As for Cover Flow on the OS of the iPhone and iPod Touch, it only uses one point of contact. Doesn't quite meet "multi-touch" criteria. Not a good point to try and prove your theory. Bottom line, the multi-touch device that this patent describes is like a quantum leap in multi-touch capabilities compared to what is currently available. And the masses are not ready for it yet. Apple will continue to give it to us in smaller portions before this comes out. A few more years my young padawan.

LOL ok nice end lol. You ever see the Triumph at Star Wars bit lol? I never claimed that Cover Flow uses Multi-Touch. I do know what Multi-Touch is you know! I stated that it is an obvious move in the GUI to prepare things for a Multi-Touch interface and many many people have commented on that obvious fact. So was that all you had? Ok then ;) What's funny is that you are trying to argue with me so much when I am saying about 2 years and you are saying 3 (if you mean a few literally) lol. I don't really disagree with you in theory. I just recognize the "smaller portions" that they are already making in order to prepare us and you think they will take longer.

[Lord Sam]

Wow. How cool is that? I can't wait. In fact, if I had $1,000,000 to spare, I'd give it to them for a prototype. Now all I have to do is get a billion bucks. Maybe I'll write into Steve.

[kontheur]

http://www.frankreinders.nl/foto/800/itouch1.jpg

[floobloo]

Oh come on, just look at wacom tables. One of their smallest ones is almost $230 (http://www.wacom.com/intuos/4x6.cfm) thats only 4x6 inches and what this looks like is at least 12x6.

So lets just use the 2.4 Ghz 15 inch as an example (as it'll probably use more processing power). So thats $2500 plus the costs of the extra hardware. Pretty soon you're looking at that $3300 price point.



Photoshop is already compatible with similar things like the wacom tablets. Tablets are awesome for photoshop and it probably wouldn't be hard at all to translate that potential to this... ...keyboard thing



I think that it'd be really cool to do something more like star trek, almost a cross between that OLED keyboard, this apple keyboard thing, and the iPhone. Also for people who want tactile sensation they could make it vibrate a little bit when you hit the keys, i know one of the LG phones does this with it's touch sensitive buttons.

So kind of make a big iPhone like keyboard, so that buttons can appear or disappear. It also would be cool for gaming because you could completely customize your control scheme rather rather than working around using the keyboard.


You know what...Wacom tablets are completely overpriced. Yes they're good, but the technology hasn't really changed for 10 years. Oooooh they've got a bit bigger and added a few buttons here and there. It really gets me that no other tablet manufacturers get proper drivers made for the mac. They are so much cheaper! Am I in the slightest bit bothered by some silly extra buttons on my tablet? No of course not.

Come on Apple. Do it, and do it SOON.

[sachxn]

I wonder why heads of Nokia and Sony do not afraid of these things and bring out something more innovative. Apple is in real terms light years ahead of other biggies and even Armani.

Sachin (http://sql-plsql.blogspot.com)

[jouster]

Yeah, Star Trek has a lot of cool technologies. Plus, it kind of predicted some technologies:
-original communicator: cell phone
-holodeck: virtual reality

Now all we need are replicators, a real holodeck & transporters.

What? The communicator is a radio. Nothing more. It predicted nothing save maybe the clamshell form factor.

Virtual reality was being described long before the holodeck ever appeared.

[Lord Sam]

You know what...Wacom tablets are completely overpriced. Yes they're good, but the technology hasn't really changed for 10 years. Oooooh they've got a bit bigger and added a few buttons here and there. It really gets me that no other tablet manufacturers get proper drivers made for the mac. They are so much cheaper! Am I in the slightest bit bothered by some silly extra buttons on my tablet? No of course not.

Come on Apple. Do it, and do it SOON. I agree.

[MLeepson]

I found these:

1
US20080043428 (http://www.freepatentsonline.com/US20080043428.html)
METHOD AND APPARATUS FOR DISSIPATING HEAT IN A COMPUTER SYSTEM
2
US20080042989 (http://www.freepatentsonline.com/US20080042989.html)
TYPING WITH A TOUCH SENSOR
3
US20080042988 (http://www.freepatentsonline.com/US20080042988.html)
WRITING USING A TOUCH SENSOR
4
US20080042987 (http://www.freepatentsonline.com/US20080042987.html)
TOUCH SENSING THROUGH HAND DISSECTION
5
US20080042986 (http://www.freepatentsonline.com/US20080042986.html)
TOUCH SENSING ARCHITECTURE
6
US20080041639 (http://www.freepatentsonline.com/US20080041639.html)
CONTACT TRACKING AND IDENTIFICATION MODULE FOR TOUCH SENSING

[EagerDragon]

http://www.frankreinders.nl/foto/800/itouch1.jpg

Looks cool, nice job.

I guess if you connect it to the MacBook Air you can touch Air.

[gkarris]

Doesn't the MS Surface computer do all this already?

[QuarterSwede]

Doesn't the MS Surface computer do all this already?
I thought it used RFID tags.

Apple may not have come up with multi-touch (they didn't) but what they're good at is coming up with GUI's and gestures* that people will actually use and bringing them to market at least a year before any one else. Simply put, Apple is a company that brings others together to move the technology industry forward.

*even if they buy up companies to do so (ex. Fingerworks, CoverFlow).

[Section 8]

my only question is: who the hell votes a negative on this besides M$ fanboys, and if your an M$ fanboy, wtf are you doing on a mac only website?!

i mean, comeon, this is cool, how can you vote a negative on it :O

[skorpien]

my only question is: who the hell votes a negative on this besides M$ fanboys, and if your an M$ fanboy, wtf are you doing on a mac only website?!

i mean, comeon, this is cool, how can you vote a negative on it :O

Somebody made a comment in another thread that it could very well be somebody accidentally clicking around and hitting negative. I myself thought it was bull, until I was browsing MR on my iTouch and... accidentally clicked negative for an article! I'd meant to read the comments, but the article itself wasn't very positive (if I had to vote I would have given it a negative anyway, though I generally try not to vote).

Or it could just be somebody bitter at the world... Or they're doing it just because they can... As Penny Arcade says: Normal Person + Anonymity + Audience = Total D*ckwad

[-Noodles]

http://www.macrumors.com/images/macrumorsthreadlogo.gif (http://www.macrumors.com)

More Apple patent applications published today rehash previous patents applications (http://www.macrumors.com/2007/11/22/advanced-multitouch-gesturing-patents/) that were revealed in November. Still, the technology behind the advanced multi-touch are impressive enough to bear repeating.

http://images.macrumors.com/article/2008/02/21/121516-Picture 8.png

The patent, originally published in November 2007, describes methods for interpreting a remarkable amount of gestures that allow for a rich vocabulary of gestures -- such as interpreting the use of an imaginary stylus. The possibilities are best summarized by this description from PCJoint: (http://pcjoint.com/multitouch-20-comes-to-apple-devices/):
The surface used would be a larger curved surface, pictured above, resembling Fingerworks' TouchStream keyboard (http://www.macrumors.com/2007/11/01/apple-researching-touch-surface-keyboard/).

Article Link (http://www.macrumors.com/2008/02/21/advanced-multitouch-writing-without-a-stylus-and-more/)

so when'll we see the patents for moving the cursor with our ~minds~ ?? :cool:

[jaydub]

This seems like a logical next step. How great would it be to have a wacom pad built into the wrist rest of a macbook pro? :)

[ClassicMac247]

Absolutely amazing, i'd be first in line. However, i couldnt see apple having a curved keyboard like that, i think they would stick to their traditional rectangle.

[Aeolius]

like this?
http://www.artlebedev.com/everything/optimus-tactus/optitact-side.jpg
http://www.artlebedev.com/everything/optimus-tactus/

[skorpien]

Absolutely amazing, i'd be first in line. However, i couldnt see apple having a curved keyboard like that, i think they would stick to their traditional rectangle.

The curved keyboard makes more ergonomic and asthetic sense. Going from the MBA design, and seeing as how asthetics are a HUGE part of the Apple brand, I actually do see Apple going the way of the curved touch surface. But that's just my opinion.

[ZorPrime]

like this?

http://www.artlebedev.com/everything/optimus-tactus/

That's pretty kewl... it reminds me of the MCP Keyboard embedded in the evil corporate guy's glass desk in Tron.

[Lord Sam]

like this?
http://www.artlebedev.com/everything/optimus-tactus/optitact-side.jpg
http://www.artlebedev.com/everything/optimus-tactus/ Sweet, but where is the space for multi-finger gestures?

[MarkWayne]

Remember that with advanced MT, the application will configure the UI, not the other way around.
When you open Word, for example, you place your fingers on the MT pad in the most comfortable position and the alphanumeric keys arrange themselves in whatever weird curvy arrangement fits you best. The numeric keypad would no longer be rectangular - you just have a numeral under each of your digits.
You open GB, you get mixers, transports, and presumably a function key to move instantly among drag-and-drop customizable UIs. You open a boat-racing game, and there's a throttle, a steering UI of some kind, weaponry, whatever - it's no longer limited by the buttons on a device. Steve hates buttons so much that he will eliminate them from computing.
And computer graphics can introduce a whole new experience of finger-painting - instead of smeary strokes like you made in kindergarten, your fingers can trace vectors, hairlines, airbrush, wide, etc. The stylus and its variants - pencils, brushes - are so ancient they seem more natural to us than fingers, but they're not . . .

[diamond.g]

Sweet, but where is the space for multi-finger gestures?

Since it is just a touch screen, I would say the whole thing. Really Apple should just buy Art Lebedev and implement the designs.

[c:\windows]

Last I checked Apple invented the mouse:apple:

Douglas Engelbart invented the mouse. http://inventors.about.com/library/inventors/bl_computer_mouse_patent.htm