Apple Researching Multi-Touch Skins and New Gestures

[MacRumors]

http://www.macrumors.com/images/macrumorsthreadlogo.gif (http://www.macrumors.com/2008/12/18/apple-researching-multi-touch-skins-and-new-gestures/)

Apple's patent applications sometimes enter into bizarre and conceptual territory. This week's patent application (http://appft1.uspto.gov/netacgi/nph-Parser?Sect1=PTO2&Sect2=HITOFF&p=1&u=%2Fnetahtml%2FPTO%2Fsearch-bool.html&r=1&f=G&l=50&co1=AND&d=PG01&s1=20080309634&OS=20080309634&RS=20080309634) reveals research into portable multi-touch skins that can be placed on three dimensional objects: The one or more multi-touch skins enable multi-touch inputs during the operation of the object. The multi-touch inputs can be tracked to monitor the operation of the object and provide feedback to the operator of the object. The one or more multi-touch skins can further enable gestures for configuring and operating the object. The one or more multi-touch skins can also be used to implement any number of GUI interface objects and actions. A multi-touch skin that measures the force of a touch in one or more directions is also provided.The Multi-Touch skins could be used on sporting equipment such as a tennis racket, golf club or hockey stick. They could also be applied to steering wheels: Multi-touch skins 410 and 420 can also be used together to configure the operation of the vehicle (e.g., its steering wheel) and another skin. For example, the tapping of two fingers on multi-touch skin 410 can be used to change the mode for multi-touch skin 420 from volume selection for the radio to wiper speed selection. The tapping of an index finger on multi-touch skin 420 would then correspond to a step increase in wiper speed while the tapping of a pinky finer would then correspond to a step decrease in wiper speed.
Perhaps more practical is a set of new multi-touch gestures (http://appft1.uspto.gov/netacgi/nph-Parser?Sect1=PTO2&Sect2=HITOFF&p=1&u=%2Fnetahtml%2FPTO%2Fsearch-bool.html&r=1&f=G&l=50&co1=AND&d=PG01&s1=20080309632&OS=20080309632&RS=20080309632) described by Wayne Westerman formerly of Fingerworks. Westerman describes the detection of a pinch/rotate/drag motion that could be used on a multi-touch surface.

- For example, a user can pinch the GUI object to grab it while dragging it to a desired location by translating the pinching fingers along the sensor panel surface to a desired drop location.
- Because a combined finger pinch/translation/liftoff gesture is a "dramatic" gesture, it can be used to throw a GUI object in the trash or to another desktop or window, minimize a window (pinch to minimize while translating to send the minimized window down to a corner), or send a file to a printer (pinch to select while translating to a printer icon), and the like.
- Another embodiment can be a pinch and pick up gesture, wherein proximity sensors detect the direction of the hand after pickup. A screen may then be activated in that direction (either highlighted or opened).



Article Link: Apple Researching Multi-Touch Skins and New Gestures (http://www.macrumors.com/2008/12/18/apple-researching-multi-touch-skins-and-new-gestures/)

[iDrum]

Hello Minority Report!

[themoonisdown09]

This is a little out there, but I can see how this could be useful.

[talkingfuture]

Sounds a long way off. It will be interesting to see what happens with multi-touch over the next few years. I reckon Apple have some big plans.

[CartoonChess]

You'll only drum along to your favourite song and swerve recklessly after your hood pops itself once.

[kkat69]

In business there's a good rule of thumb/Lesson and it's one Apple learned long ago the hard way. If you have a unique idea/concept... patent it, or at least apply for it.

You never know when someone might come along with something similar or identical and you wish you did own the patent for it.

[tosui]

This actually is a very brilliant and very *practical* idea right now.

Imagine the next MightyMouse with a multitouch surface on the front end, so you can use your thumb & fingers to do things like pinch (thumb & first finger) or scroll/swipe (two fingers, three fingers, or four fingers, in any direction).

This would 1) bring the new functionality of the trackpad to the desktop (which Apple would like), and 2) blow away any other mouse!, and 3) bring more people to Macs, as this would only work on OS X!

Seriously, I bet we see something like this sooner than we think.

[idiosyncratic i]

If the skins could be made flexible, it could open up a whole new realm of possibilities. Devices that accept touch input could change their shape based on the input, to allow for tactile feedback. I'm thinking of mostly keyboards that could reconfigure themselves. But in the steering wheel example, there could be a gesture that triggers volume control, and then a little nub pops up to indicate where the volume is set to. As you drag your finger, the nub moves along with it. That sort of thing.

[idiosyncratic i]

This actually is a very brilliant and very *practical* idea right now.

Imagine the next MightyMouse with a multitouch surface on the front end, so you can use your thumb & fingers to do things like pinch (thumb & first finger) or scroll/swipe (two fingers, three fingers, or four fingers, in any direction).

This would 1) bring the new functionality of the trackpad to the desktop (which Apple would like), and 2) blow away any other mouse!, and 3) bring more people to Macs, as this would only work on OS X!

Seriously, I bet we see something like this sooner than we think.

I bet you're right about using the technology in a mouse. Though I wouldn't venture to predict how long it would take them to actually get the technology into a product.

[puckhead193]

i could see a golf club incorporating a skycaddy type of device into it, but on a hockey stick...why would a hockey player need multi-touch on his/hers stick :confused:

[markfc]

at last we can say goodbye to the bloody mighty mouse rollerball!

[t0mat0]

Apple's venture into sensors?

[hok]

Multi touch dildo

[lofight]

Multi touch dildo

If they can do Multi-touch, they can do vibrate.
A Multi-touch vibrator.

[zombitronic]

I bet you're right about using the technology in a mouse. Though I wouldn't venture to predict how long it would take them to actually get the technology into a product.

Maybe sooner than you think. Apple applied for a patent (http://www.macrumors.com/2007/07/05/apple-investigating-mulittouch-mouse/) for a Multi-Touch Mouse over 2 1/2 years ago.

[anubis72]

Multi touch dildo

LMAO! I think everyone is thinking a little too literally. Hockey players wouldn't need a multi-touch surface on a stick, but GAMERS playing a hockey game might want to actually use a hockey stick rather than a controller...

It would make sense that Apple would delve into the Wii-style game console arena as they have with the iPhone/iPod touch games. This would take it to the next level.

"Guitar Hero Kids" might actually have to learn how to play the guitar <gasp>!:eek:

[azaas]

Looks cool and promising but i wouldn't even dare ti guess what Apple has in mind patenting that...I can see that happening on the mighty mouse but that's as far as i go :P

[Peruchito]

LMAO! I think everyone is thinking a little too literally. Hockey players wouldn't need a multi-touch surface on a stick, but GAMERS playing a hockey game might want to actually use a hockey stick rather than a controller...

It would make sense that Apple would delve into the Wii-style game console arena as they have with the iPhone/iPod touch games. This would take it to the next level.

"Guitar Hero Kids" might actually have to learn how to play the guitar <gasp>!:eek:

i was thinking the exact thing. the uses are endless.

[GQB]

And to think my daughter doesn't think there's any application for the piano practice.

[tosui]

Maybe sooner than you think. Apple applied for a patent (http://www.macrumors.com/2007/07/05/apple-investigating-mulittouch-mouse/) for a Multi-Touch Mouse over 2 1/2 years ago.

Awesome! (And, I may be right!)

I want one, um... NOW!

[Detlev_73]

Perhaps a Multitouch Netbook-ish Tablet without a physical keyboard? :)

[OdduWon]

Hopefully this technology will make it's way in to the mighty mouse. the current "track Ball" is sub par. A MT skin over the contoured shape of the new mouse could prove very useful, more functions, more accurate, and even more "funnest" (tm apple 2008). An all glass mouse maybe? or atl east one that has a scroll that is reliable.

the future is now, will there be mice in it? you decide.

[crees!]

I bet you're right about using the technology in a mouse. Though I wouldn't venture to predict how long it would take them to actually get the technology into a product.

The new Apple pro keyboard. A touch surface that has specific configurations for the app you're using.

[Digitalclips]

It's a shame in a way this stuff gets out (I know it has to). Microsoft's R&D department must spend a lot of time trying to find alternative ways to develop anything Apple dreams up.

[fendol]

It would make sense that Apple would delve into the Wii-style game console arena as they have with the iPhone/iPod touch games. This would take it to the next level.

This is what I think they're mainly focusing with this here, there's the whole iPhone/iPod market for games :apple:http://www.seoagora.com/img/589/d08l1104oulu/smiley2.gifhttp://www.seoagora.com/img/459/k08q1024glza/ecstatic.gif

[morespce54]

Tennis racket, golf club, hockey stick and steering wheels...

What the heck??? :confused:

[ZiggyPastorius]

I think if they made another keyboard and added it to the line, they could experiment there...I've always wanted a keyboard with a trackpad (like on a laptop) instead of a number pad...well, I think Apple could design a keyboard that has an area dedicated completely to multitouch functionality or even a trackpad (I love Apple's trackpads!)

[largebrandon]

Tennis racket, golf club, hockey stick and steering wheels...

What the heck??? :confused:

Mac meets Wii?! Dunno if that'll work

[macFanDave]

I'm thoroughly familiar with the rules of tennis and cannot understand how a multi-touch skin can be used with a racquet that can be used in competition.

The rules strictly limit what you can do with a tennis racquet. It may not have any moving parts, for example.

I'm all for creativity, but sometimes you need to gently guide the bat-**** crazy ideas back toward something a bit closer to the ordinary.

[Doctor Q]

Wrapping everyday objects opens up a wealth of possibilities. Curved surfaces are especially interesting to contemplate. Sports equipment, appliances, bookcovers, purses, sofa armrests, and who knows what else.

And how 'bout touch-wrapping the keys on my keyboard? Who needs a mouse at all if I could slide and tap my thumbs on my spacebar? Why not let us slide fingers left-right or up-down on any key, or even combinations of keys?

Hmmm... I tend to tap on the steering wheel in time to whatever music I'm listening to. I'd better be careful if my steering wheel starts responding to gestures!

[twoodcc]

seems pretty cool to me. but will anything ever come out of this? i doubt it

[Antares]

This actually is a very brilliant and very *practical* idea right now.

Imagine the next MightyMouse with a multitouch surface on the front end, so you can use your thumb & fingers to do things like pinch (thumb & first finger) or scroll/swipe (two fingers, three fingers, or four fingers, in any direction).

This would 1) bring the new functionality of the trackpad to the desktop (which Apple would like), and 2) blow away any other mouse!, and 3) bring more people to Macs, as this would only work on OS X!

When the Mighty Mouse first came out, that's what I kind of envisioned.. Honestly, I didn't imagine multi-touch...but instead this: To make a mouse a completely solid form, buttonless, but still have all the functions of buttons and scroll balls/wheels. The mouse's surface would be completely touch sensitive. The touch surface would follow all the ergonomic contours of a regular mouse...so it wouldn't be just like sticking a flat track pad on the top of a mouse.

I even started researching patents for this but gave up when I saw how much money it would cost to even start a patent process....

[Vulpinemac]

Anybody happen to see the movie "Quantum of Solace"? While definitely on a larger scale, multitouch was a clear player in "M's" briefings at headquarters.

It appears to me that Apple is truly attempting to bring Star Trek: TNG's technology into today's world.

[MattInOz]

http://www.macrumors.com/images/macrumorsthreadlogo.gif (http://www.macrumors.com/2008/12/18/apple-researching-multi-touch-skins-and-new-gestures/)

Apple's patent applications sometimes enter into bizarre and conceptual territory.

Clearly this patent passes the Novelty test.

[kdarling]

It appears to me that Apple is truly attempting to bring Star Trek: TNG's technology into today's world.

I hope not. I cringe whenever the ship bounces around, and the crew grabs at the touch control panels for a handhold. Can you imagine all the mistaken inputs? :eek:

Touch for weapons or navigation controls = really bad idea. :)

[BTW]

Hello Minority Report!

Loved that movie! Apple is definitely the company to get us there in a practical and incremental way.

I saw a surface device at Microsoft at their client demo building. Every Microsoft rep that talked to my company asked, "Did you see the surface device?" I sat at the surface table and really couldn't do anything with it. Um, yeah that's neat. At least let me browse the web in an interesting way. I don't own a Zune (who does?) or a WinMo phone so I was out of luck.

[speedballs]

"- For example, a user can pinch the GUI object to grab it while dragging it to a desired location by translating the pinching fingers along the sensor panel surface to a desired drop location. "

Copy and paste anyone? Sounds like they've figured out how they'll implement it. :apple:

[Kevster89]

Perhaps a Multitouch Netbook-ish Tablet without a physical keyboard? :)

this seems like a very realistic and viable option to me. A netbook caliber, multi touch driven tablet would be awesome. Anyone agree? :)

[Dejavu]

This week's patent application (http://appft1.uspto.gov/netacgi/nph-Parser?Sect1=PTO2&Sect2=HITOFF&p=1&u=%2Fnetahtml%2FPTO%2Fsearch-bool.html&r=1&f=G&l=50&co1=AND&d=PG01&s1=20080309634&OS=20080309634&RS=20080309634) reveals research into portable multi-touch skins that can be placed on three dimensional objects:

Apple will market a line of iDildos.

[iPonder]

Looks like our tax money is going to help fund the movement of Apple into the car industry as well now. We've been longing for the days that PCs become standard within new cars (like bluetooth today) and here it comes. Knobs for A/C and radio, man that's so old school...

[kdarling]

Multi-touch skins is such a 1990s idea.

Why modify the object?

Surface wave multi-touch is better because it uses the object's natural surface instead.

And these days everything is about camera-based gesture recognition, so you don't even have to mess with the object at all.

[Doctor Q]

I wonder how much interest Apple has in back-sided touchscreens. Here (http://www.newscientist.com/article/dn12773-transparent-gadget-could-trump-iphone-interface.html) is a description of LucidTouch, from October 2007, and here (http://www.newscientist.com/article/dn16295-fat-fingers-no-problem-with-seethrough-touchscreen-.html) is an update, reporting on a smaller version. By showing you shadow fingers on the screen while you touch from the back, the LucidTouch avoids having your fingers block the display.