Apple Refining the Touch Screen Interface? Evidence for a Tablet Mac?

MacRumors · Mar 10, 2006, 01:53 AM

http://www.macrumors.com/images/macrumorsthreadlogo.gif

Throughout 2005, Apple continued to apply for numerous touch-screen technology patents. These patents aren't simply attributable to the rumored touch-screen iPod. Many of the patents have shown Mac OS X elements and interfaces.

The most recent addition was filed in September 2005 and called "Operation of a computer with touch screen interface". Again, individuals at Apple appear to be spending a lot of time on the potential interface for users of a touch screen device. The patent describes the the possible advantage of touch screens by being able to "glean much more information about a user's actions" than from conventional keyboards.

The methods described are intriguing in that it appears that there could be a level of refinement to the touch interface that has not been present in previous devices. Again, Apple describes the utility of offering a multi-touch capable display which can process multiple figures and gestures to provide additional information.

The authors describe a number of interesting potential techniques to gather more information from the user operating the virtual interface (keyboard and GUI elements on the screen)

- Both pressure and time of screen presses could also be used to interpret action and intention by the users. (Chart)
- In one example, the user might be required to hold down on a "delete" button longer than is required to activate the "keep" button for an item. The delete function requiring more time to ensure that data is not accidentally erased. (Picture)
- Gestures are described to provide additional "hidden" functionality. For example, in describing an on-screen keyboard, a user could press on the letter "e" and then stroke the finger in a particular direction away from the letter to invoke a special variation (such as é). (Picture). Of historical interest, individuals at Apple had done research into similar point/flick gesture interfaces in 1994 ("T-Cube: a fast, self-disclosing pen-based alphabet") when researching alternative input methods for the Newton.
- Additional gestures may be required to activate special functionality... "wiggle" is given as an example. Again, the Newton allowed users to erase text by simply performing a zig-zag "crossing out" gesture over the text. (Quicktime Movie).

Again, patent applications do not necessarily mean these technologies will turn up as shipping technologies, but its clear a significant portion of research at Apple involves touch-screen technology. Rumors of a Tablet Mac last peaked in 2003 with a traditionally reliable source of information pointing to a Mac OS X tablet at that time:

Quote:

(2003) My sources sketch the following picture: A device that superficially resembles a large iPod with an 8-inch diagonal screen, lacks a keyboard, packs USB and FireWire ports, and runs Mac OS X along with a variety of multimedia goodies.

Steve Jobs was skeptical of the success of the Tablet form factor in 2002. Indeed, the Tablet PC's have not been a great success, but with Microsoft/Intel's introduction of the Ultra Mobile PC form factor, the market may see a renewed interest in the tablet form factor.

As a final interesting hint, in July of 2005 a small company called FingerWorks cryptically posted that they had ceased operations as a business. Multiple reports indicated that the company had been sold, but details were scarce. According to individuals close to the company, Apple had indeed purchased the company and related technology/patents. At the time, FingerWorks had offered advanced input devices, including a multi-touch product called iGesture Pad which allowed users to use Gestures to interface with their Mac. At the time it was thought that Apple was interested in touch and click-wheel related technology for the iPod, but the Gesture/MultiTouch technology may have been an important part of the acquisition.

blackfox · Mar 10, 2006, 02:03 AM

The plot thickens...

Though not necessarily in the market for such a device, if in the future Apple comes out with as elegant of a product as is implied, I may have to give them my money out of sheer appreciation...

I look forward to seeing this come to fruition, though I look less forward to yet more threads discussing this (as of now) phantom device.

JerMander · Mar 10, 2006, 02:05 AM

Maybe Jobs was telegraphing exactly what they are working on with the 8" iPod screen (minus the 10 pound weight, hopefully). Here's hoping!

Staffroomer · Mar 10, 2006, 02:09 AM

This sounds like the future of computing to me. Seriously, I don't think keyboards and mice are going to be around forever. It'll be interesting to see how things play out..

I reserve the right to be totally wrong and change my mind about this at any given time though.

How postmodern of me.

Doctor Q · Mar 10, 2006, 02:10 AM

There's a downside to some of these methods. Just as you have to learn the various combinations of shift/control/option/command with other keys to use those functions, using gestures to invoke functions means you have more methods to learn, and there may be no visible indicators of what they are.

Holding a key longer might be convenience as a way to make an indication of your meaning, but only if you know to do that. The same with holding a key while making a gesture.

The average user can learn a few gestures, but not dozens and dozens all at once, so they'd have to learn them over time.

dontmatter · Mar 10, 2006, 02:30 AM

Given the hugely underwhealming interest in tablets (and microsoft can push things to be bought even if they're crappy, we know), I think it's obvious that a computer without a decent input device just doesn't make sense. See my post earlier today for more on that.

Hope this is wrong, it just seems like an idea nerds would love and everybody else wouldn't touch.

arn · Mar 10, 2006, 02:35 AM

Quote:

Originally Posted by Doctor Q

Holding a key longer might be convenience as a way to make an indication of your meaning, but only if you know to do that. The same with holding a key while making a gesture.

I actually thought the impressive part of the examples given is that they are relatively intuitive or could be.

The pressing longer isn't something that needs to be told. If someone hits a button and it doesn't respond, the natural response is to hold it down harder/longer. I don't think we're talking about holding it down for 10 seconds. Probably 1-2 seconds instead of instantly.

As for the gesture letters. I think if you held down the character, the special characters would appear around the original letter. So as you became familiar with them, you could simply gesture instead of hold down and look at the pop-up menu. That's how I interpreted the description. Also it's how the T-Cube (Newton) interface worked. Press and hold and a menu came up, then you could gesture the correct direction. Otherwise, you could just click and flick without waiting if you knew what you were doing.

arn

shrimpdesign · Mar 10, 2006, 02:41 AM

Quote:

Originally Posted by dontmatter

I think it's obvious that a computer without a decent input device just doesn't make sense. See my post earlier today for more on that.

Hope this is wrong, it just seems like an idea nerds would love and everybody else wouldn't touch.

I agree that a computer without a decent input just doesn't make sense, but I think Apple, king of all UIs, would never release a Tablet without a great UI and input system. I remember a story about Steve Jobs using the prototype iPod ..... he'd yell at the workers if he couldn't find a song in 5 seconds ... and I can just see Jobs saying, "Why can't I type an email in a under 5 minutes?" If the MacTablet ever comes out, it'll be awesome.

Rye Brye · Mar 10, 2006, 02:43 AM

Hearing all of the talk about Newton makes me miss my old friend... Oh - and that video is a really crappy illustration of the scribble... You could really scribble it out vigorously like you would scribble out stuff normally - and it would work like magic...

Steve Jobs killed the Newton as one of his first acts as iCeo - and ticked off a lot of the developers...

They could just release a small color version of the Newton with a faster processor and built-in grafitti support (along with the option to turn on the handwriting recognition) and they would make me very happy... Oh, and add on a music player (iPod) and you would rule the world...

Come back Newton... come back!

NewtypeCJ · Mar 10, 2006, 02:45 AM

God I hope they're working on a portable touch device. I would very much like to purchase such an iPod/Mac tablet, what I would imagine would look like a more elegant and simplified variant of Microsoft's ugly and unwieldly looking Origami. I would hope it would offer wifi and a small selection of OSX's best apps and widget compatibility. I don't need a full laptop but I'd like something that would sync to the Mac and would offer more than just music/video/photos.

ScottB · Mar 10, 2006, 02:51 AM

That's a nice roundup thanks. I'm intrigued to see how Apple will enter this market if they do infact plan on doing so. I see a fully bloan tablet as unlikely but what this information suggests to me is an iPod/Tablet venture, simular to that of Samsung's new announcement is already be in Apple plans.

MacsomJRR · Mar 10, 2006, 02:53 AM

I for one really hope that Apple is working on somekind of tablet type PC if only because I have faith that their creation will be something that is actually worth buying. I would LOVE to have an Apple tablet for taking notes during classes or even out in the "field" and then making those notes come to life with movies and pictures and sounds and... oh boy I'm getting a little too excited.

Please make a tablet PC Apple, pleeeeease

puuukeey · Mar 10, 2006, 03:01 AM

as far as I can tell, the only multitouch product on the market is the lemur.

I think its undeniable that built in multitouch technology would benifit users greatly.

multitouch technology is something that DESERVES being built into a system unlike address books and buddy lists. FEH

I am a computer musician, and when I get multitouch technology, I will be a seriously excited musician.

the lemurs price point and ability just isn't good enough.

miketcool · Mar 10, 2006, 03:04 AM

As a design student, I can tell you all the problems associated with design software. The transition from manipulating things like clay, paint, models; is very difficult. You dont simply just choose tools, you have to choose how you will choose the tool and what you will manipulate exactly.
I would love to see a way in which two hands can manipulate things, why limit yourself to one input (mouse point). I would love to be able to hold something down and manipulate it with the other hand. Or do my CAD drawing with a Wacom pen and use my left hand to select button off a hidden or translucent interface. Spread two fingers to zoom. Spread four fingers to copy (two hands, not "live long and prosper"). 3-4 fingers on one hand next to each other hold down and object. A hard tap explodes. The possibilities are endless.
Ultimately it becomes refreshing. You teach by showing. Not by taking note son which menus to navigate. Welcome to the 21st century, lose the mouse. It makes manipulation fun...

c-Row · Mar 10, 2006, 03:09 AM

Quote:

Originally Posted by Doctor Q

The average user can learn a few gestures, but not dozens and dozens all at once, so they'd have to learn them over time.

When switching to my PowerBook two years ago I also had to learn all those new keyboard shortcuts - mind you, I don't even know all of them today.

I think with USB capabilities the touch screen interface would be a nice option, but not necessarily the only way of working with the tPod/tPad/tHehe/whatever.

Philsy · Mar 10, 2006, 03:09 AM

Quote:

Originally Posted by Staffroomer

This sounds like the future of computing to me. Seriously, I don't think keyboards and mice are going to be around forever. It'll be interesting to see how things play out..

I reserve the right to be totally wrong and change my mind about this at any given time though.

How postmodern of me.

While I can see the appeal in a touch-screen, I can't see them replacing keyboards for people who use computers for a lot of inputting - writers, for instance. The keyboard is going to be with us for a long time yet.

lebnjay · Mar 10, 2006, 03:13 AM

http://mrl.nyu.edu.nyud.net:8090/~jhan/ftirtouch/

lebnjay · Mar 10, 2006, 03:15 AM

This site has an awesome video demonstrating some of the uses of multitouch technology. Really amazing stuff.
Apple could do great things with this.

http://mrl.nyu.edu.nyud.net:8090/~jhan/ftirtouch/
also on google video
http://video.google.com/videoplay?do...le+multi+touch
lebnjay

goddylla · Mar 10, 2006, 03:45 AM

Yeah, I saw that video a few weeks ago.

There are real and exciting possibilities that tech like this brings to users.
Saying that there will invarriably be people who will still use a keyboard vs this tech is like saying there are people who prefer albums to CDs. Touchtech just opens new doors that we didn't even know we had the keys to.

aussie_geek · Mar 10, 2006, 03:48 AM

Quote:

Originally Posted by lebnjay

This site has an awesome video demonstrating some of the uses of multitouch technology. Really amazing stuff.
Apple could do great things with this.

http://mrl.nyu.edu.nyud.net:8090/~jhan/ftirtouch/
also on google video
http://video.google.com/videoplay?do...le+multi+touch
lebnjay

yep, someone posted these the other week. great stuff!! i just watched them again and was still baffled...

aussie_geek

psxndc · Mar 10, 2006, 03:49 AM

Sorry to be an IP nazi, but please please please please don't refer to patent applications as "patents," even if you've already referred to them as patent applications. If you are going to shorthand them, call them "applications."

They are very very different things legally. Yes, this is a distinction that probably only I care about, but anyone can apply for a patent on anything. That doesn not mean they will get a patent on it.

Thanks.

-p-

bluebomberman · Mar 10, 2006, 04:06 AM

As much as I hope I'm wrong (I'll be amongst the first to order a Tablet Mac or Newton), I'm guessing Apple does not want to make one anytime soon because it:

a) won't be substantially better than the competition (PDAs, Tivo), or
b) will be doomed to be a niche of a niche (Tablet PCs)

That said, there's been an unusual amount of activity in this sector. Something's going on, but what? I'm guessing whatever Apple's doing, it's got to be a lot bigger than the Origami device. Maybe a full-blown iPod video PDA? One can only dream.

DCapple · Mar 10, 2006, 04:08 AM

well this touch screen mac will be something that i we should wait for...this will be very interesting!!

Bad Beaver · Mar 10, 2006, 04:18 AM

Quote:

Originally Posted by Rye Brye

Hearing all of the talk about Newton makes me miss my old friend...

Well, go get one of eBay, they are pretty cheap to come by. And still usefull for a lot of things. They are especially useful for GUI designers as a demo object. SO THEY CAN GET A CLUE.

Quote:

Originally Posted by Rye Brye

Oh - and that video is a really crappy illustration of the scribble... You could really scribble it out vigorously like you would scribble out stuff normally - and it would work like magic...

Rrrright

It also still scares the crap out of unsuspecting non-geeks

MacRonin · Mar 10, 2006, 04:20 AM

8" widescreen multi-touch LCD
1.06GHz ULV Core Duo CPU w/2MB shared cache
533MHz FSB
512MB NAND flash memory
2GB DDR2 SDRAM (two SO-DIMM slots)
80GB 1.8" HDD
Intel GMA950 integrated GPU
WUSB (wireless USB)
AirPort Extreme
BlueTooth
Quad band cell capabilities
Pivoting iSight camera
stereo BlueTooth headset w/microphone
Lithium-Ion nano-tech battery
Stylus
Mac OS X 10.4.6
iLife
iWork

About the size of a DVD case (which is really close to a 16:10 ratio) and half again as thick...

US$666

Happy 30th Birthday Apple Computer

Mar 10, 2006, 02:03 AM	#2
blackfox macrumors 65816 Join Date: Feb 2003 Location: PDX	The plot thickens... Though not necessarily in the market for such a device, if in the future Apple comes out with as elegant of a product as is implied, I may have to give them my money out of sheer appreciation... I look forward to seeing this come to fruition, though I look less forward to yet more threads discussing this (as of now) phantom device. __________________ For it is the yearning after comparisons and metaphors for each new object and landscape that sanctifies consciousness

Mar 10, 2006, 02:05 AM	#3
JerMander macrumors newbie Join Date: Jan 2002	Super Secret Apple rumors Maybe Jobs was telegraphing exactly what they are working on with the 8" iPod screen (minus the 10 pound weight, hopefully). Here's hoping!

Mar 10, 2006, 02:09 AM	#4
Staffroomer macrumors member Join Date: Oct 2005	This sounds like the future of computing to me. Seriously, I don't think keyboards and mice are going to be around forever. It'll be interesting to see how things play out.. I reserve the right to be totally wrong and change my mind about this at any given time though. How postmodern of me. __________________ Come and check out The Staffroom. Get lots of FREE SOFTWARE for teachers. We're a non-profit site for TEACHERS

Mar 10, 2006, 02:10 AM	#5
Doctor Q macrumors god Join Date: Sep 2002 Location: at the table with countless relatives	There's a downside to some of these methods. Just as you have to learn the various combinations of shift/control/option/command with other keys to use those functions, using gestures to invoke functions means you have more methods to learn, and there may be no visible indicators of what they are. Holding a key longer might be convenience as a way to make an indication of your meaning, but only if you know to do that. The same with holding a key while making a gesture. The average user can learn a few gestures, but not dozens and dozens all at once, so they'd have to learn them over time. __________________ "You've just been abducted, of course you need crepes!" -- Walter Bishop

Mar 10, 2006, 02:30 AM	#6
dontmatter macrumors 6502a Join Date: Jan 2004 Location: SEATTLE, BABY! (or a nice little liberal arts college campus in the middle of nowhere...)	Given the hugely underwhealming interest in tablets (and microsoft can push things to be bought even if they're crappy, we know), I think it's obvious that a computer without a decent input device just doesn't make sense. See my post earlier today for more on that. Hope this is wrong, it just seems like an idea nerds would love and everybody else wouldn't touch. __________________ Insert witticism here. Or spelling correction.

Mar 10, 2006, 02:43 AM	#9
Rye Brye macrumors newbie Join Date: Oct 2003 Location: Utah	I miss the Newton :( Hearing all of the talk about Newton makes me miss my old friend... Oh - and that video is a really crappy illustration of the scribble... You could really scribble it out vigorously like you would scribble out stuff normally - and it would work like magic... Steve Jobs killed the Newton as one of his first acts as iCeo - and ticked off a lot of the developers... They could just release a small color version of the Newton with a faster processor and built-in grafitti support (along with the option to turn on the handwriting recognition) and they would make me very happy... Oh, and add on a music player (iPod) and you would rule the world... Come back Newton... come back!

Mar 10, 2006, 02:45 AM	#10
NewtypeCJ macrumors regular Join Date: Feb 2005 Location: Atlanta, GA	God I hope they're working on a portable touch device. I would very much like to purchase such an iPod/Mac tablet, what I would imagine would look like a more elegant and simplified variant of Microsoft's ugly and unwieldly looking Origami. I would hope it would offer wifi and a small selection of OSX's best apps and widget compatibility. I don't need a full laptop but I'd like something that would sync to the Mac and would offer more than just music/video/photos.

Mar 10, 2006, 02:51 AM	#11
ScottB macrumors regular Join Date: Jul 2005 Location: Britain	That's a nice roundup thanks. I'm intrigued to see how Apple will enter this market if they do infact plan on doing so. I see a fully bloan tablet as unlikely but what this information suggests to me is an iPod/Tablet venture, simular to that of Samsung's new announcement is already be in Apple plans.

Mar 10, 2006, 02:53 AM	#12
MacsomJRR macrumors 6502a Join Date: Jul 2003 Location: San Diego	I for one really hope that Apple is working on somekind of tablet type PC if only because I have faith that their creation will be something that is actually worth buying. I would LOVE to have an Apple tablet for taking notes during classes or even out in the "field" and then making those notes come to life with movies and pictures and sounds and... oh boy I'm getting a little too excited. Please make a tablet PC Apple, pleeeeease __________________ (\ /) I mac therefore I am. (O.o) (> <) MBP 2.0Ghz, 8GB iPhone

Mar 10, 2006, 03:01 AM	#13
puuukeey macrumors 6502 Join Date: Dec 2004 Location: tristate area	as far as I can tell, the only multitouch product on the market is the lemur. I think its undeniable that built in multitouch technology would benifit users greatly. multitouch technology is something that DESERVES being built into a system unlike address books and buddy lists. FEH I am a computer musician, and when I get multitouch technology, I will be a seriously excited musician. the lemurs price point and ability just isn't good enough.

Mar 10, 2006, 03:04 AM	#14
miketcool macrumors 6502a Join Date: Jun 2003	As a design student, I can tell you all the problems associated with design software. The transition from manipulating things like clay, paint, models; is very difficult. You dont simply just choose tools, you have to choose how you will choose the tool and what you will manipulate exactly. I would love to see a way in which two hands can manipulate things, why limit yourself to one input (mouse point). I would love to be able to hold something down and manipulate it with the other hand. Or do my CAD drawing with a Wacom pen and use my left hand to select button off a hidden or translucent interface. Spread two fingers to zoom. Spread four fingers to copy (two hands, not "live long and prosper"). 3-4 fingers on one hand next to each other hold down and object. A hard tap explodes. The possibilities are endless. Ultimately it becomes refreshing. You teach by showing. Not by taking note son which menus to navigate. Welcome to the 21st century, lose the mouse. It makes manipulation fun...

Mar 10, 2006, 03:13 AM	#17
lebnjay macrumors newbie Join Date: Jan 2004	video of multi-touch screen http://mrl.nyu.edu.nyud.net:8090/~jhan/ftirtouch/

Mar 10, 2006, 03:15 AM	#18
lebnjay macrumors newbie Join Date: Jan 2004	video of multi-touch screen This site has an awesome video demonstrating some of the uses of multitouch technology. Really amazing stuff. Apple could do great things with this. http://mrl.nyu.edu.nyud.net:8090/~jhan/ftirtouch/ also on google video http://video.google.com/videoplay?do...le+multi+touch lebnjay

Mar 10, 2006, 03:45 AM	#19
goddylla macrumors newbie Join Date: Jun 2005 Location: In a cokehead's withdrawl dillusion	Yeah, I saw that video a few weeks ago. There are real and exciting possibilities that tech like this brings to users. Saying that there will invarriably be people who will still use a keyboard vs this tech is like saying there are people who prefer albums to CDs. Touchtech just opens new doors that we didn't even know we had the keys to. __________________ Wandering the realms of varying degrees of importance has a tendency to displace central localization within any observational engine.

Mar 10, 2006, 03:49 AM	#21
psxndc macrumors regular Join Date: May 2002	sorry to be an IP nazi Sorry to be an IP nazi, but please please please please don't refer to patent applications as "patents," even if you've already referred to them as patent applications. If you are going to shorthand them, call them "applications." They are very very different things legally. Yes, this is a distinction that probably only I care about, but anyone can apply for a patent on anything. That doesn not mean they will get a patent on it. Thanks. -p-

Mar 10, 2006, 04:06 AM	#22
bluebomberman macrumors 6502a Join Date: Jan 2005 Location: Queens, NYC	As much as I hope I'm wrong (I'll be amongst the first to order a Tablet Mac or Newton), I'm guessing Apple does not want to make one anytime soon because it: a) won't be substantially better than the competition (PDAs, Tivo), or b) will be doomed to be a niche of a niche (Tablet PCs) That said, there's been an unusual amount of activity in this sector. Something's going on, but what? I'm guessing whatever Apple's doing, it's got to be a lot bigger than the Origami device. Maybe a full-blown iPod video PDA? One can only dream. __________________ Treo 700p.

Mar 10, 2006, 04:08 AM	#23
DCapple macrumors regular Join Date: Feb 2006	well this touch screen mac will be something that i we should wait for...this will be very interesting!! __________________ My Blogs \| My Bookmarks = Danica =

Mar 10, 2006, 04:20 AM	#25
MacRonin macrumors member Join Date: Jun 2002 Location: in denial…	8" widescreen multi-touch LCD 1.06GHz ULV Core Duo CPU w/2MB shared cache 533MHz FSB 512MB NAND flash memory 2GB DDR2 SDRAM (two SO-DIMM slots) 80GB 1.8" HDD Intel GMA950 integrated GPU WUSB (wireless USB) AirPort Extreme BlueTooth Quad band cell capabilities Pivoting iSight camera stereo BlueTooth headset w/microphone Lithium-Ion nano-tech battery Stylus Mac OS X 10.4.6 iLife iWork About the size of a DVD case (which is really close to a 16:10 ratio) and half again as thick... US$666 Happy 30th Birthday Apple Computer

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode