View Full Version : Extending the Touchscreen with Physical Objects (Video)

May 11, 2011, 11:48 PM
http://cdn.macrumors.com/im/macrumorsthreadlogo.gif (http://www.macrumors.com/2011/05/12/extending-the-touchscreen-with-physical-objects-video/)


Interactive Art and Technology student Mike Knuepfel has posted a teaser video for his thesis which asks if there are new ways that we can use the touchscreen to interface with tangible objects:
Touchscreens like those found on smartphones and tablets have enabled a new generation of versatile user interfaces. My thesis project, Extending the Touchscreen, aims to further this versatility by using conductive materials to construct a series of physical, mechanical, and electrical devices that touch, interact and communicate directly through the touchscreen interface. My goal in constructing these external devices is to make touchscreen interactions more tactile, physical and potentially more expressive and fun.The video shows seven different objects which interact with the iPad in interesting ways. In particular, there are two pressure-sensitive styluses using different techniques. One takes advantage of multi-touch by extending a second touch stylus and using the distance between the two to measure pressure. The second uses audio feedback to determine pressure.


At least one similar concept has already been brought to market. Ten One Design's fling (http://tenonedesign.com/fling.php) is a simplistic touch-sensitive joystick that attaches to an iPad's screen. I'm sure we'll see more of these types of products as the popularity of touch screens continues to grow.

[via Creative Applications (http://www.creativeapplications.net/iphone/extending-the-touchscreen-of-arduino-ipad-iphone/)]

Article Link: Extending the Touchscreen with Physical Objects (Video) (http://www.macrumors.com/2011/05/12/extending-the-touchscreen-with-physical-objects-video/)

May 12, 2011, 02:21 AM
very cool. Like to see more of this

May 12, 2011, 03:15 AM

Can't wait to see more as well!

Had no idea there were so many possibilities with using the touch screen to interact with other physical objects...!


May 12, 2011, 05:17 AM
The music made it seem there was some other touch screen physical interaction going on that they weren't showing us! :p

May 12, 2011, 07:18 AM
I fail to see many practical applications...

May 12, 2011, 07:36 AM
I really wish the iPad came with a stylus and also was pressure sensitive. This would have big benefits with handwriting and art apps. Just my 2Ę

May 12, 2011, 07:56 AM
It is a nice start but there is still a long way to go! The joystick is handy for a couple of games on the iPad!!

May 12, 2011, 09:49 AM
Some fun and creative experiments, worth doing whether they all end up leading to products or not.

For a stylus, the ideal solution (which Iím sure someone will get around to) would be a pressure sensor in the pen, transmitting via bluetooth to those paint apps that choose to support it. (The remaining apps would support the stylus passively like any other.) Of course, out current capacitive touchscreens are never going to have a Wacom feel, because a hard, precise point doesnít work with them. In fact, even the smaller soft styluses work less well, requiring a harder press, than the fatter ones. I like my fat Boxwave for drawing, all the same!)

May 12, 2011, 11:00 AM
has anyone tried making a bluetooth stylus with the pressure sensitivity in the pen and have it transmit that data over bluetooth? Because it seems like that's what he's doing with the audio cable

May 12, 2011, 01:17 PM
I fail to see many practical applications...

Which kind of reminds me of:


God bless the visionaries.

May 12, 2011, 05:52 PM
There are some cool things in that video and it's very unlikely that apple will supply us with a stylus but for third party companies the pressure sensor and stuff can open up a load more opportunities.

May 13, 2011, 03:13 AM
I was looking at the iPad shell instead of the stylus or iPad screen during the whole video.