The Register talks to Bill Buxton (who has built several multitouch systems) about Microsoft's Surface:

In fact, according to Bill Buxton - ironically a Principal Researcher at Microsoft's own research centre - these kinds of multi-touch interfaces have been around for over twenty years. Perhaps the Surface Computing marketing guys at Microsoft should check out Bill's web site. Moreover, perhaps Microsoft and developers like Jeff Han at NYU, who are building these 'old-school' multi-touch interfaces out of cameras and projectors, should consider the fatal flaw in their 'innovations'. This being that all back-projection interfaces are enormous. Think about it - you've essentially got a small cinema in a box behind a screen. Forget mobility and portability. Is it even moveable?

I remember using The Wasp, a portable and very yellow synthesizer in the early 80s. The keyboard was touch-sensitive, not in the sensitive-to-velocity kind of way, but in the touch-a-picture-of-a-key-to-press-it kind of way. As the site says:

Its most distinguishing feature is the keyboard and its awful non-moving touch keys. That's right, the flat plastic keys are only sensitive to your touch and so they are difficult and unreliable to play.

Anything that uses a touch interface has this tactile/audio feedback problem. A touch-input display also has the problem of planarity: the display and the input are co-planar. There are very few interactive systems designed this way -- none that I can think of that are designed for more than infrequent, dedicated use. The bigger the device (and so at least on paper the more impressive the display) the worse the situation becomes. Go smaller and the interface becomes usable because the hands can be positioned independently of the surface. Go too small and the area becomes too small to be useful.

I am wondering if Apple actually designed the iPhone like this: starting by finding the most functional form factor, then getting the feel and weight right, then moving on to the display, functionality, and finally electronics.

Tags: Microsoft, Multitouch, History, iPhone, Interesting Stuff

Microsoft announced their first sand table for grown-ups yesterday. The web site is all Flash, so that's an immediate black mark against it (I first thought it was called "buffering").

There have been several demos of this kind of technology on the web in the past few years. That it has taken six years to get from the technology demos that I have seen to this current technology demo is amazing. The original iPod was done in six months and the iPhone in two and a half years. Six years is two technology generations at least.

The real deal-killer is its fundamental ergonomic problem: you can't get your legs underneath it. The original product idea (see the pencil drawing in Origins on the web site) was just like a sand table -- deeper than a table but not uncomfortably so. But this one is a bath tub with a screen on top, so users either suffer from gorilla arm or dinosaur back. The people who are using it in the PR are grinning relentlessly to cover up the pain from their sore arms and aching backs.

A tabletop is actually a pretty bad environment for sharing and collaboration. It has no defined orientation. This means that you have competition among participants who try to out do each other in defining "up". The winner ends up with a haggle of people on their side and the losers are left to mentally rotate everything they see from their respective geometric wastelands. Even without the orientation problem, each participant also gets a different perspective and the table space becomes a hoarding area close to the dominant people. There is a reason we use whiteboards and computer screens in a vertical orientation: they are naturally placed, allow large audiences to share and view information comfortably, and don't suffer from the same degree of competition.

I suppose that the reason for the bath tub design is that there is a camera underneath (and possibly lighting and projection too) that is used to track the movements and recognize objects. The better approach is to build the light sensors into the screen as Apple has patented. The large depth quite substantially limits the places that the device could be used if it were wall-mounted. It simply has to be built in to a structure or mounted on its side like a huge CRT TV. Another challenge for any stand-alone device like this is getting power and data in and out. There will either have to be built-in power, or somebody gets the side with the wires. Venting the heat means that if the top is cool, someone gets warm air blowing at their legs. At least wireless links will rid it of the problem of networking.

Like the Segway, it's cool technology and well-implemented for some very limited applications. But also like the Segway and despite the maker's ideas, it won't change the way almost anyone does anything.

Tags: Microsoft, Segway, Coffee Tables, Pigs With Lipstick, Multitouch, Gorilla Arms, Dinosaur Back