Touch is a research project that investigates Near Field Communication (NFC), a technology that enables connections between mobile phones and physical things. We are developing applications and services that enable people to interact with everyday objects and situations through their mobile devices. More...
From the Picnic conference last year, Mediamatic’s ‘RFID safe’ which protects your wireless RFID cards from being read or ’skimmed’. With Mifare security problems a reality, and the ability to skim cards such as the Oyster fairly easily, I wonder how common these things will become?
At last year’s Picnic conference we created a networked Photo Booth as part of the Mediamatic RFID hackers camp. Picnic is a conference with about two thousand attendees and multiple venues in the Westergasfabriek in Amsterdam.
One of the aims of the Mediamatic workshop was to experiment with ubiquitous technology for social and playful purposes. Every participant in Picnic was issued with an RFID tag that could be used by various installations around the conference venue. As a controlled setting this was a very interesting environment to experiment with RFID technology in use, and in particular to experiment with physical interactions in online social networks.
One of the participants on the first day. Photo by Anne Helmond.
The photo booth team consisted of Timo Arnall, Anne Helmond, Jorn Knutsen and Einar Sneve Martinussen. We wanted to create something that brought people together both in a physical activity and in an online social network. Initially we described it like this:
A photo booth that encourages people to take photos of themselves with others. By waving multiple tags over a touchpoint inside the booth, a photo is taken, a connection is made and pictures are added to the Picnic website.
We built the booth in three days, with many design iterations, and ended up with a large white box with a picnic-themed grassy interior that allowed up to about 10 people to have their photo taken at once.
Inside there was an RFID reader, a camera and a screen that would show what was being recorded, as well as showing a countdown for picture taking. Outside a large LCD screen showed recent and random pictures from the booth, encouraging participation. By touching your tag to a reader outside, you could see pictures of yourself.
Over the course of the three-day event the photo-booth was extremely popular and resulted in literally thousands of pictures and social connections.
Every attendee’s RFID tag contained a link to their profile within the Picnic network site (their tags were registered and connected at the registration desk). This profile contained their name and any descriptions or tags that they had decided to include, we also had access to their contact details and payment information if we had chosen to do so. When the photo booth detected their tag, it could look them up in the Picnic social network, get their details and manipulate their profiles.
Left: Inside the booth. Right: Tags on the RFID touchpoint.
The booth attracted curious attendees, who looked at the photos playing on the outside. When they walked into the booth, and touched their tag to a ‘touchpoint’ their name would appear on a screen and a countdown would start. If others then touched their tags within this countdown they would also have their names appear in the photo. People who had their photo taken together would have a connection created between them on the Picnic network site.
On the web the Picnic network showed the pictures from the booth with the names of all the people that had been photographed together. People’s profiles included the photos of them and their connections. This was a different and new way of exploring the network and seeing the connections that had been made.
Photos from the booth were also uploaded to Flickr and tagged with the people’s first name (see for example all the photos taken of me and the tag cloud of the names and IDs of people who used the booth most).
This realtime Flickr stream appeared on the outside of the booth, where people stood around watching their recent creations, as well as seeing random photos where they or their friends appeared.
With around two thousand tagged attendees this was a great opportunity to design for and study the application of social networks in physical space, and to better understand the relationship between physical interactions and the resulting effects in online spaces. The way in which the photo booth took elements of a digital network and made it manipulable in a physical context was very interesting to us.
We were interested in the details of the interactions between people, their tags and readers. In practice RFID is a relatively mundane technology, it doesn’t flash or beep or cry out for attention when it’s encased in plastic packaging. It is also very limited technically: the read-ranges are typically so low that we require people to ‘touch’ their tags to the readers.
Without explicit instruction or ‘attractor loops’ the booth worked through certain ‘gestures’ that were socially learned; people observed and then participated. The activity of ‘touching’ actually brought people — who perhaps had only recently met — into very close physical proximity. This strangely intimate setting, combined with the activity of negotiating, framing and posing for a group photo provided a space for new connections to be formed, and existing relationships to be reinforced.
The attendees also became familiar with RFID interactions over time, and once they had experienced one kind of interaction, wanted to try more. Other RFID-based installations, in particular the free-beer-machine was a very low-threshold introduction to RFID interaction with a very high-degree of motivation… This benefited us all by lowering the threshold to participation.
With a single touch of a tag to a reader, we could have initiated many different actions within the Picnic network site; we had access to names, profiles, contact information including addresses and phone numbers and even perhaps payment information. But we chose fairly simple events: displaying people’s first name, updating the relationships between people, and relating photos to profiles.
However given that we had access to this data, we were very surprised that nobody questioned the fact that the booth knew their name. We expected there to be questions of privacy and security and perhaps some resentment towards the ease with which the booth accessed data. It seemed that the gesture and the resulting feedback was so natural that there didn’t seem to be anything scary about a name appearing on screen, in fact people assumed that somehow the RFID tag contained the information, the network wasn’t seen as part of the interaction. This shows how readily emerging technologies can be accepted without question, and how their implications remain obscure under the surface of an engaging experience.
Conferences are a relatively constrained setting where there is an impetus to connect with people and social networks that expand, shift and change over the course of a few days. Social networks in this controlled space have many different qualities to the ones experienced in everyday life. So installations such as the photo booth must be designed to play with the existing social fabric and activities of the conference environment.
There are many different ways in which technology can intervene in these settings, something Clay Shirky has called situated software. Whereas most online social networks require users to explicitly state relationships to each other such as ‘friend’, ‘contact’ or ‘follower’ with these physically-based interactions the connection is much more implicit and less formal.
A simple physical gesture — touching some tags together at the same time — is all it takes to create a connection. Browsing through the Picnic network after having used the booth for a few days was an entirely new experience; the network was more random and chaotic, but because it had emerged from physical, social proximity there is a richer texture to the network than one built through explicit selection. Growing an online social network through these kinds of low-threshold physical interactions seems like a interesting pattern that we might see more of in the future.
More photos from the booth and of the booth.
While thinking about radio-field-based interactions and the gestures that they entail I’m reminded of this quote by Adam in Everyware:
“If you really want to know what information processing dissolving in behaviour really looks like, catch the way women swing their handbags across the Octopus readers at the turnstiles of the Mong Kok subway station; there’s nothing in the slightest to suggest that this casual 0.3-second gesture is the site of intense technical intervention.”
Some of the most common RFID gestures that have truly become part of everyday life are in contactless ticketing. Here are some images I took in Seoul, South Korea:
Surprisingly, there is not a lot of work on the spatial or gestural aspects of radio-based interfaces. There is some work towards looking at the spatial aspects of camera-based interactions:
Reeves, S. et al., 2006. The spatial character of sensor technology. In Proceedings of the 6th ACM conference on Designing Interactive systems. University Park, PA, USA: ACM Press, pp. 31-40.
This week the the MA interaction design course Tangible Interactions is having its summer exhibition at the Oslo School of Architecture and Design. The students have been focusing on designing interactions with RFID technology. This years exhibition includes games, token-based media, transactions, wayshowing, a story-telling pillow, ‘twittering’ things and more.
The exhibition is a part of AHO Works.
I happened to catch the American-centric documentary history of the mobile phone called The Cellphone Revolution yesterday.
The most compelling content was the early visualisations of cellular networks, made by Motorola and AT&T at the time that they were trying to convince the FCC that mobile telephony was important.
It also features rather nice footage and photos of early mobile phone prototypes from Motorola, that displayed many contemporary form factors such as sliders and flip-phones. Worth checking out that full article for a bit of emerging tech/design history.
Touch and travel is a German pilot scheme (one of many) that is testing NFC for ticketing on public transport. One of the partners in the trial Giesecke and Devrient describe it:
“With the new eTicketing System Touch&Travel from Deutsche Bahn (DB), the mobile phone serves as an electronic ticket on trains, buses, streetcars, subways, etc. The SIM cards inside the phones are provided by Giesecke & Devrient. The Touch&Travel project is initiated by Deutsche Bahn, the German railway, and the mobile operator Vodafone.”
This trial shows one of the ways that NFC changes the infrastructure required for a ticketing or payment service. In this case it is a lightweight, parasitic infrastructure that can fairly cheaply be added to other ticketing methods. The service relies on three elements:
More details on the service/interaction design:
Of course the service requires that NFC handsets are easily available, or that the service is sold through SIM add-ons for existing mobiles (perhaps as an alternative to a contactless card like Oyster/Suica).
I wonder how a service that relies so heavily on an ad-hoc infrastructure will be accountable to failure and who holds responsibility and the problem-solving ability for errors and misunderstandings?
Thinking also about the parasitic; might multiple services compete with each other for approachable station space? In a de-regulated environment (I’m thinking of the UK here) who you touch might define what service you get…
In the same vein as the Bubbles of Radio work from last year, Magnetic Movie is a film that explores visible and audible manifestations of radio fields. The film is by Ruth Jarman & Joe Gerhardt of Semiconductor and commissioned by Animate Projects that remains on the forefront of “exploring the relationship between art and animation”.
“Natural magnetic fields are revealed as chaotic, ever-changing geometries… Are we observing a series of scientific experiments, the universe in flux, or a documentary of a fictional world?” The stills don’t do the pulsing, crackling, moving visuals justice, I highly recommend that you go and watch the film.
On April 15th Nokia announced the 6212 ‘classic’ phone that incorporates Near Field Communication technology. This phone is the fourth NFC-capable phone from Nokia in as many years and it is the first NFC device that supports 3G data connections.
This is a simple ‘classic’ or ‘candybar’ design like the earliest NFC models. Nokia has a history of basing its NFC devices on existing models (see the 5140 from 2004, the 3220 from 2005, and 6131 from 2007). The 6212 looks like it is based on the 3120 classic (announced in February 2008) with the addition of an NFC module and a slightly simplified physical design. Compared with the most recent NFC phone, the 6131, the 6212 is slightly smaller and lighter with a smaller display at the same resolution. More notes on the design details below.
This interview with Jeremy Belostock — Nokia’s NFC Sales & Marketing Director — has a number of cutaways that show some of the new NFC features in action.
There is a discussion about the path towards the mass market: whether to focus on user acceptance or building infrastructural ‘ecosystems’. NFC is discussed as being immediately suitable for developed markets where there is infrastructure already in place (such as RFID ticketing and credit card systems such as Oyster and Visa Wave). Although emerging markets are interesting, there is a particular emphasises on Western Europe and Asia in NFC transport and payment, because of the immediate benefits in these areas. The interview ends with a brief (and rather odd) discussion of the environmental benefits of NFC. I’m not sure replacing a stack of plastic cards with a mobile phone is necessarily an improvement towards sustainability (most of my credit and debit cards outlast my mobile phones by a factor of 2 or 3).
Nokia is attempting to focus on features such as sharing content through touch-interactions and using tags as a way of controlling phone functions. Nokia seems to call these emerging interactions “tapping and sharing”. In the demo we see:
The specifications also note that it’s possible to “share business cards, bookmarks, calendar notes, images, profiles, and more” so there is clearly a deeper integration between the Series 40 system and the NFC functions here than with earlier devices (we called for this in 2005 when we had the first look at the 3220). What is not shown is the before/after interactions that are required to set up these sharing actions. How do I set up the transfer? What happens if we simply touch phones together? What are the default events? Where and how are these actions phrased within the menu system? Without seeing these we cannot yet assess the quality of these new NFC interactions.
Touch-based interactions are super-simple, orders of magnitude less button clicks and less security hassles than a technology like Bluetooth. This simplicity stems from the physical proximity required when interacting with tiny RFID fields. The demo shows NFC pairing between two devices working in various physical ways: two phones are tapped side to side, face to face and face to back. Previously these interactions were imagined to work back to back but since RFID works through electromagnetic induction, which creates a field that encompasses both sides of the antenna, other physical gestures are possible.
When the NFC chip is given enough power and when the interaction involves two readers rather than a reader powering a passive tag, phone-to-phone interactions will work in many configurations around the device. Although this seems to be a technical reality, I wonder if it makes sense to visualise and explain NFC in this way? Should there be an active point of connection on the phone that is more like a button rather than an active aura surrounding the entire phone? There is an interesting study to be created here about the user’s mental models formed by these subtly different interaction types. More on touch-interaction affordances later.
This launch is not just about the NFC phone, but points towards a range of NFC appliances: “pairing with a Bluetooth NFC-enabled device, like the new NFC variant of the Nokia BH-210 headset, happens with just one touch“.
At first glance this suggests that new Nokia accessories may have embedded NFC tags, but it seems that “the Bluetooth Headset BH-210 sales package includes a pairing tag that has BH-210 address information in it. Pair the device and headset conveniently by tapping the tag with the device.” When suitable Mifare tags are available down to about 10mm in diameter, why not embed the pairing tag inside the device itself? Perhaps the fear is that pranksters could sneak up to unsuspecting bluetooth-headset-wearing businesspeople and pair with their devices through a sneaky swipe…
Nonetheless, this points in some interesting directions, towards interfaces and control for all sorts of consumer devices. It highlights the possibility of the mobile phone as a ubiquitous controller where it interacts with a multitude of inputs and outputs from games controllers and sensors to printers and screens, and then perhaps a whole host of other devices that require a rich interface but don’t have the physical form or price range to justify one. For more on this see our thoughts on the universal controller and this research paper by Christof Roduner.
The phone is packaged with three tags, one of which is a ‘tutorial’ tag that teaches the use of NFC with on-screen tutorials. This learning mode seems to include lots of animations where phones and tags are brought into contact with each other, perhaps the least complicated part of NFC interactions. Without seeing it for ourselves its difficult to say, but the tutorials could perhaps be more useful for explaining the possibilities inherent in putting URLs, phone numbers, etc. onto tags.
If we are expected to regularly touch our phones against grubby payment terminals, subway gates and public advertising, the surfaces and materials both on the phone and in the world must encourage this touching action. A robust and rugged shell is essential.
From the very first mobile phones that could be operated with one hand, Nokia has traditionally been good at creating robust, over-engineered devices that play well in the messy, physical world. The challenge with NFC is to create natural, basic touch interactions through material, ergonomic or other affordances. What are the physical affordances that would encourage — as Dourish puts it — ‘interacting in the world, participating in it and acting through it, in the absorbed and unreflective manner of normal experience.’? So beyond ruggedness and a degree of scratch-proofing, what is necessary for these touch-interaction affordances?
The first consideration is the placement of the reader. The above image is a quick excercise imagining where readers might be placed on various phone models. The 5140 RFID kit and the 3220 NFC shell had a ‘classic’ or ‘candybar’ form that meant that the NFC reader was placed on the lower back of the device. Apparently this was to separate the various radio antennae (GSM, Bluetooth, etc.) from the RFID antenna, but all of our experiments showed that this was confusing to users. The 6131 solved this by placing the NFC reader at the top of the flip-up screen, away from the other antennae at the hinge.
Somehow the NFC reader in the 6212 is at the top of the device. This is a very good place to have an ‘active area’, it’s outside of the natural hand-grip, and its the part of the phone that most often faces the world, encouraging intuitive pointing and selecting gestures. With this placement the phone becomes a kind of ‘wand’, that perhaps draws on the metaphor of magic in ubiquitous computing. Whatever our thoughts on magic in interaction design, there is no doubt that this gesture is culturally significant and is likely to be a useful model.
More practically, the 6212 features a camera lens in roughly the same position as the reader. This combined with the perforated loudspeaker work against the idea of a robust active area. This is clearly a tradeoff, will scratches and grit getting into these delicate areas hinder touch-based interactions, and will keeping the phone pristine in general be a problem? Would a shiny iPhone ever be suitable for touch-based interactions?
The second consideration is signs and symbols. There was a time when Nokia thought it necessary to indicate the active area of NFC phones with a visual icon, starting with two concentric rings and moving on to the ‘wireless fingerprint’:
But the 6131 and 6212 have no visible indication whatsoever that they offer any sort of NFC functionality. The clear plastic film that protects the 6131 screen had a diagram of a phone-tag interaction but that of course gets quickly removed.
My feeling is that there should be clearer markings for the NFC active areas on these phones, even if it is a change in texture, colour or material, it seems like a functional necessity until NFC is properly accepted and understood in the mass market. It’s also a particularly easy thing to do. When music phones have very clearly marked dedicated buttons devoted to specific media functions, why shouldn’t a significant functional and interactional surface be clearly marked on the device?
A few quick sketches using some of the icons from the graphic language for touch. Whether the possibilities inherent in NFC are indicated through clear affordances or explicit symbology, this is extremely important to get right.
The 6212 has a slightly better higher resolution camera than the 6131. It also offers a second video camera on the display side (why do they still include these, does anyone actually do video calling? Is there a secondary usage that I’m missing, YouTube?)
The press-release and demos emphasise the new level of integration between NFC and Bluetooth but the specifications don’t list Bluetooth 2.1. Of course it supports the standard contactless communication API (JSR 257) so that 3rd parties like us can develop applications for NFC. We hope that it gives us more leeway than the implementation on the 6131. Includes MIDP 2.1 and a few other Java APIs.
The phone also supports the Nokia Software Market for application discovery and this might be very useful for distributing consumer-focused NFC applications.
Touch is a research project that investigates Near Field Communication (NFC), a technology that enables connections between mobile phones and physical things. We are developing applications and services that enable people to interact with everyday objects and situations through their mobile devices.
Feed