Microsoft PixelSense (formerly called Microsoft Surface) was an interactive surface computing platform that allowed one or more people to use and touch real-world objects, and share digital content at the same time. The PixelSense platform consists of software and hardware products that combine vision based multitouch PC hardware, 360-degree multiuser application design, and Windows software to create a natural user interface (NUI).
 Official logo | |
| Developer(s) | Microsoft, Samsung |
|---|---|
| Initial release | Microsoft Surface 1.0 (April 17[1] 2008) |
| Stable release | Hardware: Samsung SUR40 with Microsoft PixelSense (2012)
Software: Microsoft Surface 2.0 (2011) |
| Operating system | Microsoft Surface 1.0: Windows Vista (32-bit) Samsung SUR40 with Microsoft PixelSense: Windows 7 Professional for Embedded Systems (64-bit) |
| Platform | Microsoft Surface 1.0: Microsoft Surface 1.0 Samsung SUR40 with Microsoft PixelSense: Microsoft Surface 2.0 |
| Available in | English, Danish, German, Spanish, French, Italian, Korean, Norwegian, Dutch, Swedish |
| Website | www.pixelsense.com |
Overview
editMicrosoft Surface 1.0, the first version of PixelSense, was announced on May 29, 2007, at the D5 Conference.[2] It shipped to customers in 2008 as an end-to-end solution with Microsoft producing and selling the combined hardware/software platform. It is a 30-inch (76 cm) 4:3 rear projection display (1024×768) with an integrated PC and five near-infrared (IR) cameras that can see fingers and objects placed on the display. The display is placed in a horizontal orientation, giving it a table-like appearance. The product and its applications are designed so that several people can approach the display from all sides to simultaneously share and interact with digital content. The cameras’ vision capabilities enable the product to see a near-IR image of what’s placed on the screen, captured at approximately 60 times per second. The Surface platform processing identifies three types of objects touching the screen: fingers, tags, and blobs. Raw vision data is also available and can be used in applications. The device is optimized to recognize 52 simultaneous multitouch points of contact. Microsoft Corporation produced the hardware and software for the Microsoft Surface 1.0 product. Sales of Microsoft Surface 1.0 were discontinued in 2011 in anticipation of the release of the Samsung SUR40 for Microsoft Surface and the Microsoft Surface 2.0 software platform.
Microsoft and Samsung partnered to announce the current version of PixelSense, the Samsung SUR40 for Microsoft Surface (“SUR40”), at the Consumer Electronics Show (CES) in 2011.[3] Samsung began shipping the new SUR40 hardware with the Microsoft Surface 2.0 software platform to customers in early 2012.
The Samsung SUR40 is a 40-inch (102 cm) 16:9 LED backlit LCD (1920×1080) with integrated PC and PixelSense technology, which replaces the cameras in the previous product. PixelSense technology enables Samsung and Microsoft to reduce the thickness of the product from 22 in (56 cm) to 4 in (10 cm). The size reduction enables the product to be placed horizontally, and adds the capability to be mounted vertically while retaining the ability to recognize fingers, tags, blobs and utilize raw vision data.
Target market
editPixelSense is designed primarily for use by commercial customers to use in public settings. People interact with the product using direct touch interactions and by placing objects on the screen. Objects of a specific size and shape, or with tag patterns, can be uniquely identified to initiate a preprogrammed response by the computer. The device does not require the use of a traditional PC mouse or keyboard, and generally does not require training or foreknowledge to operate. Additionally, the system is designed to interact with several people at the same time so that content can be shared without the limitations of a single-user device. These combined characteristics place the Microsoft Surface platform in the category of so-called natural user interface (NUI), the apparent successor to the graphical user interface (GUI) systems popularized in the 1980s and 1990s.
Microsoft states that sales of PixelSense are targeted toward the following industry verticals: retail, media and entertainment, healthcare, financial services, education, and government. PixelSense is available for sale in over 40 countries, including United States, Canada, Austria, Belgium, Denmark, France, Germany, Ireland, Italy, Norway, Netherlands, Qatar, Saudi Arabia, Spain, Sweden, Switzerland, United Arab Emirates (UAE), United Kingdom (UK), Australia, Korea, India, Singapore, and Hong Kong.
History
editThe idea for the product was initially conceptualized in 2001 by Steven Bathiche of Microsoft Hardware and Andy Wilson of Microsoft Research.[4]
In October 2001, DJ Kurlander, Michael Kim, Joel Dehlin, Bathiche and Wilson formed a virtual team to bring the idea to the next stage of development.
In 2003, the team presented the idea to the Microsoft Chairman Bill Gates, in a group review. Later, the virtual team was expanded and a prototype nicknamed T1 was produced within a month. The prototype was based on an IKEA table with a hole cut in the top and a sheet of architect vellum used as a diffuser. The team also developed some applications, including pinball, a photo browser, and a video puzzle. Over the next year, Microsoft built more than 85 prototypes. The final hardware design was completed in 2005.
A similar concept was used in the 2002 science fiction movie Minority Report. As noted in the DVD commentary, the director Steven Spielberg stated the concept of the device came from consultation with Microsoft during the making of the movie. One of the film's technology consultant's associates from MIT later joined Microsoft to work on the project.[5]
The technology was unveiled as under the "Microsoft Surface" name by Microsoft CEO Steve Ballmer on May 30, 2007, at The Wall Street Journal's 'D: All Things Digital' conference in Carlsbad, California.[6] Surface Computing is part of Microsoft's Productivity and Extended Consumer Experiences Group, which is within the Entertainment & Devices division. The first few companies slated to deploy it were Harrah's Entertainment, Starwood, T-Mobile and a distributor, International Game Technology.[7]
On April 17, 2008, AT&T became the first retailer to sell the product.[8] In June 2008 Harrah’s Entertainment launched Microsoft Surface at Rio iBar[9] and Disneyland launched it in Tomorrowland, Innoventions Dream Home.[10] On August 13, 2008, Sheraton Hotels introduced it in their hotel lobbies at 5 locations.[11] On September 8, 2008, MSNBC began using it to work with election maps for the 2008 U.S. Presidential Election on air.
On June 18, 2012, the product was re-branded under the name "Microsoft PixelSense" as a result of the company adopting the Surface brand for its newly unveiled series of tablet PCs.[12] The Samsung SUR40 was discontinued in 2013.[13]
Features
edit
Microsoft notes four main components being important in the PixelSense interface: direct interaction, multi-touch contact, a multi-user experience, and object recognition.
Direct interaction refers to the user's ability to simply reach out and touch the interface of an application in order to interact with it, without the need for a mouse or keyboard. Multi-touch contact refers to the ability to have multiple contact points with an interface, unlike with a mouse, where there is only one cursor. Multi-user experience is a benefit of multi-touch: several people can orient themselves on different sides of the surface to interact with an application simultaneously. Object recognition refers to the device's ability to recognize the presence and orientation of tagged objects placed on top of it.
The technology allows non-digital objects to be used as input devices. In one example, a normal paint brush was used to create a digital painting in the software.[14] This is made possible by the fact that, in using cameras for input, the system does not rely on restrictive properties required of conventional touchscreen or touchpad devices such as the capacitance, electrical resistance, or temperature of the tool used (see Touchscreen).
In the old technology, the computer's "vision" was created by a near-infrared, 850-nanometer-wavelength LED light source aimed at the surface. When an object touched the tabletop, the light was reflected to multiple infrared cameras with a net resolution of 1024×768, allowing it to sense, and react to items touching the tabletop.
The system ships with basic applications, including photos, music, virtual concierge, and games, that can be customized for the customers.[15]
A feature that comes preinstalled is the "Attract" application, an image of water with leaves and rocks within it. By touching the screen, users can create ripples in the water, much like a real stream. Additionally, the pressure of touch alters the size of the ripple created, and objects placed into the water create a barrier that ripples bounce off, just as they would in a real pond.
The technology used in newer devices allows recognition of fingers, tag, blob, raw data, and objects that are placed on the screen, allowing vision-based interaction without the use of cameras. Sensors in the individual pixels in the display register what is touching the screen.
Hardware specifications
editMicrosoft Surface 1.0
edit- Software development kit (SDK): Microsoft Surface 1.0
- Form factor usage: Tables and counters
- Display + vision input technology: Rear projection DLP w/cameras
- Price: Starting at $10,000 USD
- Weight: 198 lbs (90 kg)
- Physical dimensions (L × W × H): 42.5 × 27 × 21 in (108 × 68.6 × 53.3 cm)
- CPU: Intel Core 2 Duo E6400 2.13 GHz processor
- Graphics (GPU): ATI Radeon X1650 – 256 MB
- Memory: 2 GB DDR2
- Storage (hard drive): 160 GB HDD
- Display size: 30 in (76.2 cm) diagonal
- Display resolution: 1024×768 – 4:3 aspect ratio
- Extensions (ports): XGA (DE-15) video out, RGB analog component video out, RCA analog component audio out, 4 USB ports
- Networking: Wi-Fi 802.11g, Bluetooth, and Ethernet 10/100
- Operating system: Windows Vista (32-bit)
Samsung SUR40 with Microsoft PixelSense
edit- Software development kit (SDK): Microsoft Surface 2.0
- Form factor usage: Tables, counters, kiosks and walls
- Display + vision input technology: Thin LCD w/ PixelSense technology
- Price: Starting at $8,400 USD
- Weight: 80 lbs (36 kg)
- Physical dimensions (L × W × H): 42.7 × 27.5 × 4 in (108.5 × 69.9 × 10.2 cm)
- CPU: AMD Athlon II X2 245e 2.9 GHz dual-core processor
- Graphics (GPU): AMD Radeon HD 6570M – 1 GB GDDR5
- Memory: 4 GB DDR3
- Storage (hard drive): 320 GB HDD
- Display size: 40 in (101.6 cm) diagonal
- Display resolution: 1920×1080 – 16:9 aspect ratio
- Extensions (ports): HDMI input & output, S/PDIF 5.1 digital audio surround sound out, RCA analog component audio out, 3.5 mm TRS (stereo mini-jack) audio out, 4 USB ports
- Networking: Wi-Fi 802.11n, Bluetooth, and Ethernet 10/100/1000
- Operating system: Windows 7 Professional for Embedded Systems (64-bit)
Applications development
editMicrosoft provides the free Microsoft Surface 2.0 Software Development Kit (SDK) for developers to create NUI touch applications for devices with PixelSense and Windows 7 touch PCs.
Applications for PixelSense can be written in Windows Presentation Foundation or XNA. The development process is much like normal Windows 7 development, but custom WPF controls had to be created due to the unique interface of the system. Developers already proficient in WPF can utilize the SDK to write applications for PixelSense for deployments for the large hotels, casinos, and restaurants.[16]
Related Microsoft research projects
editMicrosoft Research has published information about a related technology dubbed SecondLight.[17] Still in the research phase,[18] this project augments secondary images onto physical objects on or above the main display.
See also
editReferences
edit- ^ "AT&T First to Introduce Microsoft Surface in Retail Stores to Enhance Mobile Shopping Experience: First commercial Microsoft Surface launch to begin April 17 in select AT&T stores with expanded deployment planned throughout 2008". Microsoft. Archived from the original on 2012-02-21. Retrieved 2020-04-17.
- ^ "Bumps on the road to Microsoft's Surface". CNET News.com. CNET Networks. Archived from the original on 2012-11-03. Retrieved 2007-11-08.
- ^ "Microsoft and Samsung unveil SUR40, the 'Surface 2.0 Experience' you still can't buy (video) – Engadget". Archived from the original on 2016-04-13. Retrieved 2017-09-05.
- ^ "Microsoft Surface Fact History". Microsoft. Archived from the original on 2007-06-14. Retrieved 2007-05-30.
- ^ "Correction: "The Island" did NOT feature a Surface – istartedsomething". 20 June 2007. Archived from the original on 2011-07-20. Retrieved 2007-06-21.
- ^ "Look What's Surfacing at Microsoft" (Press release). Microsoft. 2007-05-29. Archived from the original on 2007-06-01.
- ^ "Microsoft Launches New Product Category: Surface Computing Comes to Life in Restaurants, Hotels, Retail Locations and Casino Resorts" (Press release). Microsoft. 2007-05-29. Archived from the original on 2007-06-01.
- ^ "Microsoft Surface Now in AT&T Stores". Archived from the original on 2010-06-20. Retrieved 2008-05-28.
- ^ "Harrah's Entertainment Launches Microsoft Surface at Rio iBar, Providing Guests With Innovative and Immersive New Entertainment Experiences". Microsoft. Archived from the original on 2012-02-21. Retrieved 2020-04-17.
- ^ "Disney's Innoventions Dream Home is a Big Ad For Microsoft and HP...But I Still Want It". 20 June 2008. Archived from the original on 2017-05-18. Retrieved 2017-09-10.
- ^ https://www.microsoft.com/Presspass/press/2008/aug08/08-13SheratonMSSurfacePR.mspx Archived 2012-02-23 at the Wayback Machine Sheraton Hotels & Resorts Transforms the Hotel Lobby Experience With Microsoft Surface
- ^ Microsoft rebrands original Surface table-based touchscreen as PixelSense Archived 2016-12-06 at the Wayback Machine, theverge.com
- ^ Weinberger, Matt (August 23, 2016). "Microsoft's very first Surface was this largely forgotten coffee table sized-tablet that Bill Gates loved". Yahoo! Finance. Business Insider. Retrieved January 30, 2024.
As an epilogue, PixelSense didn't last long, with the Samsung SUR40 getting discontinued in 2013.
- ^ Bishop, Todd (2007-05-29). "Microsoft Surface brings computing to the table". Seattle Post-Intelligencer. Archived from the original on 2010-11-20. Retrieved 2007-05-30.
- ^ "Microsoft Surface Fact Sheet". Microsoft. Archived from the original on 2007-06-14. Retrieved 2007-05-30.
- ^ "What lurks below Microsoft's Surface? A brief Q&A with Microsoft". 31 May 2007. Archived from the original on 2009-01-23. Retrieved 2017-06-14.
- ^ "Hands-On Computing – Microsoft Research". Archived from the original on 2009-09-26. Retrieved 2009-11-05.
- ^ "Clearing up the confusion on future Microsoft Surface". Archived from the original on 2014-05-17. Retrieved 2014-06-30.