What is Gesture-Based Computing?

It is already common to interact with a new class of devices entirely by using natural movements and gestures. The Microsoft Surface, Apple’s iOS devices (iPad, iPhone and iPod Touch), and other gesture-based systems accept input in the form of taps, swipes, and other ways of touching. The Nintendo Wii and Microsoft’s Kinect system extend that to hand and arm motions, or body movement. These are the first in a growing array of alternative input devices that allow computers to recognize and interpret natural physical gestures as a means of control. Gesture-based computing allows users to engage in virtual activities with motions and movements similar to what they would use in the real world, manipulating content intuitively. The idea that simple gestures and natural, comfortable motions can be used to control computers is opening the way to a host of input devices that look and feel very different from the keyboard and mouse — and that are increasingly enabling our devices to infer meaning from the movements and gestures we make.

INSTRUCTIONS: Enter your responses to the questions below. This is most easily done by moving your cursor to the end of the last item and pressing RETURN to create a new bullet point. Please include URLs whenever you can (full URLs will automatically be turned into hyperlinks; please type them out rather than using the linking tools in the toolbar).

Please "sign" your contributions by marking with the code of 4 tildes (~) in a row so that we can follow up with you if we need additional information or leads to examples- this produces a signature when the page is updated, like this: - Larry Larry Feb 7, 2012

(1) How might this technology be relevant to the educational sector you know best?

  • I saw this in play at the Microsoft Partners in Learning Global Forum and believe that it has power to engage students and reach our kin esthetic learners. It also holds potential where it intersects with game based learning. - kari.stubbs kari.stubbs Feb 29, 2012- sarietjie.musgrave sarietjie.musgrave Mar 4, 2012
  • and we begin to see the combination with interactive whiteboards which also have a potential. - claus.gregersen claus.gregersen Mar 4, 2012
  • Agree that this theme links well with game based learning. This technology holds great potential for students with physical learning barriers (we speak about special needs students in SA). They have been using simple gesture based computing for some time and the rest of education is catching up to the potential it holds- sarietjie.musgrave sarietjie.musgrave Mar 4, 2012
  • Seeing as how Windows 8 will allow us to basically have the power of Kinect even in near future laptops, we can think about teaching more physical education classes from a distance. The power of these devices comes from the ability to read the whole body and give us feedback on whether we are doing the movements right or not. This can be associated to a game, but can go way beyond that. Students can put up plays (rehearsing from a distance), work on cheerleading routines, on sports, dance, and more.- cristiana.mattos cristiana.mattos Mar 4, 2012

(2) What themes are missing from the above description that you think are important?

  • Gesture-based software also gives feedback on whether you are doing the movement right or not.- cristiana.mattos cristiana.mattos Mar 4, 2012
  • add your response here

(3) What do you see as the potential impact of this technology on teaching, learning, or creative expression?

  • Student engagement, reinforcement of learning, introduction of a new topic, collaboration, informal & formal learning - kari.stubbs kari.stubbs Feb 29, 2012
  • For me, gesture-based computing just naturally links well with creative expression - movements can be big, small and despite it "happening on the computer" your body controls space. The ample examples in fiction movies children are exposed to, makes gesture-based computer "feel" natural.- sarietjie.musgrave sarietjie.musgrave Mar 4, 2012

(4) Do you have or know of a project working in this area?

  • Microsoft projects mentioned above - kari.stubbs kari.stubbs Feb 29, 2012 There was a great example of a group of students that designed a Science game for the XBox.- sarietjie.musgrave sarietjie.musgrave Mar 4, 2012
  • add your response here

Please share information about related projects in our Horizon K-12 Project form.