Saturday, October 12, 2013

First Presentation slide






Description may come soon!!!!!!!!!!!!!






[Slide 4-6] What is TaP

        "Talk and Play for Interactive Learning Playground" project or TaP is a kind of interactive playground for school children. Talk and play is mean children can interact and play with them. We want to make a game that projected on the floor as a physical playground and detect their movement by using kinect. This project includes general education subjects such as Art, Mathematics, Language, and Physics in terms of games. Children will enjoy interacting with the games while learning knowledge embedded in them. We also study related topic such as children development and learning, rules of mathematics, physics of colour and light for designing a game. Study about physical of movement  for design the interact. 

       This is the picture from our internship that we testing using kinect to detect whole body and It is our first motivation to making TaP. 


[Slide 7-8] Motivation

        About our motivation. This project is focus on children, and If we talk about children, we found that we learn a lot when we were children. According to Jean Piaget.  [ฌอง เพียเจ] who is well known from Constructivism Theory. This theory explains how knowledge is constructed in human being and told us childhood is best duration for learning  However, when children study in the class every day, they can get bored from the same pattern of teaching.


        So according from 'Seymour Papert'. who is well known from 'Constructionism Theory'. This theory is inspired by the Jean Piaget Theory, but this theory is talk about learner can learn more when they connect their learning via hands-on and object-to-think-with, especially via technologies.


        So If children do some more learning activities together with their friends, they will be more interested and gained more knowledge than general learning process. They also get the opportunity to participate with social rather than participate only with teacher.


[Slide 9-10] Motivation

       When children tries to learn something especially hard things, such as physics, mathematics and language, they try to ignore it. Because of confusion of many rules and complexity. A way to reduce the complexity is making games, because when children are playing games, they think it is just a game. It can break the first cover of person who hates study and we can interpolate indirectly knowledge thought the game on game base learning, according the example research from Prof. Kathy Hirsh-Pasek and Prof. Roberta Golinkoff who write book about the level of children’s play. They has been approached game or play as a good form of learning, and it can support children’s cognitive development.


[Slide 14 - 19] Project Scope

       So The point that we got is "Children" “Social Interaction” "Activity with real world" and “Learn Through Play” All of this reason inspired us to create this TaP Project

       This project focuses on school-age children to pre-teen children, 6 - 12 years old because children in this age range love to seek out the new information, experience, challenging and learning how to play fair. It according to research from 


       UC Davis children's hospital they research on 'What Toys are Appropriate for My Child' and National Association for Education of Young Children (NAEYC) they research on 'Good Toys for Young Children by Age and Stage' and technology that we use is Kinect. We use kinect to detect children movement and simulate game’s environment by projecting and displaying image on the floor and the game is covered knowledge from general education subjects. For example, Art to appear in combination of colours, Physics to appear in reflecting the light and Mathematics to appear in geometric shape and solving equations. Children will play all these game by using their body interaction. 



[Slide-19] Related work


       Our related work is Microsoft Kinect that was released on 2012.Its properties to detect skeletons, full body, including depth sensor, color and voice recognize. It’s well known as a game console device. But we think it should be worth than entertainer . So, we decide to develop it in our work.

[Slide-22] Design

       This is an interactive design of our work - including playground screen and devices. When player come to area and do some gesture; Kinect will detect player motion and process input to computer; Computer process the game;then send output screen to Projector and projects it on the floor.

[Slide-23] Game design


       We have gorgeous playground screen with clearly design.
Because our user is a children so it should be simple and clear.



       This game is to mixing and finds output color. We have "challenge quest” to tell the mission and we have player area, which can change to every color. In this example, the quest is Blue + Red, 


the answer should be “Violet” right? When players walk in, screen will show their own random color. Then, they should do some gesture to change their color. The player who can find Violet first, will be the winner.

[Slide-24] The second game called reflecting light


       The idea was the same as previous game but it has some more component = reflecting objects. In the game, player must change object to the right angle (change by some gesture) to make reflect into the black hole. The player who can find the right color and right angle first, will be the winner.

[Slide-25] The third game is Word guessing game

       In the game, player will see the picture on the top field and guessing the vocabulary. Then, they have to catch those falling alphabets that fall randomly.For example player should catch “D-O-G” to complete this mission.

[Slide-26] The fourth game is math game

       According to the name, this game is about calculating number.
Game will show the mission on top; for this example “Some number + Some number = 6"The player should catch the falling number to complete this equation. Game will provide flexible answer in each


mission.

[Slide-27] The last game player will interact with the real objects

       We will set-up playground with real object such as a ball and boxes in geometry shape. In the game, player should push the real object that similar to the shape on the challenge quest. Then, device will detect the shape to prove that it is the same shape or not. And this is all about the concept of games. Now, Let’s move to another topic.

Compare motion detection devices

Our group will compare 3 motion detection devices to be used. First device is Kinect. Second is Leap Motion and the last one is Web camera. 3 motion detection devices are used for detecting skeletons or any object. However, There have limited to use in each device and difference to work. Therefore, we will compare all those devices which one is the best device to be used.

Kinect



Kinect is a motion sensing input device by microsoft for the Xbox 360 video game console and Window PCs, which has RGB Camera , 3D Depth Sensors, Motorized Tilt , and Multi - Array Microphone

Platform
    • Windows 7, 8
    • Mac OS
Develop library can use with


    • Kinect SDK
    • Microsoft Visual Studio
    • OpenCV
    • OpenNI
    • EmguCV
Language
    • C#
    • C++
    • Java
    • Processing (use with Mac os)
Constrain
    • Kinect can recognize 6 people but detecting full body up to 2 people
Figure 1: Kinect can recognize 6 people and track two


    • Player must stand in the straight orientation and don’t be profile

Figure 2: Skeleton tracking is designed to recognise users facing the sensor
    • Kinect can see people standing from 0.8 to 4 meters away. Suggesting a practical range to detecting is 1.2 to 3.5 meters 

Figure 3: Kinect horizontal Field of View in default range



Figure 4: Kinect vertical Field of Veiw in default range

Leap Motion







Leap Motion is new technology detection device by Leap Motion,Inc. The Leap motion is used for detect and track hands ,fingers and finger - like tools. The device operates in an intimate proximity with high precision and tracking frame rate.

Platform
    • Windows 7, 8
    • Mac OS
Develop library can use with
    • Leap motion SDK
    • Microsoft Visual studio
Language
    • Java
    • C#
    • C
    • C++
    • Python
    • JavaScript
Constrain
    • can detect approximately 25 to 600 millimeters above the device (1 inch to 2 feet).
    • Sensor lacks precision
    • Truly useful apps remain to be see

Web Camera


Web Camera is general web camera which you use at home.


Platform
    • Windows 7, 8
    • Mac OS
Develop library can use with
    • OpenCv
    • Microsoft Visual studio
    • EmguCV
Language
    • C#
    • VB
    • .NET
Constrain
    • difficult to detect skeleton in real time

Figure5: comparing motion detection devices table

After we compare all those devices, so we decided to use Kinect as current device. Because we want to detect whole body.Leap motion can't detect far distance and Leap motion is so difficult to detect skeleton in time. Therefore, Kinect is the best device to use and also Leap motion and Webcam are alternative devices too.

Reference:


      Author: Chutsuda Rattarasan  [Modern]