Ðóñ Eng During last 365 days Approved articles: 2080,   Articles in work: 304 Declined articles: 807 
Library

Smorkalov A.Yu., Sadovin I.A. System for transferring lectures into virtual world vAcademia using features of Microsoft Kinect and stream processors

Published in journal "Software systems and computational methods", 2013-4 in rubric "Virtual worlds and virtual reality systems", pages 354-362.

Resume: the article reviews techniques and architecture of a system for transferring “live” lectures into virtual world vAcademia. The system records lector’s voice and uses Microsoft Kinect for capturing teacher’s gestures transforming this data into lector’s avatar animation. With the performance capabilities of streaming processors the content of the projector’s screen used by teacher is transferred directly to the virtual world and displayed in shared graphical workspace, and the additional analysis of the image from Kinect video camera is performed to more accurately determine the position of the body of the teacher. The stream processors allowed eff ectively implement the projector’s screen transfer to the virtual world shared workspace and also capture and recognize colored makers on the teacher’s body with little or no loss of performance. Using Kinect for lecture capture together with capturing image from the projector or interactive board and displaying it in the virtual world could allow teachers to use virtual worlds as a powerful learning tool while remaining in the familiar learning environment. That is the purpose of this research.

Keywords: vAcademia, Microsoft Kinect, stream processors, image analysis, virtual world, lecture capture, presentation, slide lectures, motion capture, discrete wavelet transform

DOI: 10.7256/2305-6061.2013.4.10547

This article can be downloaded freely in PDF format for reading. Download article

Bibliography:
1. Smorkalov, A.Yu. Realizatsiya obrazovatel'nykh instrumentov v virtual'nykh
3D-sredakh s ispol'zovaniem potokovykh protsessorov / A.Yu. Smorkalov //
Obrazovatel'nye tekhnologii i obshchestvo.-T. 14. ¹ 3, 2011.-S. 409-425.
2. Smorkalov, A.Yu. Matematicheskaya i programmnaya modeli generatsii tekstur na
graficheskikh potokovykh protsessorakh / A.Yu. Smorkalov // Programmnye sistemy i
vychislitel'nye metody.-¹ 1, 2013.-S. 116-128.
DOI: 10.7256/2305-6061.2013.01.10
3. L. Jingtang, Z. Gang, T. Dunming, and X. Junjie “Research of skeletal-based virtual human
animation using Cal3D,” in 3rd International Conference on System Science, Engineering
Design and Manufacturing Informatization (ICSEM) Chengdu, China, 2012, p. 269–273.
4. Mikhail Morozov, Alexey Gerasimov, Mikhail Fominykh, Andrey Smorkalov.
Asynchronous Immersive Classes in a 3D Virtual World: Extended Description of vAcademia
// Trans. on Comput. Sci. XVIII, LNCS 7848, p. 81-100.
5. Microsoft, Kinect. Web: http://www.microsoft.com/en-us/kinectforwindows.

Correct link to this article:
just copy this link to clipboard