3 Web

*1 ∗1, ∗1, *2,∗1, ∗1, *3, ∗1

Efficient Educational Content Creation System Based on 3D Video Data

Using 3D Data Capturing and Editing System with Web-based Data Sharing Service

Hiroki Morinaga*1, Takuya Ushinohama∗1, Ryousuke Kimura∗1, Yasuhiro Akagi*2,

Michihiro Mikamo∗1, Satoshi Ono∗1, Takashi Yamanoue*3, Hiroshi Kawasaki∗1

Abstract – In this paper, we present an interactive 3D animation creation systemthat enables the user to capture, edit the moving objects and share them easily on theweb. Recently, educational concept called active leaning has been becoming important inthe field of education. The difference between the active leaning and usual education isthat the learner actively absorbs the educational information not only from the lecturer,but also from other media contents such as videos and images. Therefore, various kindsof media contents aiming for active learning are required to help the learners. As theone of such media contents, we developed a system that can create 3D video data andshare them on a web service. Concretely, in our system, the 3D contents are acquiredby using Kinects on a graphical user interface. By using the proposed system, the usercan edit and integrate the other contents such as music and images easily. The contentscan be uploaded on the web server that provides the experience to manipulate the 3Danimation intuitively through a touch interface. In this paper, we explain the overviewof the proposed system and the details of the our algorithms to reconstruct 3D data.The experiment shows our system can obtain the 3D data efficiently by using a novelapproach. As the conclusion, we show some demos to validate that the system is availablefor educational use and a user can operate the proposed system efficiently.

Keywords : education, active leaning, 3D contents, web service, Kinect

1

3

3

3

3

*1

*2

*3

*1Department of Information Science and Biomedical Engi-neering, Kagoshima University

*2Smart Mobility Research Center, Tokyo University ofAgriculture and Technology

*3Department of Computer Science, Fukuyama University

3

3

3

3

VR

3

Vol.20, No.4, 2015

[1]

3

3

Web

[2] [3]

3

GUI

Web

3

3

(Graphical User Interface:

GUI)

VR 3

Web Mooc

Massive open online course

3

Web

3

2

3

4 Kinect 3

5 3

3

6 7 3

8

3

3

9

2

2.1

“Laputa Project”

3

[4] 3

3

. Laputa Project

,

[5].

Laputa Project

WebCT Moodle CMS

Course Management System

[6][7] CMS Web

Mooc [8][9][10] [11]

[12] YouTube [2]

Ustream [13] [3]

[14][15]

Web

Mooc

Web

Web

2

3

3

: 3 Web

2

3

3

[16] 3

3

3

3

3

Web

3

Web

2.2 3

3

3 (Degree Of Freedom:

DOF) 2 3

2

Cohe 3

[17] Bruno

3

[18]

Held 3

Kinect

3

[19]

3

4

1Fig. 1 System construction

2Fig. 2 System overview

3

3

3.1

1 Kinect

Kinect 3

PC 3

4

( 2) 3

Kinect

Kinect

Kinect

3

Kinect

3

3

3 Web

Vol.20, No.4, 2015

3 4dbFig. 3 4db format

3

Web

3.2 3

3

3

1

“.4db” 1

.4db 3

“motion1.zip”

“motion2.zip”

“movie.xml” Web

“thumbnail.png”

“icon1.ply” “1.ply”

“2.ply” 3

“motion.xml”

“rgb0000.png”

“audio.wav”

zip 4db

4

Kinect 3

Kinect2

Kinect PC USB

4 2 Kinect 3DFig. 4 3D data capturing system

PC

Kinect

Kinect

4.1

Kinect

3

PC Kinect

4

GUI

Kinect 3 GUI

Kinect

Kinect 3

4db

CLI Command Line Interface

GUI

3

4db

PC TCP PC

Kinect

4.2

Kinect

Kinect

SDK

: 3 Web

5 3Fig. 5 Importing 3D objects

PC PC

PC

Kinect FPS

30

FPS

160 [sec.] × 1

60

5 3

3

GUI GUI 3

3

3

5.1

3

3

GUI 3

PLY OBJ 3

2 GUI

5

3

Web 3

6Fig. 6 Setting camera path

3

Web 3

3

GUI

6

5.2

3

1

Kinect

[24]

3 Kinect

2 3

[20]

2

1

Vol.20, No.4, 2015

7 3Fig. 7 3D data reconstruction

1

3

7 7(a) Kinect 3

7(b)

7(c)

7(b) Kinect

1

Kinect

6 Web

Web 3

Web

“Hyper3Dcast” Web

6.1 3

3 Web

Hyper3Dcast

3

Twitter Facebook

8

.4db

3

.4db

8Fig. 8 Screenshot of the uploading window

3

URL QR

3

GUI

3 SD Standard Defini-

tion HQ High Qual-

ity 3

HQ

3

HQ 3

Web

3 Web

3

URL

3

6.2 3

9 3

3

URL

3

: 3 Web

9 3Fig. 9 A screenshot of the viewing window

10 3

Fig. 10 Linking to other 3D video and exter-nal sites

URL 3

3 3

Web

3

3 SD HQ 2

HQ

3

3

Web 10

3 WebGL

WebGL

Web

3

11 Hyper3Dcast 3

Fig. 11 The application shows 3D videosposted on Hyper3Dcast

WebGL

PC

7

3

Web

Android OS

3

Hyper3Dcast

API Hyper3Dcast

3

3

Android OS

3

WebGL OpenGL

WebGL

3

3

3

3

3

Vol.20, No.4, 2015

3

8

3

2 Kinect

3

MMD (MikuMikuDance)[21] MMD

3

MMD

MMD

1.

2. Kinect

3. MMD

4. Web

3

2

3

8.1 3

3

magic dance maemawari 3

5 10 5

3 4

MMD magic 34 20

12 3MMD

Fig. 12 The comparison of the editing time tomake 3D video data

13 3Fig. 13 The 3D data used in reconstructing

dance 36 45

maemawari MMD

3

12 3

MMD 3

3 MMD

MMD 3

3

3

PC

3

8.2

2 3

1

: 3 Web

14Fig. 14 The comparison of the processing

time to reconstruct 3D data

Stanford 3D Scanning Repository [22]

3 Bunny2 Armadillo Dragon

13

7

Stanford

14

2

3

3

8.3

4 2 15

15Fig. 15 The proposed 3d video and previous

methods for comparison.

15

3 1 15(a)

3

15(b) 3 15(c) 1

3

3

16

16

t

3

1

5%(0.05) t

P (T≤t) 0.0065

0.0112

8.4

3

( 17). [23]

3

Vol.20, No.4, 2015

16Fig. 16 The time to arrange the boxes

17Fig. 17 Browsing 3D video using a tablet de-

vice

( 18) 3

( 19) 19

3

3

9

3

GUI 3

3

Web

3

18Fig. 18 Animations composed of state transi-

tions

19Fig. 19 Manipulating state transitions on a

tablet device

3

[1] Microsoft Xbox 360 Kinect,http://www.xbox.com/en-US/kinect.

[2] YouTube, http://www.youtube.com/.[3] , http://www.nicovideo.jp/.[4]

, : Laputa Project: The Potential of the 3DInteractive Education System in College EnglishEducation, Proceedings of The Fourth Conferenceon Foreign Language Education and Technology,pp.429-435, 2001 .

[5] : -

- 2005[6] :

: 3 Web

11 , pp. 85-98 2004

[7] Takashi Yamanoue, et al.: Information and Com-munication Technology Infrastructure and Man-agement for Collaboration with Regional Univer-sities and Colleges, Proceedings of the 39th an-nual ACM SIGUCCS conference on User services,pp.25-30, 2011.

[8] : MOOC MOOC, 57

6 , pp. 367-375 2014[9] gacco, http://gacco.org.

[10] jmooc, http://www.jmooc.jp.[11] : ICT ,

56 10 pp. 677-684, 2014[12] Takashi Yamanoue, Michio Nakanishi, Atsushi

Nakamura, Izumi Fuse, Ikuya Murata, ShozoFukada, Takahiro Tagawa, Tatsumi Takeo, ShigetoOkabe, Tsuneo Yamada: Digital Video Clips Cov-ering Computer Ethics in Higher Education, Pro-ceedings of the 33rd annual ACM SIGUCCS con-ference on User services, pp.456-461 2005.

[13] Ustream, http://www.ustream.tv/.[14] Ustream ,

22 1 , pp. 281-296, 2015

[15] GMS 2015http://live.nicovideo.jp/watch/lv222670215

[16] , ,(Web / ),

, 108146 2008 .

[17] Aurelie Cohe and Martin Hachet.: Understand-ing user gestures for manipulating 3d objects fromtouchscreen inputs, Proceedings of Graphics Inter-face 2012, pp. 157–164, 2012.

[18] Bruno De Araujo, Gery Casiez, Joaquim Jorge,and Martin Hachet.: Modeling on and above astereoscopic multitouch display, In 3DCHI-The3rd Dimension of CHI, pp. 79–86, 2012.

[19] Robert Held, Ankit Gupta, Brian Curless, and Ma-neesh Agrawala.: 3d puppetry: a kinect-based in-terface for 3d animation. In UIST, pp. 423–434.Citeseer, 2012.

[20] T. Ushinohama, Y. Sawai, S. Ono, andH. Kawasaki.: Simultaneous entire shape regis-tration of multiple depth images using depth dif-ference and shape silhouette. In Proceedings ofthe 12th Asian Conference on Computer Vision(ACCV’14), 2014.

[21] Vocaloid Promotion Video Project,http://www.geocities.jp/higuchuu4/

[22] The Stanford 3D Scanning Repository,http://graphics.stanford.edu/data/3Dscanrep/

[23] Masayuki Furukawa, Yasuhiro Akagi, YukikoKawai, and Hiroshi Kawasaki. Interactive 3d ani-mation creation and viewing system based on mo-tion graph and pose estimation method. In Pro-ceedings of the ACM International Conference onMultimedia, pp. 1213–1216, 2014.

[24] Genzhi Ye, Yebin Liu, Nils Hasler, Xiangyang Ji,Qionghai Dai, and Christian Theobalt.: Perfor-mance capture of interacting characters with hand-held kinects. In Proceedings of the 12th EuropeanConference on Computer Vision - Volume Part II,ECCV’12, pp. 828–841, 2012.

(2015 6 15 )

2014 3

2014 3

2015 9

20062006 2012

2012 20132014

( )

20132014 2015

( )

200220032010

1987

2015

)

20032008

2009 INRIA

2010( )