• 中国计算机学会会刊
  • 中国科技核心期刊
  • 中文核心期刊

计算机工程与科学

• 教学法与教学组织 • 上一篇    下一篇

基于云服务的AI玩偶的研究及在教育教学中的应用

叶枫1,2,胡程1,黄倩1,陈勇2   

  1. (1.河海大学计算机与信息学院,江苏 南京 211100;2.南京龙渊微电子科技有限公司博士后工作站,江苏 南京 211106)
  • 收稿日期:2018-07-11 修回日期:2018-09-28 出版日期:2018-11-26 发布日期:2018-11-25
  • 基金资助:

    国家自然科学基金(61300122);2017江苏省“六大人才高峰”项目(XYDXX078);2017江苏省博士后科研资助计划(1701020C)

AI avatar based on cloud services
and its educational application

YE Feng1,2,HU Cheng1,HUANG Qian1,CHEN Yong2   

  1. (1.College of Computer and Information,Hohai University,Nanjing 211100;
    2.Postdoctoral Centre,Nanjing Longyuan MicroElectronic Company,Nanjing 211106,China)
     
  • Received:2018-07-11 Revised:2018-09-28 Online:2018-11-26 Published:2018-11-25

摘要:

在人工智能时代,以“会说话的汤姆猫”应用为代表的虚拟化、智能化的玩偶软件愈加得到人们的青睐。从教育的角度,它们能提供儿童陪伴、辅助学习等功能。但是,对于教育领域的研究人员而言,受限于AI技术的复杂性、智能终端的硬件和网络条件,构建功能丰富、用户体验良好的AI玩偶应用较为困难。针对该问题,提出了快速构建一个Android平台AI玩偶应用软件的解决方案,并集成了多个第三方提供的云服务实现了人脸合成3D玩偶、语音转换、语音评测及社交分享等功能。通过性能测试和与相关研究做比较,该AI玩偶应用框架适用于主流的Android终端,具有良好的响应速度和用户体验,能成为辅助教育教学的工具。
 

关键词: 玩偶, 云服务, 人工智能, 教育教学

Abstract:

In AI age, the virtual and intelligent avater software applications represented by Talking Tom increasingly attract more and more attention. From an educational perspective, they can provide company for children, auxiliary learning and other functions. However, constrained by the complexity of related technologies, hardware and networks, it is very difficult for average education researchers to develop AI avatar applications which can offer rich functions and friendly user experience. Aiming at the problem, we propose a solution to developing a framework for AI avatar applications rapidly. It integrates the multiple cloud services from thirdparty providers, and implements virtual 3D avatar with human face synthesis, speech conversion, speech evaluation and social sharing. System testing and comparison with other related works show that the framework is suitable for common Android mobile devices and has the good response speed and friendly user experience, thus it becomes an auxiliary education teaching tool.
 

Key words: avatar, cloud service, AI, education and teaching