面向大规模在线开放课程的编程题多特征综合自动评分方法

刘月霞; 牛志尧; 吴宁

doi:10.7652/xjtuxb201610010

您当前的位置：

首页 >

文章列表页 >

面向大规模在线开放课程的编程题多特征综合自动评分方法

更新时间：2025-07-09

- 面向大规模在线开放课程的编程题多特征综合自动评分方法
- An Automatic Scoring Method of Student Programs Using Multi-Feature Analysis for Massive Open Online Courses
- 西安交通大学学报 2016年50卷第10期页码：64-70
- 作者机构：
  
  西安交通大学电子与信息工程学院,西安,710049
- 作者简介：
- 基金信息：
  
  : 2016-05-19。作者简介: 刘月霞(1991—),女,硕士生;吴宁(通信作者),女,教授。基金项目: 陕西省科技研究发展计划资助项目(2013K06-05)
- DOI：10.7652/xjtuxb201610010
  中图分类号： TP311
- 网络首发：2016-10-10，
  
  纸质出版：2016
- 稿件说明：
移动端阅览
刘月霞, 牛志尧, 吴宁. 面向大规模在线开放课程的编程题多特征综合自动评分方法[J]. 西安交通大学学报, 2016,50(10):64-70.

An Automatic Scoring Method of Student Programs Using Multi-Feature Analysis for Massive Open Online Courses[J]. 2016, 50(10): 64-70.
刘月霞, 牛志尧, 吴宁. 面向大规模在线开放课程的编程题多特征综合自动评分方法[J]. 西安交通大学学报, 2016,50(10):64-70. DOI： 10.7652/xjtuxb201610010.

An Automatic Scoring Method of Student Programs Using Multi-Feature Analysis for Massive Open Online Courses[J]. 2016, 50(10): 64-70. DOI： 10.7652/xjtuxb201610010.

摘要

针对大规模在线开放课程环境下C/C++语言学习者人数众多、自动评阅准确率低的问题

提出一种基于多特征综合分析的编程题自动评分方法。通过对源程序编译预处理剔除提示性信息

用词法分析和抽象语法树(AST)分别抽取学生程序和标准模板程序的多种特征并计算特征相似度

再根据程序编译是否通过

采用不同策略综合分析多种特征相似度进行自动评分。特征相似度包括多项测试用例运行结果的相似度、AST抽取的各项特征的相似度和源程序代码相似度。如果学生程序编译失败

在计算AST特征相似度的同时需进行源程序代码相似度分析。实验结果表明:相对于仅基于测试用例运行结果的动态测试方法和传统静态分析方法

所提方法的平均准确率分别提高了18.48%和14.17%

评价结果与人工评分高度相关且无需借助人工辅助分析。该方法适用于大规模在线开放课程教学。

Abstract

A new automatic scoring method based on multi-feature analysis is proposed to focus the problem that there are a great number of C/C++ programming learners on massive open online courses environment

while the existing automatic scoring techniques possess low accuracy. The prompt information in a submitted program is eliminated with a preprocessing compiler. The lexical analysis and abstract syntax tree(AST)methods are used to extract the features of the submitted program and the standard template one

respectively. Then similarities of these features are calculated. According to whether or not the program is compiled successfully

two different strategies are applied to comprehensively analyze the multi-feature similarities and the program is automatically evaluated finally. The multi-feature similarities include the running result similarity of test cases

the AST feature similarity

and the source code similarity. If the program fails to be compiled

both the source code similarity and the AST features similarity need to be analyzed. Experimental results and comparisons with the dynamic test method and the static analysis method show that the average accuracy of the proposed method increases by 18.38% and 14.17%

respectively. The automatically generated scores are highly correlated with manually determined scores and there is no manual assistant to ensure the accuracy of the scoring results. The proposed method can be applied in massive open online courses.

关键词

Keywords

references

STAUBITZ T, KLEMENT H, RENZ J, et al. Towards practical programming exercises and automated assessment in massive open online courses [C]∥Proceedings of the 2015 IEEE International Conference on Teaching, Assessment, and Learning for Engineering. Piscataway, NJ, USA: IEEE, 2015: 23-30.

ALBER S, DEBIASI L. Automated assessment in massive open online courses [EB/OL].(2013-07-16)[2015-12-12]. http:∥uni-salzburg.at/fileadmin/multimedia/SRC/docs/teaching/SS13/SaI/Paper_Alber_Debiasi.pdf.

PIETERSE V. Automated assessment of programming assignments [C]∥Proceedings of the 3rd Computer Science Education Research Conference on Computer Science Education Research. New York, USA: ACM, 2013: 45-56.

ALA M, KIRSTI M. A survey of automated assessment approaches for programming assignments [J]. Computer Science Education, 2005, 15(2): 83-102.

POZENEL M, FURST L, MAHNICC V. Introduction of the automated assessment of homework assignments in a university-level programming course [C]∥Proceedings of the 2015 38th International Convention on Information and Communication Technology, Electronics and Microelectronics. Piscataway, NJ, USA: IEEE, 2015: 761-766.

RUBIO M, KINNUNEN P, PAREJA C, et al. Student perception and usage of an automated programming assessment tool [J]. Computers in Human Behavior, 2014, 31(2): 453-460.

GUPTA S, DUBEY S K. Automatic assessment of programming assignment [J]. Computer Science Engineering, 2012, 2(1): 67-74.

VUJOSEVIC M, NIKOLIC M, TOSIC D, et al. Software verification and graph similarity for automated evaluation of students' assignments [J]. Information Software Technology, 2013, 55(6): 1004-1016.

马培军, 王甜甜, 苏小红. 基于程序理解的编程题自动评分方法 [J]. 计算机研究与发展, 2009, 46(7): 1136-1142.

MA Peijun, WANG Tiantian, SU Xiaohong. Automatic grading of student programs based on program understanding [J]. Journal of Computer Research and Development, 2009, 46(7): 1136-1142.

王倩, 苏小红, 马培军. 有语法错误的编程题自动评分方法研究: 用局部语法分析和采分点匹配实现 [J]. 计算机工程与应用, 2010, 46(17): 239-242.

WANG Qian, SU Xiaohong, MA Peijun. Automatic grading method for programs with syntax error: via local syntax analysis and key point matching [J]. Computer Engineering and Applications, 2010, 46(17): 239-242.

CUI B, LI J, GUO T, et al. Code comparison system based on abstract syntax tree [C]∥Proceedings of the 2010 3rd IEEE International Conference on Broadband Network and Multimedia Technology. Piscataway, NJ, USA: IEEE, 2010: 668-673.

张宇, 刘雨东, 计钊. 向量相似度测度方法 [J]. 声学技术, 2009, 28(4): 532-536.

ZHANG Yu, LIU Yudong, JI Zhao. Vector similarity measurement method [J]. Technical Acoustics, 2009, 28(4): 532-536.

李扬,潘泉,杨涛.基于短文本情感分析的敏感信息识别.2016,50(9):80-84.[doi:10.7652/xjtuxb201609013]

杨迎辉,李建华,沈迪,等.多重边融合复杂网络动态演化模型.2016,50(9):132-139.[doi:10.7652/xjtuxb201609021]

戴启华,刘勤让,沈剑良,等.采用集簇方法的片上网络动态映射算法.2016,50(8):52-58.[doi:10.7652/xjtuxb201608 009]

魏倩,蔡远利.一种基于神经网络的中制导改进算法.2016,50(7):125-130.[doi:10.7652/xjtuxb201607019]

张小栋,郭晋,李睿,等.表情驱动下脑电信号的建模仿真及分类识别.2016,50(6):1-8.[doi:10.7652/xjtuxb201606001]

姜涛,黄伟,王安麟.多路阀阀芯节流槽拓扑结构组合的神经网络模型.2016,50(6):36-41.[doi:10.7652/xjtuxb201606 006]

宋青松,田正鑫,孙文磊,等.用于孤立数字语音识别的一种组合降维方法.2016,50(6):42-46.[doi:10.7652/xjtuxb 201606007]

陈江城,张小栋.人体下肢行走关节连续运动表面肌电解码方法.2016,50(6):61-67.[doi:10.7652/xjtuxb201606010]

刘兆丽,秦涛,管晓宏,等.采用用户名相似度传播模型的线上用户身份属性关联方法.2016,50(4):1-6.[doi:10.7652/xjtuxb201604001]

浏览量

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

混合电解槽阵列协同的风光耦合制氢系统双层多目标优化

水蒸气掺混对氨裂解气旋流燃烧与排放特性的影响研究

超临界水异常区域热力学特性研究

扇贝仿生密封腔室内超临界二氧化碳泄漏流湍动能耗散机理研究

多工况下离心压气机叶轮-机匣一体联合设计优化