Automatic Conceptual Feedback on Software Tests

Abstract

Students in introductory programming courses face many challenges. While the educators try their best to assist students with these challenges by adopting different approaches, majority of them end up overlooking the significance of software testing activities. However, these activities are crucial for any developer. This paper proposes and then develops a tool, Testing Tutor, developed by us to help improve student’s testing skills by providing them with conceptual feedback on their tests. We believe that such an approach will help students understand basic testing concepts and understand the reasons for their mistakes instead of offering them the option to simply tweak the source/test code at the erroneous location pointed out by test runner or coverage tool. This paper details the process of designing and building a prototype for such a tool and lessons learnt.