Intelligent Tutoring Systems Authoring Tools For Nonprogrammer Authors: A Systematic Review

Nur Rokhman, Syeh Abidin Kobar


Many studies have been shown that Intelligent Tutoring Systems (ITSs) contribute to a remarkable improvement in the educational outcomes of students. Several authoring tools have been developed to contribute to making ITSs easier to build and widespread. However, there is still a lacks of current understanding in the ITSs community on how authoring tools could support nonprogrammer authors to build ITSs. This study uses a systematic literature review (SLR) method to identify primary empirical studies for nonprogrammers regarding the usage of ITSs authoring tools. The concern of this study is summarizing and analyzing the state of the art of the development of authoring tools. This study identifies the ITSs components and types that can be authored, the technologies used, and also search for proof of the advantages of ITSs authoring tools as well.


authoring tools; intelligent tutoring systems; systematic literature review

Full Text:



Anderson, J. R. (1982). Acquisition of a Cognitive Skill. Psychological Review, 89, 369-406.

Sarrafzadeh, A., Alexander, S., & Dadgostar, F. (2008). "How Do You Know That I Don't Understand?" A Look at The Future of Intelligent Tutoring Systems. Computers in Human Behavior, 24, 1342-1363.

Beal, C. R., Walles, R., Arroyo, I., & Woolf, B. P. (2007). Online Tutoring for Math Achievement Testing: A Controlled Evaluation. Journal of Interactive Online Learning, 6, 1-13.

Corbett A. (2001) Cognitive Computer Tutors: Solving the Two-Sigma Problem. In: Bauer M., Gmytrasiewicz P.J., Vassileva J. (eds) User Modeling 2001. UM 2001. Lecture Notes in Computer Science, vol 2109. Springer, Berlin, Heidelberg.

Graesser, A. C., VanLehn, K., Rose, C., Jordan, P. W., & Harter, D. (2001). Intelligent Tutoring Systems with Conversational Dialogue. AI Magazine, 22, 39.

Koedinger, K. R., & Anderson, J. R. (1997). Intelligent Tutoring Goes to School in The Big City. International Journal of Artificial Intelligence in Education, 8, 1-14.

Mitrovic, A., Martin, B., & Mayo, M. (2002). Using Evaluation to Shape ITSs Design: Results and Experiences with SQL-Tutor. User Modelling and User-Adapted Interaction, 12, 243-279.

Ritter, S., Anderson, J. R., Koedinger, K. R., & Corbett, A. T. (2007). Cognitive Tutor: Applied Research in Mathematics Education. Psychonomic Bulletin & Review, 14(2), 249-255.

Vanlehn, K., Lynch, C., Schulze, K., Shapiro, J.A., Shelby, R., Taylor, L. Treacy, D., Weinstein, A., and Wintersgill, M. (2005). The Andes physics tutoring system: Lessons learned. International Journal of Artificial Intelligence in Education. 15. pp. 147-204.

VanLehn, K. (2011). The Relative Effectiveness of Human Tutoring, Intelligent Tutoring Systems, and Other Tutoring Systems. Educational Psychologist, 46(4), 197-221.

Murray, T. (2005). Having It All, Maybe: Design Tradeoffs in ITSs Authoring Tools. Proceedings of The 3rd International Conference on Intelligent Tutoring Systems, 93-101.

Murray, T. (2003). An Overview of Intelligent Tutoring System Authoring Tools: Updated Analysis of The State of The Art. In Authoring Tools for Advanced Technology Learning Environments (pp. 491-544). Springer.

Woolf, B. P. (2010). Building Intelligent Interactive Tutors: Student-Centered Strategies for Revolutionizing E-learning. Morgan Kaufmann.

Sottilare, R., Graesser, A., Hu, X., & Brawner, K. (2015). Design Recommendations for Intelligent Tutoring Systems: Authoring Tools and Expert Modeling Techniques. US Army Research Laboratory.

Murray, T. (1999). Authoring Intelligent Tutoring Systems: An Analysis of the State of the Art. International Journal of Artificial Intelligence in Education. Vol 10. pp. 98-129.

Murray, T. (1997) Expanding the knowledge acquisition bottleneck for intelligent tutoring systems. International Journal of Artificial Intelligence in Education. Vol. 8 , No. 3-4, pp. 222-232.

Anderson, J. & Skwarecki, E. (1986). The Automated Tutoring of IntroductoryComputer Programming. Communications of the ACM, Vol. 29 No. 9. 842-849

Chen, L., Babar, M. A., & Zhang, H. (2010). Towards an Evidence-Based Understanding of Electronic Data Sources. Proceedings of the 14th International Conference on Evaluation and Assessment in Software Engineering, (British Computer Society, Swinton, UK, EASE’10), 135–138.

Chakraborty, S., Roy, D., Bowmick, P. K., & Basu, A. (2010). An authoring system for developing Intelligent Tutoring Systems. Proceedings of the IEEE Students’ Technology Symposium (TechSym), 196–205.

Suraweera, P., Mitrovic, A., & Martin, B. (2010). Widening the knowledge acquisition bottleneck for constraint-based tutors. International Journal of Artificial Intelligence in Education, 20(2), 137–173.

Chou, C. Y., Huang, B. H., & Lin, C. J. (2011). Complementary machine intelligence and human intelligence in virtual teaching assistant for tutoring program tracing. Computers and Education, 57(4), 2303–2312.

Zatarian-Cabada, R., Barron-Estrada, M., & Reyes Garcia, C. A. (2011). EDUCA: A web 2.0 authoring tool for developing adaptive and intelligent tutoring systems using a Kohonen network. Expert Systems with Applications, 38(8), 9522–9529.

Devasani, S., Gilbert, S., & Blessing, S. (2012). Evaluation of two intelligent tutoring system authoring tool paradigms graphical user interface-based and text-based. Proceedings of the 21st Annual Conference on Behavior Representation in Modeling and Simulation, BRiMS 2012, 51–58.

Abbas, M. A., Ahmad, W., & Kalid, K. S. (2014). Semantic Web Technologies for Preschool Cognitive Skills Tutoring System. Journal of Information Science and Engineering, 30(3), 835–851.

MacLellan, C. J., Koedinger, K. R., & Matsuda, N. (2014). Authoring tutors with Simstudent: An evaluation of efficiency and model quality. International Conference on Intelligent Tutoring Systems, Springer, 551–560.

Blessing, S. B., Devasani, S., Gilbert, S. B., & Sinapov, J. (2015). Using concept grid as an easy authoring technique to check natural language responses. International Journal of Learning Technology, 10(1), 50–70.

Gilbert, S. B., Blessing, S. B., & Guo, E. (2015). Authoring effective embedded tutors: An overview of the extensible problem-specific tutor (xPST) system. International Journal of Artificial Intelligence in Education, 25(3), 428–45.

Lane, H. C., Core, M. G., Hays, M. J., Auerbach, D., & Rosenberg, M. (2015). Situated pedagogical authoring: Authoring intelligent tutors from a student’s perspective. International Conference Artificial Intelligence in Education, Springer International Publishing, 195–204.

Matsuda, N., Cohen, W. W., & Koedinger, K. R. (2015). Teaching the teacher: tutoring Simstudent leads to more effective cognitive tutor authoring. International Journal of Artificial Intelligence in Education, 25(1), 1–34.

Aleven, V., McLaren, B. M., Sewall, J., van Velsen, M., Popescu, O., Demi, S., Ringenberg, M., & Koedinger, K. R. (2016). Example-Tracing Tutors: Intelligent Tutor Development for Non-Programmers. International Journal of Artificial Intelligence in Education, 26(1), 224–269.

MacLellan, C. J., & Koedinger, K. R. (2020). Domain-General Tutor Authoring with Apprentice Learner Models. International Journal of Artificial Intelligence in Education.

Weitekamp, D., Harpstead, E., & Koedinger, K. R. (2020). An Interaction Design for Machine Teaching to Develop AI Tutors. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 1-11.



  • There are currently no refbacks.

SISFORMA: Journal of Information Systems | p-ISSN: 2355-8253 | e-ISSN: 2442-7888 | View My Stats

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.