Framework for evaluating and selecting mobile-learning applications using multi criteria decision making techniques

The use of mobile learning (m-learning) applications in education has increased dramatically in recent years. M-learning applications are installed by users through a variety of mobile device distribution platforms. For a wide audience to accept them, these applications must be stable and of high quality. The decision to purchase m-learning applications needs systematic guidelines so that the appropriate one can be selected to provide a viable and effective solution to educational organizations. Usability in m-learning applications has been studied as a non-functional problem in several previous studies. In reality, Saudi tertiary institutions still lack a systematic, efficient, and well-defined framework for evaluating and selecting m-learning applications due to the lack of reliable m-learning application selection methods. Therefore, this study addresses this gap by proposing a framework to support and improve m-learning applications evaluation and selection process named as Mobile-Learning Application Evaluation and Selection Framework (MLA-ESF). MLA-ESF supports evaluation and selection of m-learning applications and integration of functional and non-functional requirements as well as addresses mismatch problems. In addition, the MLA-ESF is developed to assist and guide developers and educational organizations in selecting the required m-learning application in a more systematic and repeatable manner. Moreover, the MLA-ESF framework provides a guideline for future theoretical research, as well as being a practical and usable tool in real contexts. The study is conducted in four main phases: a survey and interview of decision-makers and users to identify the evaluation criteria, development of the framework based on the Evaluation Theory, development of a new decision-making technique by integrating Fuzzy Analytical Hierarchy Process (FAHP), Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS), and GAP Analysis (GA) to handle user requirements mismatches, and validation of the applicability and reliability of MLAESF using experts review, case study and yardstick validation. The study shows that the evaluated aspects of MLA-ESF namely, inputs, actions, outcomes, are feasible and demonstrate their potential and applicability to be applied in the real environment as 75% of the experts found it as useful, 66.7% find it easy to implement, and 75% find the techniques are adequate and sufficient.