The Open Psychology Journal




ISSN: 1874-3501 ― Volume 12, 2019
RESEARCH ARTICLE

Dilemma Between Applying Coherent Principle and Signaling Principles In Interactive Learning Media



Baharuddin1, Sutarto Hadi2, Abdul Hamid3, Ariffin Abdul Mutalib4, Juhriyansyah Dalle5, *
1 Department of Electrical Engineering Education, Universitas Negeri Medan, Medan, Indonesia
2 Department of Mathematics Education, Universitas Lambung Mangkurat, Banjarmasin, Indonesia
3 Department of Civil Engineering Education, Universitas Negeri Medan, Medan, Indonesia
4 School of Multimedia Technology and Communication, Universiti Utara Malaysia, Kedah, Malaysia
5 Department of Information Technology, Universitas Lambung Mangkurat, Banjarmasin, Indonesia

Abstract

Background:

Studies on developing multimedia content for eLearning have widely been conducted. In previous studies, multimedia learning contents were developed without applying any principles, making them less efficient in supporting user’s mental effort. To this end, this study extends the current state by applying the coherence principle and signaling principle to make the multimedia learning content usable and interesting to use. Furthermore, the paper aims at describing the dilemma when applying both principles together.

Materials and Methods:

In this study, a four-phase methodology has been used. First, a prototype has been developed by applying the coherence principle and signaling principle. Following the development, five experts were consulted for identifying flaws in the developed prototype through a walkthrough session.

Results:

Finally, this paper showcases the flaws gathered by the experts for further improvement.

Keywords: Coherence principle, Signaling principle, Interactive learning media, Learning, Multimedia content, Dilemma.


Article Information


Identifiers and Pagination:

Year: 2018
Volume: 11
First Page: 235
Last Page: 248
Publisher Id: TOPSYJ-11-235
DOI: 10.2174/1874350101811010235

Article History:

Received Date: 28/8/2018
Revision Received Date: 18/10/2018
Acceptance Date: 5/11/2018
Electronic publication date: 30/11/2018
Collection year: 2018

Article Metrics:

CrossRef Citations:
0

Total Statistics:

Full-Text HTML Views: 457
Abstract HTML Views: 258
PDF Downloads: 102
ePub Downloads: 82
Total Views/Downloads: 899

Unique Statistics:

Full-Text HTML Views: 280
Abstract HTML Views: 175
PDF Downloads: 76
ePub Downloads: 65
Total Views/Downloads: 596
Geographical View

© 2018 Baharuddin et al.

open-access license: This is an open access article distributed under the terms of the Creative Commons Attribution 4.0 International Public License (CC-BY 4.0), a copy of which is available at: (https://creativecommons.org/licenses/by/4.0/legalcode). This license permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.


* Address correspondence to this author at the Department of Information Technology, Universitas Lambung Mangkurat, Banjarmasin, Indonesia, Tel: +6281312979899; E-mail: j.dalle@ulm.ac.id




1. INTRODUCTION

Teaching and learning activities have now gone beyond the classroom. In a digital environment, the learning ecosystem comprises a learning management system, a learning content management system, and a learning object. The technologies supporting the learning and teaching processes have become so advanced thus enabling anyone to have learning opportunities. As a response to such advantages, various works have been conducted for enriching learning experience. As an example, Aziz et al. [1Aziz N, Mutalib AA, Sarif SM. user experience of interactive assistive courseware for low vision learners (ac4lv): Initial round. TEM J 2017; 6(3): 488-96.[http://dx.doi.org/10.18421/TEM63-09] ] and Dalle et al. [2Dalle J, Hadi S, Baharuddin, Hayati N. The development of interactive multimedia learning pyramid and prism for junior high school using macromedia authorware. The Turkish Online J Educ Techn 2017; 714-21. November] made the multimedia learning content simpler through the simplicity principle for visually-impaired learners in schools. Meanwhile, Dolhalit et al. [3Dolhalit ML, Salam SNA, Mutalib AA, Yusoff MSB. Towards the development of persuasive multimedia model of truancy awareness (PMTA): Review of research. J Eng Appl Sci (Asian Res Publ Netw) 2017; 12(16): 4215-21.[http://dx.doi.org/10.3923/jeasci.2017.4215.4221] ] applied the persuasive principle in their multimedia content that makes society aware of the danger of truancy among school students. While previously, Tosho et al. [4Tosho A, Mutalib AA, Abdul-Salam SN. Conceptual design model of instructional interfaces: Courseware for inclusive education system (IID4C) distance learning. Int J Distance Educ Technol 2016; 14(4): 68-82.[http://dx.doi.org/10.4018/IJDET.2016100106] ] and Elkabani and Zantout [5Elkabani I, Zantout R. A framework for helping the visually impaired learn and practice math. 2015. In: 5th International Conference on Information and Communication Technology and Accessibility; 2015. ICTA 2015[http://dx.doi.org/10.1109/ICTA.2015.7426909] ] coined a model for multimedia learning content for inclusive users. In fact, multimedia has been used also in teaching practical skills [2Dalle J, Hadi S, Baharuddin, Hayati N. The development of interactive multimedia learning pyramid and prism for junior high school using macromedia authorware. The Turkish Online J Educ Techn 2017; 714-21. November, 6Baharuddin, Dalle J. Interactive courseware for supporting learners competency in practical skills. Turkish Online J Educ Tech 2017; 16(3): 87-98.], assisting people in learning practical tasks in extremely-crowded situation [7Al-Aidaroos ASA, Ariffin AA. Personal digital mutawwif: A multi-modal mobile hajj assistance using the location based services. Jurnal Teknologi 2015; 77(29): 15-20.[http://dx.doi.org/10.11113/jt.v77.6805] ] and teaching culture [8Walsh T, Petrie H, Odutola O. Developing interactive systems for different cultures: Issues of assessing user experience with visual materials. Proceedings of the 26th Australian Computer-Human Interaction Conference 2014; 470-9.[http://dx.doi.org/10.1145/2686612.2686687] ]. While they evolve from different forms, the society forgets that such technologies actually prepare them for facing the learning paradigm in the fourth Industrial Revolution (IR4.0) [9Li G, Hou Y, Wu A. Fourth industrial revolution: Technological drivers, impacts and coping methods. Chin Geogr Sci 2017; 24(7): 626-37.[http://dx.doi.org/10.1007/s11769-017-0890-x] , 10Baygin M, Yetis H, Karakose M, Akin E. An effect analysis of industry 40 to higher education Conference Information Technology Based Higher Education and Training (ITHET) 2016; 1-4. [DOI: 10.1109/ITHET.2016.7760744]]. In general, the IR4.0 requires designers to be highly creative in providing solutions [11Carter D. Creativity in action–the information professional is poised to exploit the fourth industrial revolution: The business information survey 2017. Bus Inf Rev 2017; 34(3): 122-37.[http://dx.doi.org/10.1177/0266382117722440] , 12Ward J. Are you ready for the fourth industrial revolution? Aust Min 2017; 108(11): 36-7. [DOI: 10.15265/IY-2016-052].].

In IR4.0, the learning and teaching processes have been largely improved by the multimedia technology [13Munadi Y. Learning media: A new approach 2013.]. Besides the fact that learning activities are diversified (as described in the studies in the previous paragraph), the learning contents are also made easily understandable and more attractive through the use of multimedia technology [14Mayer RE. Using multimedia for e-learning. J Comput Assist Learn 2017; 33(5): 403-23.[http://dx.doi.org/10.1111/jcal.12197] , 15Aziz N, Mutalib AA, Sarif SM. The design principles of assistive courseware for low vision (AC4LV) learners. J Eng Appl Sci (Asian Res Publ Netw) 2015; 10(3): 1447-56.]. As an instance, an extremely fast-moving object is presented in a slow representation. It has also been seen that abstract concepts (such as photosynthesis and respiration) can be represented in a concrete form. Furthermore, it can support educators in case of dangerous or rare phenomena that are difficult to be presented in class. In fact, Mayer [14Mayer RE. Using multimedia for e-learning. J Comput Assist Learn 2017; 33(5): 403-23.[http://dx.doi.org/10.1111/jcal.12197] ] goes beyond that in which he expressed that multimedia technology supports various tasks for enabling learning takes place in a virtual environment.

Multimedia contents or interactive learning media must be tailored for intended users. Moreover, its context of use must be carefully considered. Without a proper design and development procedure, it will not successfully achieve its goals in its desired context. In this regard, Cooper et al. [16Cooper A, Reimann R, Cronin D, Noessel C. About Face: The essentials of interaction design 2014.] expressed that designers have to focus on the learning experience. When there are too many difficulties in utilizing the learning materials, users tend to get frustrated [17Preece J, Sharp H, Rogers Y. Interaction design: Beyond human-computer interaction 4th ed. 4th ed.2015.] and such experience could disengage users with the learning content and learning activities.

In Indonesia, the government invests hugely in the education sector [18 Educational Science Development Team FIP-UPI. Science and Application Education Part 1. Bandung: Imtima; 2007.]. However, the teaching and learning technologies, including multimedia learning content, have to be wisely designed so that they do not go against human rights [19Tilaar HAR. Improve national education 2009., 20Usman MU, Setiawati L. Efforts to optimalize teaching and learning activities 1993.]. Aspired to be at par with teachers in developed countries, the government also concerns with teachers’ ability. Hence, it has been underlined in the main thrusts of the national agenda, which implies that each education level must possess a high quality of teaching and learning practice. This requires the co-operation of all teachers, especially regarding their teaching duties [20Usman MU, Setiawati L. Efforts to optimalize teaching and learning activities 1993., 21Arsyad A. Learning Media 2010.] because learners have different types of intelligence [22Gardner H. Frames of mind 1993., 23Gardner H. Multiple intelligences: The theory in practice 1993.]. Considering Multiple Intelligence, one of the intelligences is, for example, visual intelligence, which argues that there are people who learn best through visual representations. In response to that, this study believes that multimedia learning will benefit students in their learning process [24Tomita K. Visual design tips to develop an inviting poster for poster presentation. TechTrends 2017; 61(4): 313-5.[http://dx.doi.org/10.1007/s11528-017-0197-x] ]. It is especially applicable to topics that contain processes and step-by-step procedures, including learning mathematics.

Works on making learning mathematics interesting through multimedia contents have been widely conducted. In their recent study, Parera et al. [25Parera H, Hewagamage KP, Weerasinghe TA. Game-based learning as a supplementary approach in teaching mathematics. Proceedings of the 17th Int. Conf. On Advances in ICT for Emerging Regions 2017.[http://dx.doi.org/10.1109/ICTER.2017.8257799] ] and attracted learners through digital creative games, as opposed to earlier approaches as of Chorianopoulos et al. [26Chorianopoulos K, Giannakos MN, Chrisochoides N. Design principles for serious games in mathematics. Proceedings of the 18th Panhellenic Conference on Informatics 2014: 1-5.[http://dx.doi.org/10.1145/2645791.2645843] ], that used serious games. Even though both studies use games, their connotation is different. Nevertheless, both have shown a positive impact towards learning mathematics. Meanwhile, Chao-Fernández et al. [27Chao-Fernández R, Román-García S, Chao-Fernández A. Art, science and magic: Music and math the classroom. Proceedings of the 5th International Conference on Technological Ecosystems for Enhancing Multiculturality 2017.[http://dx.doi.org/10.1145/3144826.3145427] ] utilized music in making learning mathematics interesting.

The multimedia learning content has been used in supporting not only the needs of normal learners but also learners with special needs. This is shown in recent works of Ávila-Soto et al. [28Ávila-Soto M, Valderrama-Bahamóndez E, Schmidt A. Tan Math: A tangible math application to support children with visual impairment to learn basic arithmetic. Proceedings of the 10th International Conference on Pervasive Technologies Related to Assistive Environments 2017: 244-45.[http://dx.doi.org/10.1145/3056540.3064964] ] and Maćkowski et al. [29Maćkowski M, Brzoza P, Żabka M, Spinczyk D. Multimedia platform for mathematics’ interactive learning accessible to blind people. Multimedia Tools Appl 2018; 77(5): 6191-208. [https://doi.org/10.1007/s11042-017-4526-z].[http://dx.doi.org/10.1007/s11042-017-4526-z] ]. Meanwhile, Ahmad and Mutalib [30Ahmad SZ, Mutalib AA. Integrating learning techniques into iCAL4LA-Bijak matematik courseware to motivate low achieving children in learning. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 2017. [http://dx.doi.org/10.1007/978-3-319-70010-6_40] ] designed a courseware for low-achieving learners. However, in the above-mentioned studies, authors have not reported the application of certain multimedia design principles. As it is shown in this study, without applying multimedia principles, the learning users do not experience the learning contents as they desire. Furthermore, they become cognitively tired and exhausted because they are dealing with audio and visual elements. When their cognitive is inappropriately loaded, their attention is disrupted, which negatively affects their learning process. The present study presumes that when multimedia design principles are applied, the courseware would better assist the learners.

Regarding multimedia learning content for learning mathematics, Sweller et al. [31Sweller J, Ayres P, Kalyuga S. Explorations in the learning sciences, instructional systems and performance technologies 2011. [DOI: 10.1007/978-1-4419-8126-4_7]] considered that reduced cognitive and minimized load is potentials for promoting user’s engagement in using multimedia content. One of the famous ways to ensure this fact is to apply certain principles in the multimedia learning system design [32Clark RC, Mayer RE. E-learning and the science of instruction: Proven guidelines for consumers and designers of multimedia learning 2016.[http://dx.doi.org/10.1002/9781119239086] ]. In response to that, this study applies in the design process two of the multimedia learning principles [33Butcher KR. The multimedia principle In the cambridge handbook of multimedia learning 2nd ed. 2nd ed.2014.], which are recommended by Mayer and Fiorella [34Mayer RE, Fiorella L. Principles for reducing extraneous processing in multimedia learning: Coherence, signaling, redundancy, spatial contiguity, and temporal contiguity principles.The Cambridge handbook of multimedia learning 2014.[http://dx.doi.org/10.1017/CBO9781139547369.015] ] and Mayer et al. [35Mayer RE, Heiser H, Lonn S. Cognitive constraints on multimedia learning: When presenting more material results in less understanding. J Educ Psychol 2001; 93: 187-98. [DOI: 10.1037//0022-0663.93.1.187].[http://dx.doi.org/10.1037/0022-0663.93.1.187] ], namely the signaling principle and the coherent principle. In general, the coherent principle recommends that multimedia learning content should rather be simple, not complex. In contrast, the signaling principle recommends that important parts of the multimedia learning contents should be highlighted or supported with certain instructional technique [36Majumdar A. design principle of using multimedia in elearning Retrieved from 2016. 22 March 2018https:// elearningindustry.com/ 10-design -principles- using-multimedia- in-elearning.]. This study involves a scientific and systematic process [37Mayer RE. Multimedia learning 2nd ed. 2nd ed.2009.[http://dx.doi.org/10.1017/CBO9780511811678] , 38Mayer RE. Instruction based on visualizations.Handbook of Research on Learning and Instruction 2011.] for designing and developing the multimedia learning content while considering an expert review upon the developed multimedia learning in accordance.

All the above-mentioned discussions highlight the importance of multimedia use in supporting the learning process. However, ensuring users’ satisfaction when using the multimedia learning system is another issue. Accordingly, this study attempts to design a multimedia learning system related to mathematics content to be used in secondary schools in Indonesia. For the purpose of this study, the content has been decided by the school teachers. Based on their experience in teaching mathematics for more than 8 years, the fraction topic is appropriate because it is not too difficult and has the potential to be understood by all learners.

This section states the aim of this study and discusses the background, including the problem that this study solves. A detailed explanation of the research procedure is enclosed in the next section, which is followed by the results and findings. Finally, this paper ends with a conclusive discussion regarding the way this study impacts the context of the study.

2. METHODOLOGY

To achieve the proposed aim, this study involves a set of activities, which cover three stages, as shown in Fig. (1) (Interactive Triangulation Methodology), namely requirement analysis, development, and evaluation. Every stage requires iterations of processes, which demand triangulations for the data source and methods.

Fig. (1)
Iterative triangulation methodology.


  • Data source triangulation: This study gathers data from different timings, locations, and people. This increases the possibility of revealing typical data or the potential of identifying similar patterns, thus increasing confidence of the findings.
  • Methodology triangulation: This could also be called mix method or multi-method and can be considered in both data collection methods and research methods. The use of different methods provides richer information to the study.

Furthermore, Fig. (2) visualizes the steps conducted throughout the research work mapped with the study deliverables.

Referring to Fig. (2), it is observed that the requirements were gathered through interviews and observations. Basically, based on the problem, this study observed the teaching and the learning process within class hours for five different schools. It was found that teachers use conventional means and the pupils (learners) do not engage in the process. The mediums relate only to chalk-and-board and books, for which learners show no excitement. After a few observation sessions, the teachers were interviewed as for the purpose of the study. The interviews were held in the corresponding five schools and two to three teachers were involved in each school. The purpose of interviewing the teachers was to gather their opinion on the use of visual representation (multimedia learning application) for their teaching and learning process, as a complementary medium to books. Additionally, it was aimed to gather inputs if they agree with the idea of utilizing multimedia learning application for learning mathematics.

Fig. (2)
Research procedure.


The teachers uncontestably accepted the idea of utilizing multimedia learning content for their teaching and learning purpose. In further discussions, the teachers agreed to select the fraction topic as a starting point. The topic was selected as it is not very difficult, it is famous and provides the potential for all learners to understand the concept. Given this fact, it is likewise a good strategy to familiarize them with the multimedia learning content considering other topics later on. Starting with a favorite topic could ensure learners’ interest towards the multimedia learning content and further support their knowledge.

After the teachers were interviewed, this study interviewed a group of learners within each school to gather their requests related to the way they expect the multimedia learning content to support them in their learning. The interviews were also held in the schools where they study and between 13 and 17 learners from each school took part in this study. Although some learners were not sure about the format of the learning content, the majority expressed their preference for a courseware, no matter if it is online or offline. They had no idea on how the multimedia learning system should look or act, but only that it must be user-friendly. This implies that the learning content has to be in Bahasa Indonesia.

Fig. (3)
Sample of the storyboard.


The results of the observations and interviews set the requirements for the multimedia learning content. It is clear that users need an interactive multimedia for content learning that provides information on the fraction topic. They want to access the learning content from any location and at any given time. While the focus is to make the multimedia learning content usable for the users, the fraction content for this study was taken from the standard textbooks used in schools. Particularly, multimedia learning content should minimize users’ cognitive load by minimizing assessments.

Based on the requirements gathered in Phase 1, this study designed the visual interface and the ambience of the multimedia learning content in Phase 2. Storyboard (the sample is available in Fig. (3) was used to locate ideas into concrete representations. It was necessary to ensure that quick responses could be gathered from users: teachers and students.

The alternative designs of storyboards were presented to users in a cyclical process, for them to give their comments and feedback on the designs. Providing alternative designs is necessary for the users to have opportunities to compare and express their responses as a reference to the designs, rather than having to think without any point of reference. The sample in Fig. (3) represents the finalized design.

When the design was selected, a working prototype was developed. Macromedia Flash 8 was used for developing the multimedia learning content. It is appropriate because the learning content contains hybrid interactivity and navigation style. Fig. (4) through Fig. (8) depict the snapshots of the multimedia learning content.

Fig. (4) shows the main menu of the multimedia learning content. A cloud representation is used for buttons. The cloud signals that they are clickable items. The title of the learning content is placed at the right-top corner of the interface.

Fig. (4)
Main menu.


Similar cloud representation is used for selecting the topics, as shown in Fig. (5). The figure exhibits different line weights for the clouds contour, wherein a thicker contour represents a parent topic, while a thinner contour shows sub-topic.

Fig. (5)
Selection of topics.


Fig. (6)
Notes.


When notes are included, they are separated into different representations. Main notes are presented without a frame, while additional notes are located within frames, as shown in Fig. (6). This strategy highlights to learners the parts to focus more and where to focus less. Additionally, an avatar explains the notes using audio, with various intonations to highlight important points for the learners.

Fig. (7)
Instructions.


When instructions are provided, they are represented in numbered lists, as indicated in Fig. (7). The use of numbered lists enables learners to systematically organize their learning process in a step-by-step order of actions to be performed. Fig. (7) exhibits a page for learners to perform exercises. From this page, the learners are supposed to select an appropriate level of questions to answer. From the figure, it is seen that the buttons clearly state the level of taxonomy for the questions. If learners click the “Uji Kompetensi 1” button, they will be provided with questions of knowledge level only. Meanwhile, the “Uji Kompetensi 2” button provides learners with questions of comprehension level. A similar procedure is considered for the other buttons. This strategy informs the learners about the level of questions they are expected to answer.

Fig. (8)
Exercises.


When users click any button, a page appears, as shown in Fig. (8). It is seen that the questions and answer options are presented in a scrollable window, with a panel of responses at the bottom. The panel is consistently visible. This strategy is significant to notify the learners on their attempts.

Then, the prototype was reviewed by experts by means of a walkthrough process. The expert walkthrough process aims at determining whether users could easily carry out their tasks. For this study, experts’ comments regarding the walkthrough are important, as indicators whether the learning content could reach learners before being implemented in actual teaching and learning activities. For such purpose, Blackmon et al. [39Blackmon MH, Polson PG, Kitajima M, Lewis C. Cognitive walkthrough for the web. Proc of Conference on Human Factors in Computing Systems 2002 2002; 463-70. CHI 2002[http://dx.doi.org/10.1145/503376.503459] ] employed five experts, and they were able to gather saturated feedbacks. Hence, this study adopts their technique, because we believe employing less than three experts is doubtable in terms of maximum feedback, while employing more than five experts may lead to a waste of resources. All experts involved in this study have experienced consulting projects in the industry. At the same time, they have been researching in human-computer interaction and teaching their respective fields for at least seven years. The walkthrough session was conducted as the procedure visualized in (Fig. 9).

Fig. (9)
The walkthrough procedure.


During the day of the walkthrough session, the experts were briefed about the aim of the walkthrough session. They were cleared that at the end of the walkthrough session, they should assemble usability flaws in the prototype, particularly on flaws regarding unnecessary activities that increase cognitive loads. Then, they conducted specific tasks to walk through the multimedia learning content. The tasks are (1) reading the notes about fraction, (2) understanding the instructions, (3) answering the exercise questions, and (4) analyzing their attempts. It was emphasized to the experts that they should note all findings while individually walking through the session. The expert provided their consent that they were not allowed to discuss during the walkthrough. The session was followed with a debriefing session, wherein the experts gathered together and discussed what they found. After brainstorming and moderating the outcomes, they finally provided the conclusions of this study.

3. RESULTS

The multimedia learning content was developed based on a storyboard designed in a cyclical process, which eventually has been approved by the users. The contents were adopted from the textbook used in schools. When experts walked through the learning content, their concern was focused on whether the prototype supports well the user tasks, through the way it interacts with the users. This refers to unnecessary activities that create cognitive loads, which may lead to negative impacts on user experience.

Having gone through the walkthrough process, the experts found that the multimedia learning content is able to properly deliver the learning contents. However, all experts agree there are some activities in certain parts that may lead to unnecessary user efforts either physically or cognitively. These additional activities are detailed in the following paragraphs.

In the main menu, the real-time date is stated in a cloud (Fig. (10), which could be understood as a button (excise 1). This is because all buttons are represented with a cloud formation, and therefore confuses the users. It is similar to the exit button that should be represented in a special representation to notify its impact (excise 2). Another fact is that the buttons are not organized (excise 3). Users have no order when searching for the desired button to be clicked; hence, they have to visually search the entire interface.

Fig. (10)
Excise in main menu.


The buttons for selecting sub-topics are shown in Fig. (11). It is observed that the buttons for the parent topic and sub-topic are represented identically, except the outlines for the parent topic, which are thicker (excise 4). In such situations, some learners may not give attention to that or some may think that it is merely a mistake. Moreover, all buttons for sub-topics are not organized, similarly as found on the main page (excise 5). The buttons are also not associated with their parents. In this case, learners have to think additionally which sub-topics correspond to which parent. To avoid this additional load, topics have to be linked, for example using lines. Some good examples for that are using breadcrumb (in normal websites) or tab (in excel). Furthermore, the menu contains many topics, and therefore it (excise 6) should propose the order of topics to the learners so that it makes learners aware of the desired order and the corresponding topic family. This perhaps could be done using colors, shape, size, grouping, or other similar representations.

Fig. (11)
Excise in sub-topic.


In the notes page (Fig. 12), the title is represented in a cloud, identical with the buttons (excise 7). This really confuses learners, because they have associated the cloud with buttons in their mind. The title should be the dominant element in the page, with different colors and larger size, free of cloud. In the pages, the text is white (excise 8), which does not bring any emphasis from the learners’ perspective. Hence, learners are not guided by repetition and emphasis. This could be avoided by using color, underline, punctuation, and others.

Fig. (12)
Excise in notes.


Fig. (13)
Excise in instructions.


When instructions are available in the interface, they are represented in a numbered order, as shown in Fig. (13). In general, they are helpful, but the title is similar to buttons (excise 9) and can confuse some learners. At the bottom, there are three buttons intended to enable learners to test their knowledge and understanding about the topics. However, there is no indication related to the order (excise 10); therefore, learners do not know whether there is any order. This may force them to do the exercise in an inappropriate order. Moreover, the instruction lists are plainly white without any emphasis (excise 11). In this situation, learners are not motivated to go through the instructions, as it is desired. To avoid this situation, the use of different color for keywords may help.

In the exercises page (Fig. 14), the use of the windowing approach is excellent, because it can ensure information about user attempts, which is always visible. However, the title looks like a button (excise 12). The questions and options for answers are in white (excise 13), which does not emphasize their meaning. If the options for answers would be in a different color, it may strongly convey its meaning. The level of information within and outside the window is also different. However, in Fig. (14), having similar color and size, they look alike (excise 14). This could be avoided using different size and color.

Fig. (14)
Excise in exercises.


4. DISCUSSION

Involving experts in the design process is crucial for multimedia learning because they can discover flaws that may potentially disrupt the users. As an evidence, the experts in this study discovered 14 additional loading activities through the walkthrough sessions and they believe that there are severe excises regarding coherent and signaling principles that may disrupt learners’ attention while learning using multimedia eLearning platform. Other studies have also involved experts in the development of interactive products such as Karajeh et al. [40Karajeh W, Hamtini T, Hamdi M. Designing and implementing an effective Courseware for the enhancement of e-learning. International Journal of Emerging Technologies in Learning 2016; 11(4): 70-6. [http://dx.doi.org/10.3991/ijet.v11i04.5384].[http://dx.doi.org/10.3991/ijet.v11i04.5384] ], and Mohd and Shahbodin [41Mohd CKNCK, Shahbodin F. Design and development of a multimedia courseware using personalized learning environment approach for nutrition topic. J Eng Appl Sci (Asian Res Publ Netw) 2016; 11(18): 10714-20. [DOI:10.4018/978-1-60566-208-4.ch011].]. They also gathered similar results, wherein expert evaluations discover a number of a flaw in terms of excise in the interactive products.

Besides those 14 severe excises, they also discovered other excises that affect the learners but are not severe. Moreover, excises regarding aspects that are not related to coherent and signaling principles are also discovered (not discussed in this paper).

Although there are excises, the developed multimedia learning content has applied the principles at its best. Obviously, the coherent principle is applied throughout the learning content. By applying the principles, unnecessary remedies are eliminated, which further help learners to focus on the learning content.

Similarly, the signaling principle is applied throughout the learning content. However, the designers are confused between strategies considering the coherent and signaling principles. It is observed that the designer is not confident to use elements for signaling the learners (by applying the signaling principle) to avoid making the display complex (the coherent principle).

Considering experts’ feedback, this is a trade-off. However, in case it impacts more positively, let the use of signaling principle harmonizes the coherent principle. In case it is not necessary, follow the coherent principle [34Mayer RE, Fiorella L. Principles for reducing extraneous processing in multimedia learning: Coherence, signaling, redundancy, spatial contiguity, and temporal contiguity principles.The Cambridge handbook of multimedia learning 2014.[http://dx.doi.org/10.1017/CBO9781139547369.015] , 35Mayer RE, Heiser H, Lonn S. Cognitive constraints on multimedia learning: When presenting more material results in less understanding. J Educ Psychol 2001; 93: 187-98. [DOI: 10.1037//0022-0663.93.1.187].[http://dx.doi.org/10.1037/0022-0663.93.1.187] ]. Such instructional approach is very important in the learning process because it can determine learners’ knowledge [42Straková J, Simonová J, Greger D. Improving mathematics results: Does teachers’ academic optimism matter? A study of lower secondary schools. Sch Eff Sch Improv 2018; 1-18. [https://doi.org/10.1080/09243453.2018.1446449].].

CONCLUSION

Although the design is approved by the users (teachers and learners) through the storyboard, experts still recommend severe excise to be readdressed regarding the coherent and signaling principles. This study agrees to the experts’ recommendations because they are experienced with numerous projects (as recommended by Preece et al. [17Preece J, Sharp H, Rogers Y. Interaction design: Beyond human-computer interaction 4th ed. 4th ed.2015.] and Mayhew [43Mayhew DJ. The usability engineering lifecycle 1999.[http://dx.doi.org/10.1145/632716.632805] ]). Based on their experience in dealing with various users and various context, their recommendations are valid.

This study will take appropriate actions accordingly. All excises will be eliminated through appropriate instructional strategies. This will lead to a new design, which will need another expert evaluation, followed by user acceptance as it has previously been conducted within various works [44Aziz N, Roseli NHM, Mutalib AA. Visually impaired children’s acceptance on assistive courseware. Am J Appl Sci 2011; 8(10): 1019-26. [DOI: 10.5042/jat.2011.0096].[http://dx.doi.org/10.3844/ajassp.2011.1019.1026] , 45Mayer RE, DaPra CS. An embodiment effect in computer-based learning with animated pedagogical agents. J Exp Psychol Appl 2012; 18(3): 239-52. [DOI: 10.1037/a0028616].[http://dx.doi.org/10.1037/a0028616] [PMID: 22642688] ]. In fact, this is likewise strongly emphasized by experts like Nielsen [46Nielsen J. Usability Engineering 1994.], Preece et al. [17Preece J, Sharp H, Rogers Y. Interaction design: Beyond human-computer interaction 4th ed. 4th ed.2015.], and Schneiderman et al. [47Schneiderman B, Plaisant C, Cohen M, Jacobs S, Elmqvist N, Diakopoulos N. Designing the user interface: Strategies for effective human-computer interaction 6th ed. 6th ed.2016.].

ETHICS APPROVAL AND CONSENT TO PARTICIPATE

Not applicable.

HUMAN AND ANIMAL RIGHTS

No Animals/Humans were used for studies that are base of this research.

CONSENT FOR PUBLICATION

Not applicable.

CONFLICT OF INTEREST

The authors declare no conflict of interest, financial or otherwise.

ACKNOWLEDGEMENTS

This article is extracted from individual research that uses the specially designed multimedia learning tool. On this occasion, the authors expresses their highest appreciation to M. Ali Hasmi who has designed the interface of multimedia learning and also to the rector of Universitas Lambung Mangkurat, Universitas Negeri Medan, and Universiti Utara Malaysia, which provided a wide discussion room to improve the quality of this article.

REFERENCES

[1] Aziz N, Mutalib AA, Sarif SM. user experience of interactive assistive courseware for low vision learners (ac4lv): Initial round. TEM J 2017; 6(3): 488-96.[http://dx.doi.org/10.18421/TEM63-09]
[2] Dalle J, Hadi S, Baharuddin, Hayati N. The development of interactive multimedia learning pyramid and prism for junior high school using macromedia authorware. The Turkish Online J Educ Techn 2017; 714-21. November
[3] Dolhalit ML, Salam SNA, Mutalib AA, Yusoff MSB. Towards the development of persuasive multimedia model of truancy awareness (PMTA): Review of research. J Eng Appl Sci (Asian Res Publ Netw) 2017; 12(16): 4215-21.[http://dx.doi.org/10.3923/jeasci.2017.4215.4221]
[4] Tosho A, Mutalib AA, Abdul-Salam SN. Conceptual design model of instructional interfaces: Courseware for inclusive education system (IID4C) distance learning. Int J Distance Educ Technol 2016; 14(4): 68-82.[http://dx.doi.org/10.4018/IJDET.2016100106]
[5] Elkabani I, Zantout R. A framework for helping the visually impaired learn and practice math. 2015. In: 5th International Conference on Information and Communication Technology and Accessibility; 2015. ICTA 2015[http://dx.doi.org/10.1109/ICTA.2015.7426909]
[6] Baharuddin, Dalle J. Interactive courseware for supporting learners competency in practical skills. Turkish Online J Educ Tech 2017; 16(3): 87-98.
[7] Al-Aidaroos ASA, Ariffin AA. Personal digital mutawwif: A multi-modal mobile hajj assistance using the location based services. Jurnal Teknologi 2015; 77(29): 15-20.[http://dx.doi.org/10.11113/jt.v77.6805]
[8] Walsh T, Petrie H, Odutola O. Developing interactive systems for different cultures: Issues of assessing user experience with visual materials. Proceedings of the 26th Australian Computer-Human Interaction Conference 2014; 470-9.[http://dx.doi.org/10.1145/2686612.2686687]
[9] Li G, Hou Y, Wu A. Fourth industrial revolution: Technological drivers, impacts and coping methods. Chin Geogr Sci 2017; 24(7): 626-37.[http://dx.doi.org/10.1007/s11769-017-0890-x]
[10] Baygin M, Yetis H, Karakose M, Akin E. An effect analysis of industry 40 to higher education Conference Information Technology Based Higher Education and Training (ITHET) 2016; 1-4. [DOI: 10.1109/ITHET.2016.7760744]
[11] Carter D. Creativity in action–the information professional is poised to exploit the fourth industrial revolution: The business information survey 2017. Bus Inf Rev 2017; 34(3): 122-37.[http://dx.doi.org/10.1177/0266382117722440]
[12] Ward J. Are you ready for the fourth industrial revolution? Aust Min 2017; 108(11): 36-7. [DOI: 10.15265/IY-2016-052].
[13] Munadi Y. Learning media: A new approach 2013.
[14] Mayer RE. Using multimedia for e-learning. J Comput Assist Learn 2017; 33(5): 403-23.[http://dx.doi.org/10.1111/jcal.12197]
[15] Aziz N, Mutalib AA, Sarif SM. The design principles of assistive courseware for low vision (AC4LV) learners. J Eng Appl Sci (Asian Res Publ Netw) 2015; 10(3): 1447-56.
[16] Cooper A, Reimann R, Cronin D, Noessel C. About Face: The essentials of interaction design 2014.
[17] Preece J, Sharp H, Rogers Y. Interaction design: Beyond human-computer interaction 4th ed. 4th ed.2015.
[18] Educational Science Development Team FIP-UPI. Science and Application Education Part 1. Bandung: Imtima; 2007.
[19] Tilaar HAR. Improve national education 2009.
[20] Usman MU, Setiawati L. Efforts to optimalize teaching and learning activities 1993.
[21] Arsyad A. Learning Media 2010.
[22] Gardner H. Frames of mind 1993.
[23] Gardner H. Multiple intelligences: The theory in practice 1993.
[24] Tomita K. Visual design tips to develop an inviting poster for poster presentation. TechTrends 2017; 61(4): 313-5.[http://dx.doi.org/10.1007/s11528-017-0197-x]
[25] Parera H, Hewagamage KP, Weerasinghe TA. Game-based learning as a supplementary approach in teaching mathematics. Proceedings of the 17th Int. Conf. On Advances in ICT for Emerging Regions 2017.[http://dx.doi.org/10.1109/ICTER.2017.8257799]
[26] Chorianopoulos K, Giannakos MN, Chrisochoides N. Design principles for serious games in mathematics. Proceedings of the 18th Panhellenic Conference on Informatics 2014: 1-5.[http://dx.doi.org/10.1145/2645791.2645843]
[27] Chao-Fernández R, Román-García S, Chao-Fernández A. Art, science and magic: Music and math the classroom. Proceedings of the 5th International Conference on Technological Ecosystems for Enhancing Multiculturality 2017.[http://dx.doi.org/10.1145/3144826.3145427]
[28] Ávila-Soto M, Valderrama-Bahamóndez E, Schmidt A. Tan Math: A tangible math application to support children with visual impairment to learn basic arithmetic. Proceedings of the 10th International Conference on Pervasive Technologies Related to Assistive Environments 2017: 244-45.[http://dx.doi.org/10.1145/3056540.3064964]
[29] Maćkowski M, Brzoza P, Żabka M, Spinczyk D. Multimedia platform for mathematics’ interactive learning accessible to blind people. Multimedia Tools Appl 2018; 77(5): 6191-208. [https://doi.org/10.1007/s11042-017-4526-z].[http://dx.doi.org/10.1007/s11042-017-4526-z]
[30] Ahmad SZ, Mutalib AA. Integrating learning techniques into iCAL4LA-Bijak matematik courseware to motivate low achieving children in learning. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 2017. [http://dx.doi.org/10.1007/978-3-319-70010-6_40]
[31] Sweller J, Ayres P, Kalyuga S. Explorations in the learning sciences, instructional systems and performance technologies 2011. [DOI: 10.1007/978-1-4419-8126-4_7]
[32] Clark RC, Mayer RE. E-learning and the science of instruction: Proven guidelines for consumers and designers of multimedia learning 2016.[http://dx.doi.org/10.1002/9781119239086]
[33] Butcher KR. The multimedia principle In the cambridge handbook of multimedia learning 2nd ed. 2nd ed.2014.
[34] Mayer RE, Fiorella L. Principles for reducing extraneous processing in multimedia learning: Coherence, signaling, redundancy, spatial contiguity, and temporal contiguity principles.The Cambridge handbook of multimedia learning 2014.[http://dx.doi.org/10.1017/CBO9781139547369.015]
[35] Mayer RE, Heiser H, Lonn S. Cognitive constraints on multimedia learning: When presenting more material results in less understanding. J Educ Psychol 2001; 93: 187-98. [DOI: 10.1037//0022-0663.93.1.187].[http://dx.doi.org/10.1037/0022-0663.93.1.187]
[36] Majumdar A. design principle of using multimedia in elearning Retrieved from 2016. 22 March 2018https:// elearningindustry.com/ 10-design -principles- using-multimedia- in-elearning.
[37] Mayer RE. Multimedia learning 2nd ed. 2nd ed.2009.[http://dx.doi.org/10.1017/CBO9780511811678]
[38] Mayer RE. Instruction based on visualizations.Handbook of Research on Learning and Instruction 2011.
[39] Blackmon MH, Polson PG, Kitajima M, Lewis C. Cognitive walkthrough for the web. Proc of Conference on Human Factors in Computing Systems 2002 2002; 463-70. CHI 2002[http://dx.doi.org/10.1145/503376.503459]
[40] Karajeh W, Hamtini T, Hamdi M. Designing and implementing an effective Courseware for the enhancement of e-learning. International Journal of Emerging Technologies in Learning 2016; 11(4): 70-6. [http://dx.doi.org/10.3991/ijet.v11i04.5384].[http://dx.doi.org/10.3991/ijet.v11i04.5384]
[41] Mohd CKNCK, Shahbodin F. Design and development of a multimedia courseware using personalized learning environment approach for nutrition topic. J Eng Appl Sci (Asian Res Publ Netw) 2016; 11(18): 10714-20. [DOI:10.4018/978-1-60566-208-4.ch011].
[42] Straková J, Simonová J, Greger D. Improving mathematics results: Does teachers’ academic optimism matter? A study of lower secondary schools. Sch Eff Sch Improv 2018; 1-18. [https://doi.org/10.1080/09243453.2018.1446449].
[43] Mayhew DJ. The usability engineering lifecycle 1999.[http://dx.doi.org/10.1145/632716.632805]
[44] Aziz N, Roseli NHM, Mutalib AA. Visually impaired children’s acceptance on assistive courseware. Am J Appl Sci 2011; 8(10): 1019-26. [DOI: 10.5042/jat.2011.0096].[http://dx.doi.org/10.3844/ajassp.2011.1019.1026]
[45] Mayer RE, DaPra CS. An embodiment effect in computer-based learning with animated pedagogical agents. J Exp Psychol Appl 2012; 18(3): 239-52. [DOI: 10.1037/a0028616].[http://dx.doi.org/10.1037/a0028616] [PMID: 22642688]
[46] Nielsen J. Usability Engineering 1994.
[47] Schneiderman B, Plaisant C, Cohen M, Jacobs S, Elmqvist N, Diakopoulos N. Designing the user interface: Strategies for effective human-computer interaction 6th ed. 6th ed.2016.

Endorsements



"Open access will revolutionize 21st century knowledge work and accelerate the diffusion of ideas and evidence that support just in time learning and the evolution of thinking in a number of disciplines."


Daniel Pesut
(Indiana University School of Nursing, USA)

"It is important that students and researchers from all over the world can have easy access to relevant, high-standard and timely scientific information. This is exactly what Open Access Journals provide and this is the reason why I support this endeavor."


Jacques Descotes
(Centre Antipoison-Centre de Pharmacovigilance, France)

"Publishing research articles is the key for future scientific progress. Open Access publishing is therefore of utmost importance for wider dissemination of information, and will help serving the best interest of the scientific community."


Patrice Talaga
(UCB S.A., Belgium)

"Open access journals are a novel concept in the medical literature. They offer accessible information to a wide variety of individuals, including physicians, medical students, clinical investigators, and the general public. They are an outstanding source of medical and scientific information."


Jeffrey M. Weinberg
(St. Luke's-Roosevelt Hospital Center, USA)

"Open access journals are extremely useful for graduate students, investigators and all other interested persons to read important scientific articles and subscribe scientific journals. Indeed, the research articles span a wide range of area and of high quality. This is specially a must for researchers belonging to institutions with limited library facility and funding to subscribe scientific journals."


Debomoy K. Lahiri
(Indiana University School of Medicine, USA)

"Open access journals represent a major break-through in publishing. They provide easy access to the latest research on a wide variety of issues. Relevant and timely articles are made available in a fraction of the time taken by more conventional publishers. Articles are of uniformly high quality and written by the world's leading authorities."


Robert Looney
(Naval Postgraduate School, USA)

"Open access journals have transformed the way scientific data is published and disseminated: particularly, whilst ensuring a high quality standard and transparency in the editorial process, they have increased the access to the scientific literature by those researchers that have limited library support or that are working on small budgets."


Richard Reithinger
(Westat, USA)

"Not only do open access journals greatly improve the access to high quality information for scientists in the developing world, it also provides extra exposure for our papers."


J. Ferwerda
(University of Oxford, UK)

"Open Access 'Chemistry' Journals allow the dissemination of knowledge at your finger tips without paying for the scientific content."


Sean L. Kitson
(Almac Sciences, Northern Ireland)

"In principle, all scientific journals should have open access, as should be science itself. Open access journals are very helpful for students, researchers and the general public including people from institutions which do not have library or cannot afford to subscribe scientific journals. The articles are high standard and cover a wide area."


Hubert Wolterbeek
(Delft University of Technology, The Netherlands)

"The widest possible diffusion of information is critical for the advancement of science. In this perspective, open access journals are instrumental in fostering researches and achievements."


Alessandro Laviano
(Sapienza - University of Rome, Italy)

"Open access journals are very useful for all scientists as they can have quick information in the different fields of science."


Philippe Hernigou
(Paris University, France)

"There are many scientists who can not afford the rather expensive subscriptions to scientific journals. Open access journals offer a good alternative for free access to good quality scientific information."


Fidel Toldrá
(Instituto de Agroquimica y Tecnologia de Alimentos, Spain)

"Open access journals have become a fundamental tool for students, researchers, patients and the general public. Many people from institutions which do not have library or cannot afford to subscribe scientific journals benefit of them on a daily basis. The articles are among the best and cover most scientific areas."


M. Bendandi
(University Clinic of Navarre, Spain)

"These journals provide researchers with a platform for rapid, open access scientific communication. The articles are of high quality and broad scope."


Peter Chiba
(University of Vienna, Austria)

"Open access journals are probably one of the most important contributions to promote and diffuse science worldwide."


Jaime Sampaio
(University of Trás-os-Montes e Alto Douro, Portugal)

"Open access journals make up a new and rather revolutionary way to scientific publication. This option opens several quite interesting possibilities to disseminate openly and freely new knowledge and even to facilitate interpersonal communication among scientists."


Eduardo A. Castro
(INIFTA, Argentina)

"Open access journals are freely available online throughout the world, for you to read, download, copy, distribute, and use. The articles published in the open access journals are high quality and cover a wide range of fields."


Kenji Hashimoto
(Chiba University, Japan)

"Open Access journals offer an innovative and efficient way of publication for academics and professionals in a wide range of disciplines. The papers published are of high quality after rigorous peer review and they are Indexed in: major international databases. I read Open Access journals to keep abreast of the recent development in my field of study."


Daniel Shek
(Chinese University of Hong Kong, Hong Kong)

"It is a modern trend for publishers to establish open access journals. Researchers, faculty members, and students will be greatly benefited by the new journals of Bentham Science Publishers Ltd. in this category."


Jih Ru Hwu
(National Central University, Taiwan)


Browse Contents



Webmaster Contact: info@benthamopen.net
Copyright © 2019 Bentham Open