Design, Implementation and Evaluation of Mobile Learning Resources
- 1. Design, Implementation and Evaluation of Mobile Learning ResourcesVíctor Robledo-Rella, Luis Neri, VioletaChirino, Julieta Noguez and Gerardo AguilarTecnológicode Monterrey, Campus Ciudad de Méxicovrobledo@itesm.mx; neri@itesm.mx; vchirino@itesm.mx; jnoguez@itesm.mx; gerardo.aguilar@itesm.mx
- 2. Abstract The Tecnológico de Monterrey, Campus Ciudad de México (CCM) launched in 2008 its Mobile Learning (ML) model which involves a massive widespread and systematic use of ML resources among high school and undergraduate students. Each new first semester student was given cell phone with 24/7 data access.
- 3. Mobile resources were designed and catalogued for specific courses according to the curricula by a group of professors and instructional designers.
- 4. In order to measure its effectiveness, we describe here the methodology followed to design, implement and evaluate a ML resource for Physics I courses.Abstract We designed and applied an Pre-Test / Pos-Test assessment tool for a total sample of N = 222 students enrolled in two consecutive semesters.
- 5. We found that the integrated relative gain for the focus group, which used ML (Nf = 113) is about 30% larger than that for the control group, which did not used ML (Nc = 109).
- 6. A student survey (N = 95) show that students consider that their experience using ML resources was good, and that the use of ML resources helped them to improve the comprehension of course content.
- 7. These results encourage and support the use of ML resources for educational purposes.Introduction Mobile devices are here to stay, and we barely grasp the extend to which they are changing the way we live and communicate.
- 8. The Tecnológico de Monterrey is a world leading private institution regarding the use of innovation and technology for educational purposes.
- 9. This work belongs to a wider project been carried out by the eLearning Research Group of the CCM regarding the impact that ML resources have on the teaching and learning process. Further results are reported by Aguilar et al. 2010.
- 10. The contribution of this work is to present and discuss the main elements behind the design and implementation of a ML resource, anchored to an evaluation instrument to measure its pedagogical effectiveness.Design of a ML resourceEducational resources were produced having in mind the following considerations:Its content is aimed to achieve a given course learning objective.It meet basic quality criteria regarding graphics and sound deployment through standard mobile devises.It includes variation of stimuli to engage the learner and promote meaningful learning.A Mobile Learning Knowledge Management System was (SICAM) developed at the CCM to storage and classify ML resources’ metadata, so to evolve them towards Learning Objects.Design of a ML resourceWe re-designed a ML resource for the Physics I course for the Dynamics of a Particle module, entitled “Free Body Diagram (FBD) and Newtons’s 2nd law”, being these central concepts for the course.
- 11. We designed a 5 min video, and it was uploaded into a WAP portal hosting all ML resources produced by CCM faculty and Virtual University staff.
- 12. The video explains how to build a FBD step by step, how to decompose forces into their Cartesian components and how to write down Newton’s 2nd law to study the dynamic evolution of a system. At the end, the video pose a challenge to the student about what as been explained.Design of a ML resourceThe aesthetic and graphic design of the ML resource was carried out by CCM Virtual University staff (length and time management, clarity of presented elements, sound and meaningful content, adequate audio and video elements,…)
- 13. ML resource is self-contained (framing, development and closure-evaluation)
- 14. See WAP portal and video .Evaluation processWe developed a Pre-Test / Pos-Test assessment tool consisting of a short written quizzes (~ 15 min) that were answered during class hours. Their aim is to asses the degree to which the ML resource fulfills its course learning objectives. Both Pre-Test and Post-Test were basically the same.
- 15. We applied the Pre-Test to a total sample of N = 222 students (6 Physics courses and 2 Math courses; with similar ML resources for the Math course – see Aguilar et al. 2010) during the Fall 2009 and Spring 2010 terms.Evaluation processThe Pre-Test was applied to all students before using the ML resource. We then split randomly the sample so that half the students were asked to study the ML video for about a week using their mobile devices. This defines the control group (Nc = 113).
- 16. The remaining students did not used the mobile device, which constitutes the control group (Nc = 109).
- 17. Finally, the Post-Test was applied to the whole sample.Results and conclusionsFor each group we defined and integrated relative gain (Hake 1988):Where <Pos> and <Pre> are the average Pos-Test and Pre-Test grades for a given group, respectively. Our results are summarized in Table 1 and Figure 1.Table 1. Average Pre-Test, Pos-test and integrated relative gains.
- 19. Figure 2. Survey results (N = 95)
- 20. Results and conclusionsAlthough the total sample is still small and the uncertainties are relatively large, we found that there is a higher integrated relative gain for the focus group as compared to that for the control group:<G>control = 0.29, while <G>focus = 0.47.The difference between Math and Physics results is considerable and is due to differences in the Math Pre-Test/ Pos-Test and ML resource itself.
- 21. A student survey for the Physics courses (N = 95)showed students consider that their experience using ML resources was good, and that the use of ML resources helped them to improve their comprehension of course concepts, as well as their ability to solve specific problems.¡Gracias por su atención!