This paper is in the following e-collection/theme issue:

e-Learning and Medical Education (648) mHealth in Medical Education and Training (66) Training Tools for Medical Students (124) Undergraduate Education for Allied Health Professionals (37) Undergraduate Education for Future Healthcare Professionals (26)

Published on in Vol 22, No 3 (2020): March

The Ecofisio Mobile App for Assessment and Diagnosis Using Ultrasound Imaging for Undergraduate Health Science Students: Multicenter Randomized Controlled Trial

The Ecofisio Mobile App for Assessment and Diagnosis Using Ultrasound Imaging for Undergraduate Health Science Students: Multicenter Randomized Controlled Trial

The Ecofisio Mobile App for Assessment and Diagnosis Using Ultrasound Imaging for Undergraduate Health Science Students: Multicenter Randomized Controlled Trial

Authors of this article:

Mario Lozano-Lozano1, 2, 3 Author Orcid Image ;   Noelia Galiano-Castillo1, 2, 3 Author Orcid Image ;   Carolina Fernández-Lao1, 2, 3 Author Orcid Image ;   Paula Postigo-Martin1, 2 Author Orcid Image ;   Francisco Álvarez-Salvago1 Author Orcid Image ;   Manuel Arroyo-Morales1, 2, 3 Author Orcid Image ;   Irene Cantarero-Villanueva1, 2, 3 Author Orcid Image
Article Authors Cited by (15) Tweetations (6) Metrics

    Original Paper

    1Department of Physical Therapy, University of Granada, Granada, Spain

    2Sport and Health Joint University Institute, Granada, Spain

    3Biohealth Research Institute in Granada, Granada, Spain

    Corresponding Author:

    Noelia Galiano-Castillo, PhD

    Department of Physical Therapy

    University of Granada

    Avda de la Ilustración 60

    Granada

    Spain

    Phone: 34 958248769

    Email: noeliagaliano@ugr.es


    Background: Generation Z is starting to reach college age. They have adopted technology from an early age and have a deep dependence on it; therefore, they have become more drawn to the virtual world. M-learning has experienced huge growth in recent years, both in the medical context and in medical and health sciences education. Ultrasound imaging is an important diagnosis technique in physiotherapy, especially in sports pathology. M-learning systems could be useful tools for improving the comprehension of ultrasound concepts and the acquisition of professional competencies.

    Objective: The purpose of this study was to evaluate the efficacy and use of an interactive platform accessible through mobile devices—Ecofisio—using ultrasound imaging for the development of professional competencies in the evaluation and diagnosis of sports pathologies.

    Methods: Participants included 110 undergraduate students who were placed into one of two groups of a randomized controlled multicenter study: control group (ie, traditional learning) and experimental group (ie, Ecofisio mobile app). Participants’ theoretical knowledge was assessed using a multiple-choice questionnaire (MCQ); students were also assessed by means of the Objective Structured Clinical Examination (OSCE). Moreover, a satisfaction survey was completed by the students.

    Results: The statistical analyses revealed that Ecofisio was effective in most of the processes evaluated when compared with the traditional learning method: all OSCE stations, P<.001; MCQ, 43 versus 15 students passed in the Ecofisio and control groups, respectively, P<.001. Moreover, the results revealed that the students found the app to be attractive and useful.

    Conclusions: The Ecofisio mobile app may be an effective way for physiotherapy students to obtain adequate professional competencies regarding evaluation and diagnosis of sports pathologies.

    Trial Registration: ClinicalTrials.gov NCT04138511; https://clinicaltrials.gov/ct2/show/NCT04138511

    J Med Internet Res 2020;22(3):e16258

    doi:10.2196/16258

    Keywords

    undergraduate; OSCE; mHealth; teaching and learning strategies 


    Generational evolution is nothing new; constant social change poses a challenge for education. During the last several years, concepts referring to subsequent generational learning styles, such as those of Generation X, Generation Y (ie, millennials), or even Generation Z, have been emerging as new ways of understanding new generations [1]. Although most current undergraduate students are within the so-called millennial generation, the next wave of students (ie, Generation Z) is beginning to reach college age [2]. Both groups share many similarities, but the latter has unique characteristics that require new teaching strategies [3]. Generation Z is the term used to refer to those born between the mid-90s and the 2000s [4]. This generation has adopted technology from a very early age, creating a deep dependence on it and becoming more drawn to the virtual world [5].

    Some studies have shown how these generations absorb and process information in very different ways compared to previous generations [6-8]. These students are characterized as being digital natives and active learners who constantly search for innovation and technology, and who prefer teams, groups, and multitasking [6]. Therefore, they have grown up with several tools that make their learning brain structures different [9]. In this sense, the use of traditional teaching tools is decontextualized [10,11].

    In this new teaching-and-learning era, the adaptation of methodologies to new technologies is completely necessary to improve social learning. Educational activity has moved from distance learning to e-learning and, finally, to mobile learning (m-learning), as knowledge has increased exponentially and the demand has escalated [12]. According to Colazzo et al [13], “an educational process can be considered as any learning and teaching activity that is possible through mobile tools or in settings where mobile equipment is available.” M-learning can be understood the same way.

    M-learning is surpassing its predecessor (ie, e-learning), since it takes advantage of all its characteristics and overcomes all its disadvantages, making the content much more accessible in time and space [14]. It has become a reality, as proven by many validation studies conducted all over the world [15,16]; it even affects cognitive processes, such as memory. We are becoming symbiotic with our electronic tools, living in an increasingly interconnected society [17], where mobile apps attempt to overcome the problems currently posed by the learning system: the lack of personalized content and appeal to different learning styles, the inability of teachers to apply their true strengths, and the lack of effective reforms at a reasonable cost [18].

    There has been an incredible expansion of mobile phone apps in both the medical context [19] and medical and health sciences education. Briz-Ponce et al suggest that more than 37% of health sciences students have used a medical app to improve their learning skills [20]. However, despite the increasing use of m-learning, Po Lau et al highlight the lack of knowledge of m-learning services by public institutions [4]. Even though mobile technology is very well received and health sciences students are well disposed toward its use, its implementation among students has been unsuccessful; this is due to a lack of compliance by the educational systems because m-learning has not been integrated within the standard teaching process [21]. Consequently, as these authors indicate, it is necessary to conduct larger studies to raise awareness of these programs.

    There is an increasing number of studies on the use of m-learning in health sciences, such as in surgical skills [15], medicine [21], and nursing [22]. A systematic review in physiotherapy specifically evaluated the effectiveness and user perceptions of online technology for physiotherapy teaching and learning and highlighted its benefits. However, this review did not include any studies that used m-learning as the educational process [23]. Therefore, it is of crucial importance to include this technology as a complement in physical therapy studies.

    Our research team has previously conducted some e-learning [24,25] and m-learning studies with physiotherapy students. Our most recent study has shown that palpation skills and ultrasound techniques could be better acquired with a mobile app than by means of traditional learning [26]. In this sense, due to the importance of ultrasound as a diagnostic technique in physiotherapy, especially in sports pathology, m-learning seems to be a useful tool for its study, since it provides the necessary tools for the comprehension of concepts. To our knowledge, there are no studies that propose an m-learning environment to improve the acquisition of professional competencies of sports pathology assessment. Thus, the aim of this study was to evaluate the efficacy and use of an interactive platform accessible through mobile devices using ultrasound imaging for the development of professional competencies in the evaluation and diagnosis of sports pathologies.


    Recruitment and Participants

    A total of 110 undergraduate physical therapy students took part in this study; students were enrolled at the Health Science Faculty at the University of Granada, Spain, or at the Campus of Tudela, University of Navarra, Spain. These students were in their first or second year of Physical Therapy Fundamentals and Physical Therapy Assessments courses or in their second year of the Physiology of Effort, Physical Exercise, and Health course during the 2014-2015 academic year. Participants’ theoretical knowledge was assessed and they were also assessed by means of the Objective Structured Clinical Examination (OSCE). The participants were recruited via a public announcement at both universities. All students signed an informed consent form to participate in this study.

    Eligibility Criteria

    To be eligible for this trial, students needed to meet the following criteria: not having received any previous training in ultrasound imaging and management, having anatomy and biomechanics knowledge, being enrolled in any required subjects, having the basic ability to use a mobile app, and having a mobile phone with Internet access running on the Android operating system.

    Study Design

    We conducted a multicenter study, which consisted of a double-blinded, randomized controlled study involving volunteer students earning degrees in physical therapy from two public Spanish universities. The study was registered at ClinicalTrials.gov (NCT04138511). We used a computer program to randomly assign a number to each student in both universities. These numbers were provided in numbered, opaque envelopes by an external study member to ensure that the study member responsible for outcome assessments was blinded to intervention and control group assignment. The envelopes were opened after a baseline assessment. The assessment evaluator was blinded to both the assessment and the outcomes. There were 55 participants in the experimental group and 55 in the control group. The students were also blinded to the group to which they were assigned.

    After students received theoretical and practical lessons about ultrasound skills in sports pathology areas, the role that the Ecofisio mobile app played was assessed in a traditional way and by means of the OSCE. The OSCE allows us to measure ultrasound competence as expressed in specific observable behaviors. This study was approved by the Unidad de Calidad, Innovación y Prospectiva—a quality and innovation body—from the University of Granada, Spain (PID 14-56), and was conducted in accordance with the Declaration of Helsinki [27,28].

    The theoretical and practical lessons were conducted by three professors and three teaching fellows; the teacher-to-student ratio was 1:6-8. The same lessons were taught in both universities by the same professors.

    There were a total of six contact sessions on site; this was followed by self-study time focused on the theoretical and practical learning of ultrasound imaging procedures, on different areas of the body, regarding sports pathologies. Each study group—Ecofisio intervention group and control group—attended 2 hours of theoretical lessons and 4 hours of practical lessons. The ultrasound imaging sessions were developed following a previously reported methodology [29] and the diagnosis of sports injuries. All participants used the same ultrasound device model—MyLab 25 (Esaote Medical Systems)—with a 12 MHz linear probe. Finally, there was a self-study period, where the Ecofisio group used the mobile app and the control group used traditional study models (eg, books and journal papers).

    Both groups had 2 weeks to study after the on-site lessons. To prevent the control group from accessing information related to the mobile app, they were assessed before the Ecofisio group. The Ecofisio mobile app is focused on sports pathologies and contains relevant written and digital information about ultrasound imaging and management, as well as diagnosis of sport injuries. For each anatomical structure, there exists a theoretical description, a drawing with the anatomical description, an image with the specific placement of the ultrasound probe, an ultrasound slice, a diagram of the ultrasound image, and a video of the manual palpation procedure.

    Outcome Measures

    All variables were measured among both study groups after their self-study periods.

    Objective Structured Clinical Examination

    An OSCE [30,31] was used to measure participants’ hands-on skills in terms of ultrasound management. It is a competency-based evaluation [32] consisting of one station with five specific components: positioning of the patient, positioning of the ultrasound probe, orientation (ie, angle) of the ultrasound probe, handling of the ultrasound probe, and image adjustment. Before starting each component, the participants received accurate information about the task to perform. The examiner used a 5-point Likert scale, ranging from 0 to 4, to grade the specific efficiency of each component. The examiner also registered the required time (seconds) to identify the lesion. During each component, no comments were allowed between the students, the examiners, and the patients. The blinded examiner was an expert in ultrasound management with at least 5 years of experience, and the patient suffered a lesion that students had to locate. There were different clinical cases about different sports injuries.

    Multiple-Choice Questionnaire

    An evaluation of students’ theoretical knowledge was conducted using a multiple-choice questionnaire of 20 questions, where a maximum score of 10 points could be obtained.

    Satisfaction Survey

    Satisfaction scores related to the interventions were assessed among both groups through a specific 5-point Likert questionnaire, ranging from 1 (disagree) to 5 (strongly agree), which had been used in similar contexts previously [24-26]. Furthermore, the Ecofisio group completed another satisfaction questionnaire about the usage of the mobile app, ranging from 0 (totally unsatisfied) to 10 (totally satisfied).

    Sample Size Calculation

    It would require a power of 90% to detect a significant mean difference of 3.5 (SD 3) points in the palpation assessment via the OSCE, assuming a type 1 error (alpha) of 5% and a type 2 error (beta) of 10%. Considering a dropout rate of 20%, we decided to enroll 55 subjects per group. Before the on-campus sessions, an independent researcher randomly assigned each participant to a group using Epidat 3.1 software (Xeral de Saúde Pública).

    Statistical Analysis

    Descriptive analyses were obtained for all randomized participants. The Kolmogorov-Smirnov test was applied to test the hypothesis of normality for all variables. We calculated Student t tests for variables with normal distribution and Mann-Whitney U tests for the rest as nonparametric tests. The statistical significance was determined by P<.05, and all analyses were conducted using IBM SPSS Statistics for Windows, version 22.0 (IBM Corp).


    The final sample was comprised of 50 students in the Ecofisio group and 55 students in the control group, with mean ages of 19.8 years (SD 2.1) and 19.7 years (SD 6.0), respectively. At the beginning of the study, there were no group differences in study variables such as gender or previous experience (see Table 1). There were 5 dropouts (5/55, 9%) in the Ecofisio group due to problems with the operating system versions of their mobile devices (see Figure 1).

    Table 1. Characteristics of groups.
    CharacteristicEcofisio group (N=50)Control group (N=55)
    Age (years), mean (SD)19.8 (2.1)19.7 (6.0)
    Gender, n (%)


    		Female30 (60)32 (58)

    		Male20 (40)23 (42)
    Experience with ultrasound, n (%)


    		Yes0 (0)0 (0)

    		No50 (100)55 (100)
    Experience with sports injuries diagnosis, n (%)


    		Yes0 (0)0 (0)

    		No50 (100)55 (100)
    Experience with sports injuries diagnosis with ultrasound, n (%)


    		Yes1 (2)4 (7)

    		No49 (98)51 (93)
    ‎
    Figure 1. Consolidated Standards Of Reporting Trials (CONSORT) flow diagram of the study.
    View this figure

    We found a significant difference in the theoretical exam score (P<.001) in favor of the Ecofisio group: mean 7.3 (SD 1.5) points. The results also indicated significant differences in all components assessed during the OSCE stations (P<.001 for all) (see Table 2). The Ecofisio group significantly improved in the positioning of the patient (mean score 3.9 [SD 0.3]) and ultrasound probe (mean score 3.9 [SD 0.3]) compared with the control group (mean score 2.3 [SD 1.4] and 1.6 [SD 1.5], respectively). The Ecofisio group also reported higher marks than the control group in the following tasks: orientation of the ultrasound probe (mean score 3.8 [SD 0.6] vs 1.8 [SD 1.7]), handling of the ultrasound probe (mean score 3.3 [SD 0.8] vs 0.7 [SD 0.9]), and image adjustment (mean score 3.0 [SD 1.4] vs 1.6 [SD 1.5]). Finally, the Ecofisio group took significantly more time (P<.001) to identify the lesion (mean score 60.2 [SD 25.9]) than did the control group (mean score 45.3 [SD 18.3]). We found significant differences between groups in terms of passing the exam in favor of the Ecofisio group (43/50, 86%, vs 15/55, 27%, P<.001) (see Table 2).

    Regarding the satisfaction results, we only found significant differences between groups for two items. The Ecofisio group showed a higher satisfaction level than the control group for the following items: The teacher was competent (mean score 4.8 [SD 0.4] vs 4.5 [SD 0.5], P=.009) and I believe that the training is applicable (mean score 3.3 [SD 0.8] vs 3.0 [SD 0.9], P=.04) (see Table 3). For the rest of the items, there were no significant differences between groups: The subject was interesting (P=.08) and I am satisfied with the training (P=.98) (see Table 4).

    Table 2. Differences between groups in data obtained from the Objective Structured Clinical Examination (OSCE) stations 1 and 2.
    Station, specific componentsEcofisio group (N=50)Control group (N=55)P value
    1, mean (SD)

    		Total theoretical knowledge (maximum 10 points)7.3 (1.5)6.3 (1.5)<.001a
    2, mean (SD)



    		Positioning of patient (maximum 4 points)3.9 (0.3)2.3 (1.4)<.001a

    		Positioning of ultrasound probe (maximum 4 points)3.9 (0.3)1.6 (1.5)<.001a

    		Orientation (ie, angle) of ultrasound probe (maximum 4 points)3.8 (0.6)1.8 (1.7)<.001a

    		Handling of ultrasound probe (maximum 4 points)3.3 (0.8)0.7 (0.9)<.001a

    		Image adjustment (maximum 4 points)3.0 (1.4)1.6 (1.5)<.001a

    		Time to identify the lesion (seconds)60.2 (25.9)45.3 (18.3)<.001b
    2, total, n (%)



    		Suitable43 (86)15 (27)<.001c

    		Not suitable12 (14)35 (73)<.001c

    aMann-Whitney U test.

    bOne-way analysis of variance (ANOVA).

    cChi-square test.

    Table 3. Differences between groups regarding training satisfaction.
    ItemEcofisio group (N=50), mean (SD)Control group (N=55), mean (SD)P value
    The teacher was competent (maximum 5 points)4.8 (0.4)4.5 (0.5).009a
    The subject was interesting (maximum 5 points)4.3 (0.5)4.4 (0.6).08a
    I am satisfied with the training (maximum 5 points)3.6 (0.7)3.5 (0.7).98
    I believe that the training is applicable (maximum 5 points)3.3 (0.8)3.0 (0.9).04a

    aMann-Whitney U test.

    Table 4. Descriptive data related to the Ecofisio group’s satisfaction.
    ItemEcofisio group (N=50), n (%)
    Understandable information

    		Very clear40 (80)

    		Not very clear10 (20)

    		Not clearN/Aa
    Scientific quality of information (good quality)

    		Yes46 (92)

    		Not quite4 (8)

    		NoN/A
    Clear presentation of contents

    		Yes37 (74)

    		In some cases13 (26)

    		NoN/A
    Overall impression of the app

    		Very good7 (14)

    		Good43 (86)

    		Not very goodN/A

    		BadN/A
    Evaluation of the app from 0 to 10

    		101 (2)

    		911 (22)

    		828 (56)

    		710 (20)

    		6N/A

    		5N/A

    		4N/A

    		3N/A

    		2N/A

    		1N/A

    		0N/A

    aNot applicable.


    Principal Findings

    This work presents the results obtained on the use and efficacy of an interactive platform accessible through mobile devices using ultrasound imaging for the development of professional competencies in the evaluation and diagnosis of sports injuries. The mobile app has demonstrated its effectiveness in the majority of the processes evaluated when compared with the traditional learning method. Moreover, the results revealed that the app is attractive and useful from the point of view of the students.

    The findings presented are in line with previous work developed by our research group, where different technological tools were used to acquire professional competencies among physiotherapy students [24-26]. This study improves and adds importance to the ultrasound imaging competencies for the assessment and follow-up in sports injuries, which has great impact on the development of the professional activity of physiotherapists. In the case of the use of a mobile app, this study resulted in an improvement in all the components of the ultrasound assessment, being broader than those presented previously by Fernández-Lao et al [26]; that study, which also used a mobile app, showed no differences between groups in the items orientation of the ultrasound probe and image adjustment. This may be due to the fact that students had more motivation to correctly diagnose the sports injuries than to improve on other settings presented in the previous work. On the other hand, in our opinion, more experienced teachers could have also had a positive influence on the way information was provided to students.

    A surprising result was that there were significant differences between groups in the time required to identify the lesion. The identification time was almost 20 seconds lower for the control group when compared with the Ecofisio group. This finding was also described in our previous work [26]. We hypothesized that the students in the m-learning group took longer to reach the final result because they dedicated more time to finding a clearer image of the lesion. It is also possible that the control group had finished before the m-learning group because they did not find a clear image of the lesion [33]. Nevertheless, decreasing the time to identify the lesion was not an objective of our study and, therefore, the students were not encouraged to complete the assessment in a short time.

    According to the results of the postprogram survey on training satisfaction, nearly all the scores were better in the Ecofisio group than in the control group. We think that the students in the group with access to the app felt a greater motivation for the project in general, so they felt more satisfied with the experience; this fact was also stated in all our previously published works [24-26]. This is in accordance with results from Hill et al, where the students preferred new technologies over traditional learning processes [6]. Another previous study developed in the area of physiotherapy, which used a 3D mobile app, also showed a very good level of acceptance among students of anatomy and manual therapy [34]. In our study, the only item in which both groups presented very similar results was I am satisfied with the training. It is possible that all the students who were enrolled in the project were motivated because the project was conducted during the course and because of their very active participation in any activity that was proposed. Furthermore, their regular teacher taught the lessons, in which students were encouraged to consider the mobile app as a study complement.

    At the end of the project, the students in the Ecofisio group were asked about their level of satisfaction with the app; the results were quite good for all of the items evaluated. A total of 80% of the students gave scores of 8 or more on a 0-10-point rating scale about their overall satisfaction level with the app, similar to our previous studies [24-26]. Fernández-Lao et al [26] reported an average score of 8.2 on the global satisfaction level with their mobile app as a learning complement of palpation and ultrasound imaging skills of the shoulder. This fact demonstrates that, regardless of the subject studied with mobile apps, these tools are useful for students and their reported acceptance levels are very good. This fact highlights the interest and familiarization of Generation Z students with new technologies [35,36].

    Limitations

    Finally, we have to recognize some limitations of this research. Our study results with this mobile app should be supported in different countries and with different languages in order to extrapolate the results to other populations. On the other hand, we are aware of the fact that conducting the project during the course sessions may have prompted extra motivation among the students and that ultrasound imaging was an attractive tool for them to use; therefore, the results were quite good for both study groups. In this sense, it would be interesting to develop an independent study with the mobile app in other settings. Finally, there was no follow-up period with which to evaluate the sustainability of the benefits of this interactive platform. Nevertheless, this study also presents a number of strengths. This project was carried out in two different universities in Spain with an important sample of students; therefore, the results could be generalized to physiotherapy students. To our knowledge, this is one of the few studies that has been developed in the area of physiotherapy, showing the use of new technologies to complement traditional learning. In fact, we believe this is the first m-learning system designed to improve the acquisition of professional competencies in the assessment of sports pathologies. In addition, this m-learning system could be implemented in different areas of knowledge, such as sports medicine or sports sciences.

    Conclusions

    Ecofisio is an interactive platform accessible through mobile devices, which uses ultrasound imaging. It is an effective way to develop professional competencies in the evaluation and diagnosis of sports pathologies in physiotherapy students, in a way that students find satisfying. Similar experiences could be implemented in different areas of knowledge with good results.

    Acknowledgments

    We are grateful to Ms Carmen Sainz-Quinn for her assistance with the English language. The authors are also grateful for the collaboration of the students who participated in the study. This study was funded by a grant from the Educational Innovation Unit of the University of Granada, Spain (PID 14-56). This study was conducted thanks to the additional funding from the University of Granada, Plan Propio de Investigación 2016, Excellence actions: Units of Excellence; Unit of Excellence on Exercise and Health (UCEES).

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    CONSORT-eHEALTH checklist (V 1.6.1).

    PDF File (Adobe PDF File), 348 KB
    1. Jones VR. Essentials for engaged 21st-century students. Tech 2012 Oct;87(7):16-19 ISSN: ISSN-1527-1803.
    2. Eckleberry-Hunt J, Lick D, Hunt R. Is medical education ready for Generation Z? J Grad Med Educ 2018 Aug 02;10(4):378-381. [CrossRef]
    3. Shatto B, Erwin K. Teaching Millennials and Generation Z: Bridging the generational divide. Creat Nurs 2017 Feb 01;23(1):24-28. [CrossRef] [Medline]
    4. Lau K, Chiu D, Ho K, Lo P, See-To EW. Educational usage of mobile devices: Differences between postgraduate and undergraduate students. J Acad Librariansh 2017 May;43(3):201-208. [CrossRef]
    5. Pérez-Escoda A, Castro-Zubizarreta A, Fandos-Igado M. Digital skills in the Z Generation: Key questions for a curricular introduction in primary school. Comunicar: Revista Científica de Comunicación y Educación 2016 Oct 01;24(49):71-79. [CrossRef]
    6. Hill RL, Swanson A, Kirwan J. EI and learning styles: The effect on learning of generationals. In: Proceedings of the International Conference on Interactive Collaborative Learning. 2017 Presented at: International Conference on Interactive Collaborative Learning; September 21-23, 2016; Belfast, UK p. 101-115   URL: https://link.springer.com/chapter/10.1007/978-3-319-50340-0_8 [CrossRef]
    7. Hopkins L, Hampton BS, Abbott JF, Buery-Joyner SD, Craig LB, Dalrymple JL, et al. To the point: Medical education, technology, and the millennial learner. Am J Obstet Gynecol 2018 Feb;218(2):188-192. [CrossRef] [Medline]
    8. Hampton D, Welsh D, Wiggins A. Learning preferences and engagement level of Generation Z nursing students. Nurse Educ 2019 Jun 14:1. [CrossRef] [Medline]
    9. Desy JR, Reed DA, Wolanskyj AP. Milestones and Millennials: A perfect pairing-competency-based medical education and the learning preferences of Generation Y. Mayo Clin Proc 2017 Feb;92(2):243-250. [CrossRef] [Medline]
    10. Grossman P, McDonald M. Back to the future: Directions for research in teaching and teacher education. Am Educ Res J 2008 Mar;45(1):184-205. [CrossRef]
    11. Hora M, Smolarek B, Martin K, Scrivener L. Exploring the Situated and Cultural Aspects of Communication in the Professions: Implications for Teaching, Student Employability, and Equity in Higher Education. Am Educ Res J 2019 Apr 09;56(6):2221-2261. [CrossRef]
    12. Muttappallymyalil J, Mendis S, John LJ, Shanthakumari N, Sreedharan J, Shaikh RB. Evolution of technology in teaching: Blackboard and beyond in medical education. Nepal J Epidemiol 2016 Oct;6(3):588-592 [FREE Full text] [CrossRef] [Medline]
    13. Colazzo L, Molinari A, Ronchetti M, Trifonova A. Towards a multi-vendor mobile learning management system. In: Proceedings of the World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education (E-Learn). 2003 Presented at: World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education (E-Learn); November 7-11, 2003; Phoenix, AZ p. 2097-2100   URL: https://pdfs.semanticscholar.org/eabb/bd1313e9c5dec868d2736233533b7149f8e9.pdf
    14. Farley H, Murphy A, Johnson C, Carter B, Lane M, Midgley W, et al. How do students use their mobile devices to support learning? A case study from an Australian regional university. J Interact Media Educ 2015;1(14):13. [CrossRef]
    15. Al-Jundi W, Kayssi A, Papia G, Dueck A. Smart(phone) learning experience among vascular trainees using a response system application. J Surg Educ 2017;74(4):638-643. [CrossRef] [Medline]
    16. Lazarus L, Sookrajh R, Satyapal KS. Tablet technology in medical education in South Africa: A mixed methods study. BMJ Open 2017 Jul 31;7(7):e013871 [FREE Full text] [CrossRef] [Medline]
    17. Sparrow B, Liu J, Wegner D. Google effects on memory: Cognitive consequences of having information at our fingertips. Science 2011 Aug 05;333(6043):776-778. [CrossRef] [Medline]
    18. Newstead B, Wright CM, Colby SJ. The Bridgespan Group. 2010 Jun 28. Next generation learning: Can we crack four problems to unleash quality education for all?   URL: https://tinyurl.com/vrmlk5x [accessed 2020-01-19]
    19. Woodill G, Udell C. Mobile Learning in Medicine and Healthcare: Professional Education Applications. Morton, IL: Float Mobile Learning; 2011.   URL: http:/​/info.​floatlearning.com/​hs-fs/​hub/​241955/​file-285652672-pdf/​docs/​mobile-health/​mobile-learning-medicine-healthcare-professional-education-applications.​pdf [accessed 2020-01-19]
    20. Briz-Ponce L, Juanes-Méndez J, García-Peñalvo F. Exploring mobile learning apps for medical students and health care professionals. In: Proceedings of the Fourth International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM’16). 2016 Presented at: Fourth International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM’16); November 2-4, 2016; Salamanca, Spain p. 461-465   URL: https://tinyurl.com/vufgvzh [CrossRef]
    21. Patil RN, Almale BD, Patil M, Gujrathi A, Dhakne-Palwe S, Patil AR, et al. Attitudes and perceptions of medical undergraduates towards mobile learning (m-learning). J Clin Diagn Res 2016 Oct;10(10):JC06-JC10 [FREE Full text] [CrossRef] [Medline]
    22. Mather CA, Gale F, Cummings EA. Governing mobile technology use for continuing professional development in the Australian nursing profession. BMC Nurs 2017;16:17 [FREE Full text] [CrossRef] [Medline]
    23. Macznik AK, Ribeiro DC, Baxter GD. Online technology use in physiotherapy teaching and learning: A systematic review of effectiveness and users' perceptions. BMC Med Educ 2015 Sep 28;15:160 [FREE Full text] [CrossRef] [Medline]
    24. Arroyo-Morales M, Cantarero-Villanueva I, Fernández-Lao C, Guirao-Piñeyro M, Castro-Martín E, Díaz-Rodríguez L. A blended learning approach to palpation and ultrasound imaging skills through supplementation of traditional classroom teaching with an e-learning package. Man Ther 2012 Oct;17(5):474-478. [CrossRef] [Medline]
    25. Cantarero-Villanueva I, Fernández-Lao C, Galiano-Castillo N, Castro-Martín E, Díaz-Rodríguez L, Arroyo-Morales M. Evaluation of e-learning as an adjunctive method for the acquisition of skills in bony landmark palpation and muscular ultrasound examination in the lumbopelvic region: A controlled study. J Manipulative Physiol Ther 2012;35(9):727-734. [CrossRef] [Medline]
    26. Fernández-Lao C, Cantarero-Villanueva I, Galiano-Castillo N, Caro-Morán E, Díaz-Rodríguez L, Arroyo-Morales M. The effectiveness of a mobile application for the development of palpation and ultrasound imaging skills to supplement the traditional learning of physiotherapy students. BMC Med Educ 2016 Oct 19;16(1):274 [FREE Full text] [CrossRef] [Medline]
    27. Manzini JL. Declaración de Helsinki: Principios éticos para la investigación médica sobre sujetos humanos. Acta Bioeth 2000;6(2):321-334 ISSN 1726-569X [FREE Full text] [CrossRef]
    28. World Medical Association General Assembly. World Medical Association Declaration of Helsinki: Ethical principles for medical research involving human subjects. J Int Bioethique 2004 Mar;15(1):124-129. [Medline]
    29. Martinoli C. Musculoskeletal ultrasound: Technical guidelines. Insights Imaging 2010 Jul;1(3):99-141 [FREE Full text] [CrossRef] [Medline]
    30. Harden RM, Stevenson M, Downie WW, Wilson GM. Assessment of clinical competence using objective structured examination. Br Med J 1975 Feb 22;1(5955):447-451 [FREE Full text] [CrossRef] [Medline]
    31. Davies R, Ellerton C, Evans C. Reaching consensus on measuring professional behaviour in physical therapy objective structured clinical examinations. Physiotherapy Can 2017 Feb;69(1):65-72. [CrossRef]
    32. Carraccio C, Englander R. The objective structured clinical examination: A step in the direction of competency-based evaluation. Arch Pediatr Adolesc Med 2000 Jul;154(7):736-741. [CrossRef] [Medline]
    33. Payne E, Brown G. Communication and practice with examination criteria: Does this influence performance in examinations? Assess Eval High Educ 2011 Oct;36(6):619-626. [CrossRef]
    34. Noguera JM, Jiménez JJ, Osuna-Pérez MC. Development and evaluation of a 3D mobile application for learning manual therapy in the physiotherapy laboratory. Comput Educ 2013 Nov;69:96-108. [CrossRef]
    35. Whipple EC, Allgood KL, Larue EM. Third-year medical students' knowledge of privacy and security issues concerning mobile devices. Med Teach 2012;34(8):e532-e548. [CrossRef] [Medline]
    36. George PP, Papachristou N, Belisario JM, Wang W, Wark PA, Cotic Z, et al. Online eLearning for undergraduates in health professions: A systematic review of the impact on knowledge, skills, attitudes and satisfaction. J Glob Health 2014 Jun;4(1):010406 [FREE Full text] [CrossRef] [Medline]

    ‎
    m-learning: mobile learning
    OSCE: Objective Structured Clinical Examination

    Edited by G Eysenbach; submitted 15.09.19; peer-reviewed by AJ Martín-Pérez, F Artacho-Cordon; comments to author 16.10.19; revised version received 24.10.19; accepted 13.11.19; published 10.03.20

    Copyright

    ©Mario Lozano-Lozano, Noelia Galiano-Castillo, Carolina Fernández-Lao, Paula Postigo-Martin, Francisco Álvarez-Salvago, Manuel Arroyo-Morales, Irene Cantarero-Villanueva. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 10.03.2020.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.