Huang, Jie (2017) A Formative Evaluation of the ICAO TRAINAIR PLUS Program. Masters thesis, Concordia University.
Preview |
Text (application/pdf)
1MBHuang_MA_F2017.pdf - Accepted Version Available under License Spectrum Terms of Access. |
Abstract
The ICAO TRAINAIR PLUS Program is a global cooperative training network of civil aviation training organizations and industry partners working together to develop and deliver competency-based training courses (ICAO, 2014). Since the inception of the TRAINAIR PLUS Program in 2010, the Members of the ICAO training network have grown steadily and the available ICAO-recognized training courses have also increased accordingly, however, only one customer satisfaction survey was conducted for the identification of the Members’ satisfaction level with the TRAINAIR PLUS Program. After seven years of operation, it is significant to conduct a formative evaluation of the Program. This formative evaluation is an action oriented research, with the purpose to study how the TRAINAIR PLUS Program meets its prescribed objectives, how the TRAINAIR PLUS Electronic Management System (TPEMS) contributes to the achievements of the Program objectives and, consequently, determine potential improvements of the Program. In the process of implementing this formative evaluation, four online surveys were deployed using Google Forms and questions were tailored to the TRAINAIR PLUS Program Members, ICAO qualified course developers, ICAO course validators and ICAO instructors respectively. Data collected from the four groups of respondents were analysed separately and then aggregated to generalize the overall results. Subsequently, recommendations and limitations were discussed, and conclusions were summarized from the survey results for the Program improvements.
| Divisions: | Concordia University > Faculty of Arts and Science > Education |
|---|---|
| Item Type: | Thesis (Masters) |
| Authors: | Huang, Jie |
| Institution: | Concordia University |
| Degree Name: | M.A. |
| Program: | Educational Technology |
| Date: | 31 August 2017 |
| Thesis Supervisor(s): | Shaw, Steven |
| Keywords: | formative evaluation, ICAO TRAINAIR PLUS Program, objectives, improvements |
| ID Code: | 982962 |
| Deposited By: | JIE HUANG |
| Deposited On: | 09 Nov 2017 20:21 |
| Last Modified: | 18 Jan 2018 17:56 |
References:
American Evaluation Association (2004). American Evaluation Association Guiding Principles For Evaluators. Retrieved from the American Evaluation Association website: http://www.eval.org/p/cm/ld/fid=51Bloom, B. S. (1956). Taxonomy of educational objectives; the classification of educational goals. New York: Longmans, Green.
Bloom, B. S. (1968). Learning for mastery. Los Angeles, USA: University of California press.
Bloom, B. S., Hasting, T., & Madaus, G. (1971). Handbook of formative and summative evaluation of student learning. New York, USA: McGraw-Hill.
Clark, V. P., & Creswell, J. W. (2010). Understanding research: A consumer's guide (2nd ed.). Upper Saddle River, NJ: Merrill/Pearson Educational.
Creswell, J. W. (2011). Educational research: Planning, conducting, and evaluating quantitative and qualitative research (4th ed.). Boston, MA: Pearson Education.
Formative assessment (n.d.). In Wikipedia. Retrieved June 5, 2017, from https://en.wikipedia.org/wiki/Formative_assessment
Global Aviation Training Office. (2017). TRAINAIR PLUS activities [PowerPoint Slides]. Retrieved from 4th ICAO Global Aviation Training and TRAINAIR PLUS Symposium website: https://www.ethiopianairlines.com/events/icao/presentations-and-photos/presentations
International Civil Aviation Organization. (2014). ICAO Civil Aviation Training Policy. Retrieved from http://www.icao.int/training/Pages/GAToverview.aspx#RefDocs
International Civil Aviation Organization. (2011). ICAO Study Reveals Strong Demand for Qualified Aviation Personnel up to 2030. Retrieved from http://www.icao.int/Newsroom/Pages/icao-study-reveals-strong-demand-for-qualified-aviation-personnel-up-to-2030.aspx
International Civil Aviation Organization. (2011). Training Development Guide. Retrieved from https://www.icao.int/safety/TrainairPlus_Archive/Pages/TrainingDevelopmentGuidelines.aspx
International Civil Aviation Organization. (2016). TRAINAIR PLUS Operations Manual. Retrieved from https://www.icao.int/training/Pages/TPP-How-to-apply.aspx
International Civil Aviation Organization. (2014). ICAO Instructor Competency Framework. Retrieved from https://www4.icao.int/tpems/InstructorApplication/Create
International Civil Aviation Organization. (2014). TRAINAIR PLUS Program Update (Electronic Bulletin 2014/73). Retrieved from http://www.icao.int/training/Pages/GAToverview.aspx#RefDocs
International Civil Aviation Organization. (2017). ICAO’s Regional Presence. Retrieved from https://www.icao.int/secretariat/RegionalOffice
International Civil Aviation Organization. (2017). Build Safety Intelligence Using iSTARS. Retrieved from https://www.icao.int/safety/iStars/pages/intro.aspx
Kaufman, R., Keller, J. M. (1994). Levels of evaluation: Beyond Kirkpatrick. Human Resources Development Quarterly, Vol. 5 (4), Winter.
Kirkpatrick, D. L. (1998). Evaluating training programs: The four levels. San Francisco, CA: Berrett-Koehler.
Kirkpatrick, D.L. (1998). Another look at evaluating training programs. Alexandria, VA: American Society for Training & Development.
Kirkpatrick, D. L. (2006). Seven keys to unlock the four levels of evaluation. Performance Improvement, 45(7) 5-8. http://www.scribd.com/doc/7841600/Donald-Kirkpatrick-7-Keys-to-Unlock-4-Levels-of-Evaluation
Klein, J. D., & Reiser, R. A. (2014). Suggestions for structuring a research article. J Comput High Educ Journal of Computing in Higher Education, 26(1), 22-38. doi:10.1007/s12528-013-9075-5
Martel, C. (2016). Evaluation in education [PowerPoint slides]. Retrieved from https://moodle.concordia.ca/moodle/course/view.php?id=90300
Michael Scriven (n.d.). In Wikipedia. Retrieved June 5, 2017, from https://en.wikipedia.org/wiki/Michael_Scriven
Mohr, L. B. (1995). Impact analysis for program evaluation (2nd ed.). Thousand Oaks, CA: Sage.
Patton, M. Q. (2008), Utilization-focused evaluation (4th ed.). Thousand Oaks, Calif: Sage.
Pareto principle (n.d.). In Wikipedia. Retrieved June 5, 2017, from https://en.wikipedia.org/wiki/Pareto_principle
Reeves, T. (n.d). Questionnaire. [PDF File]. Retrieved from http://treeves.coe.uga.edu/edit8350/QUES.html
Reeves, T.C. & Hedberg, J.G. (2003). Interactive learning systems evaluation. Englewood Cliffs, NJ: Educational Technology Publications.
Scriven, M. (1980). The logic of evaluation. Inverness, Calif: Edgepress.
Scriven, M. (1991). Beyond formative and summative evaluation. In M.W. McLaughlin and ED.C. Phillips (Eds.), Evaluation and Education: A Quarter Century. Chicago: University of Chicago Press, p. 169.
Scriven, M. (1967). The methodology of evaluation. In R. W. Tyler, R. M. Gagne, & M. Scriven (Eds.), Perspectives of Curriculum Evaluation, 39-83. Chicago, IL: Rand McNally.
Tessmer, M. (1993). Planning and conducting formative evaluations: Improving the quality of education and training. London: Kogan Page.
Tessmer, M. (1996). Formative evaluation. In P. Kommers, S. Grabinger, & J. Dunlap (Eds.), Hypermedia Learning Environments: Instructional Design and Integration. Mahwah, NJ: Lawrence Erlbaum, p. 187-210.
Urdan, T. C. (2010). Statistics in plain English (3rd ed.). New York, NY: Taylor and Francis Group.
Wholey, J. S., Hatry, H. P., & Newcomer, K. E. (2010). Handbook of practical program evaluation. San Francisco: Jossey-Bass.
Repository Staff Only: item control page
Download Statistics
Download Statistics