Assessment and Ranking Framework for the English Skills of Pre-Service Teachers Based on Fuzzy Delphi and TOPSIS Methods

• Published in: IEEE access 2019, Vol.7, p.126201-126223
• Main Authors: Alaa, Musaab, Albakri, Intan Safinas Mohd Ariff, Singh, Charanjit Kaur Swaran, Hammed, Hamsa, Zaidan, A. A., Zaidan, B. B., Albahri, O. S., Alsalem, M. A., Salih, Mahmood Maher, Almahdi, E. M., Baqer, M. J., Jalood, N. S., Nidhal, Shahad, Shareef, Ali. H., Jasim, Ali Najm
• Format: Article
• Language: English
• Subjects: Analytic hierarchy process; Attitudes; Bibliographies; Delphi method; Education; English as a second language; English as a second language instruction; English as a second language tests; English language; English proficiency; English teachers; Evaluation; fuzzy Delphi method; Language; Literature reviews; MCDM; multi-criteria decision making; Multiple criterion; Pre-service teacher; Ranking; Second language teachers; Skills; Student teachers; Task analysis; Teachers; Teaching; TESL; TOPSIS; Vocabulary
• ISSN: 2169-3536; 2169-3536
• DOI: 10.1109/ACCESS.2019.2936898

In this study, pre-service teaching refers to teaching English as a second language (TESL) to Malaysian students whose first language is not English. TESL prepares English-language learners to become future teachers of English as a second language. To date, no multi-criteria framework has been developed to evaluate and select the skills of pre-service teachers. This study presents a new framework to assess and rank the English skills of pre-service teachers on the basis of fuzzy Delphi and multi-criteria analysis. Three experiments were conducted. Firstly, criteria were identified from the literature review and the opinions of representative experts via the Delphi method. Secondly, 31 pre-service teachers were evaluated to determine the skills of pre-service teachers on the basis of Delphi criteria outcomes. English proficiency was tested through the English Language Testing Service and four language skill examinations. Each examination was evaluated by experts with vast experience in English teaching. Thirdly, pre-service teachers were ranked on the basis of a set of evaluated Delphi criteria outcomes through the technique for the order of preference by similarity to ideal solution (TOPSIS) method. Thereafter, the mean and standard deviation were utilized to ensure the identical systematic ranking of pre-service teachers. Findings are as follows. Twenty-five criteria from previous studies are representative as evaluated by the opinions of experts, which were gathered through interviews and a structured questionnaire. The validity of content was verified using a five-point Likert scale. With Delphi method outcomes, 14 criteria were selected and included in the final framework. The results of the proposed evaluation framework were tested on Malaysian pre-service teachers. TOPSIS is effective for solving the selection problems of pre-service teachers. In the final experiment, significant differences were recognized between the scores of groups, indicating identical ranking results.