Using the ELECTRE MLO Multi-Criteria Decision-Making Method in Stepwise Benchmarking – Application in Higher Education
DOI:
https://doi.org/10.31181/oresta1903077lKeywords:
multi-criteria decision-making, ELECTRE, benchmarking, evolution path, higher educationAbstract
The purpose of this paper reflects in a study of an optimal development path in the ELECTRE-based stepwise benchmarking context. In the paper, multi-criteria decision-making is first described as a tool for stepwise benchmarking, where the ELECTRE MLO ranking method is used. In order to make the problem of finding the optimal path easier and significantly reduce the number of the paths that have to be considered, we are proving the theorem showing that it is better to make gradual progress than “skip steps”. As an illustration of these considerations, the ELECTRE MLO method is applied to the benchmark teaching assistants of one faculty of Belgrade University, according to the marks given by their students. We are looking for an optimal development path by using our theorem that substantially reduces the number of cases. We are also checking that the paths with no steps skipped are superior to the paths in which steps are skipped, in accordance with the theoretical result we have obtained. Thus, we are demonstrating that one should first look up to the colleague who is a little better than him/her, and then gradually improve until he/she has reached the level of the individual given the best mark.
Downloads
Download data is not yet available.
References
Anić, I., Larichev. O. "The ELECTRE method and the problem of acyclic relation between alternatives." Automation and Remote Control, 1996.
Arrowsmith, J., Sisson K., & Margison. P. "What can banchmarking offer the open method of co-ordination?" (Journal of Europen Public policy) 2004.
Bauer, J. "Learning from each other: promises and pitfalls of benchmarking in comunications policy." Info, 2010.
Bouysson, D. Roy. B."Comaprasion of two decision-aid models applied to a nuclear power plant siting example." Europen Jurnal of Operational Research, 1986.
Brehmer, J., Dawson, S., Homiller, S., Kling, F., & Plehn, T. " Benchmarking simplified template cross sections in WH production". Journal of High Energy Physics, 34.2019.
Charnes, A., W. Cooper & E. Rhodes. "Evaluating program and managerical efficiency: an application of data envelopment analysis to program folow through." Management science, 1981.
De Blas, C. S., Martin, J. S., & Gonzalez, D. G. " Combined social networks and data envelopment analysis for ranking. ." European Journal of Operational Research, 266(3), 990-999. 2018.
Dias, L. C., Antunes, C. H., Dantas, G., de Castro, N., & Zamboni, L. " A multi-criteria approach to sort and rank policies based on Delphi qualitative assessments and ELECTRE TRI: The case of smart grids in Brazil." Omega, 76, 100-111. 2018.
Dolowitz, D. Marsh. D."Who learns what from whom: a review of the policy transfer literature." Political studies, 1996.
Doumpos, M., & Figueira, J. R. " A multicriteria outranking approach for modeling corporate credit ratings: An application of the Electre Tri-nC method." Omega, 82, 166-180. 2019.
Figueira, J., Moussean V., & Roy. B.,"ELECTRE methodes. In Multiple criteria decision analysis: State of the art surveys." Springer, 2005.
Galo, N. R., Calache, L. D. D. R., & Carpinetti, L. C. R. "A group decision approach for supplier categorization based on hesitant fuzzy and ELECTRE TRI. ." International Journal of Production Economics, 202, 182-196. 2018.
Ganushchak-Yefimenko, L., Shcherbak, V., & Nifatova, O. " Managing a project of competitive-integrative benchmarking of higher educational institutions." Eastern-European journal of enterprise technologies. 2017.
Gidion, D. K., Hong, J., Adams, M. Z., & Khoveyni, M. " Network DEA models for assessing urban water utility efficiency." Utilities Policy, 57, 48-58.
Harsoyo, A., & Jati, H.Harsoyo, A., & Jati, H. " performance analysis of ministry’s website in Indonesia using entropy weightage method and electre ranking method. ."E-JPTE (Jurnal Elektronik Pendidikan Teknik Elektronika), 7(1), 1-8. 2018.
Hashemi, S. S., Hajiagha, S. H. R., Zavadskas, E. K., & Mahdiraji, H. A. (2016). "Multicriteria group decision making with ELECTRE III method based on interval-valued intuitionistic fuzzy information." Applied mathematical modelling, 40(2), 1554-1564., (2016).
Hassan, M. F. C., Rosli, M. U. M., & Redzuan, M. A. M. " Material selection in a sustainable manufacturing practice of a badminton racket frame using Elimination and Choice Expressing Reality (ELECTRE) Method. " Journal of Physics: Conference. 2018.
Hong, P., Hong, S., Roh, J. James, J., Park. K., "Evolving benchmarking practices: a review for research percpetives." (Benchmarking: An Internacional Journal), no. 19(4/5): 444-462 (2012).
Ishizaka, A., & Pereira, V. " Utilisation of ANPSort for sorting alternative with interdependent criteria illustrated through a researcher’s classification problem in an academic context." Soft Computing, 1-12. 2019.
Ishizaka, A., Giannoulis. C. "A web-based decision support system with ELECTRE III for a personalised ranking of british universitetes." Decision Support Systems, 2010.
Ishizaka, A., Tasiou, M., & Martínez, L. " Analytic hierarchy process-fuzzy sorting: An analytic hierarchy process–based method for fuzzy classification in sorting problems. ." Journal of the Operational Research Society, 1-20. 2019.
Ji, X., Wu, J., Zhu, Q., & Sun, J. " Using a hybrid heterogeneous DEA method to benchmark China’s sustainable urbanization: An empirical study." Annals of Operations Research, 278(1-2), 281-335. 2019.
La Fata, C. M., Lupo, T., & Piazza, T. " Service quality benchmarking via a novel approach based on fuzzy ELECTRE III and IPA: an empirical case involving the Italian public healthcare context. Health care management science, 22(1), 106-120." 2019.
Lundvall, B. Tomlison. M. "International benchmarking as a policy learning tool. The New Knowledge Economy in Europe." A strategy for Internacional Competitiveness and social Cohesion, 2012.
Millis, B. J., & Cottell Jr, P. G. (1997). Cooperative Learning for Higher Education Faculty. Series on Higher Education. Oryx Press, PO Box 33889, Phoenix, AZ 85067-3889.
Moore, R. "Making common sense common practice: Models for manufacturing excellence." Gulf Publishing Company, 1999.
Padró, F. F., & Sankey, M. " Benchmarking as an instrument for continuous improvement in a regulated higher education quality assurance environment. ." In Cases on Quality Initiatives for Organizational Longevity (pp. 35-73). IGI Global. 2018.
Paliulis, N. K., & Labanauskis, R. " Benchmarking as an Instrument for improvement of quality management in higher education." Business, management and education, 13(1), 140. 2015.
Papadopulos, A. Karagiannidis. A., "Application of the multicriteria analysis method ELECTRE III for the optimisation of decentralised energy systems." Omega, 2008.
Pereira, J., de Oliveira, E. C., Gomes, L. F., & Araújo, R. M. "Sorting retail locations in a large urban city by using ELECTRE TRI-C and trapezoidal fuzzy numbers. ." Soft Computing, 23(12), 4193-4206. 2019.
Petrović, M., Bojković, N., Anić, I., Petrović. D, "Benchmarking the digital divide using a multi-level outraking framework: Evidence from EBRD countries of operation." (Goverment Information Quaterly) 2012.
Petrović, M., Bojković, N., Anić, I., Stamenković, M., Pejčić-Tarle. S., "An ELECTRE-based decision aid tool for stepwise benchmarking: An aplication EU Digital Agenda targets." (Decision Support Systems) 2014.
Petrovic, M., Bojkovic, N., Stamenkovic, M., & Anic, I. "A sensitivity analysis of ELECTRE based stepwise benchmarking for policy: The case of EU digital agenda." Management: Journal of Sustainable Business and Management Solutions in Emerging Econo, 2018.
Petrović, M., Bojković, N., Stamenković, M., & Anić, I. "Supporting performance appraisal in ELECTRE based stepwise benchmarking model". Omega, 78, 237-251. 2018
Plaček, M., Ochrana, F., & Půček, M. " Benchmarking in Czech higher education. ." NISPAcee Journal of Public Administration and Policy, 8(2), 101-124. 2015.
R. Hambelton, J. Gross. "Local management in a global era." Public Management, 2008.
Ramón, N., Ruiz, J. L., & Sirvent, I. " Two-step benchmarking: Setting more realistically achievable targets in DEA. ." Expert Systems with Applications, 92, 124-131.
Ramsden, P. (2003). Learning to teach in higher education. Routledge.
Rose, R. "What is lesson-drawing?" Cambrige University Press, 1991.
Roy, B. "Classement et choix en presence de points de vue multiples." RAIRO- Operations Research-Recharche Operationnelle, 1968.
Roy, B., & Skalka. J. M. "ELECTRE Is: Aspects methodologiques etiquide d'utilisation LAMASADE." Unite associee an CNRS no 825, 1987.
S. Lim, H.Bae& L. H. Lee. "A study on the selection of benchmarking paths in DEA." Expert System with Applications, 2011.
Singh, A. " An integrated approach towards ranking hospitals using Fuzzy AHP and ELECTRE-I technique. ." International Journal of Healthcare Management, 1-10. 2019.
Spehl, M. S., Straub, C., Heinzmann, A., & Bode, S. F. " Student-perceived exam difficulty may trump the effects of different quality improvement measures regarding the students’ evaluation of a pediatric lecture series. ." BMC medical education, 19(1). 2019.
Sullivan, A. M., & Skanes, G. R. (1974). Validity of student evaluation of teaching and the characteristics of successful instructors. Journal of Educational Psychology, 66(4), 584.
Tavassoli, M. A., Darestani, S. A., & Tavassoli, S. A. " Supplier selection and evaluation using QFD and ELECTRE in quality management system environment (case study: Faravari & Sakht Company)." International Journal of Productivity and Quality Management. 2018.
Wachtel, H. K. (1998). Student evaluation of college teaching effectiveness: A brief review. Assessment & Evaluation in Higher Education, 23(2), 191-212.
Wang, Y., & Yeo, G. T. " Intermodal route selection for cargo transportation from Korea to Central Asia by adopting Fuzzy Delphi and Fuzzy ELECTRE I methods." Maritime Policy & Management, 45(1), 3-18. 2018.
Wei, W. A. N. G. (2007). Dilemma of the Criteria and Anxiety for the Reality: Reflections on the Current System for Evaluation of College Teachers' Classroom Teaching [J]. Journal of Zhejiang Normal University (Social Sciences), 3, 025.
Arrowsmith, J., Sisson K., & Margison. P. "What can banchmarking offer the open method of co-ordination?" (Journal of Europen Public policy) 2004.
Bauer, J. "Learning from each other: promises and pitfalls of benchmarking in comunications policy." Info, 2010.
Bouysson, D. Roy. B."Comaprasion of two decision-aid models applied to a nuclear power plant siting example." Europen Jurnal of Operational Research, 1986.
Brehmer, J., Dawson, S., Homiller, S., Kling, F., & Plehn, T. " Benchmarking simplified template cross sections in WH production". Journal of High Energy Physics, 34.2019.
Charnes, A., W. Cooper & E. Rhodes. "Evaluating program and managerical efficiency: an application of data envelopment analysis to program folow through." Management science, 1981.
De Blas, C. S., Martin, J. S., & Gonzalez, D. G. " Combined social networks and data envelopment analysis for ranking. ." European Journal of Operational Research, 266(3), 990-999. 2018.
Dias, L. C., Antunes, C. H., Dantas, G., de Castro, N., & Zamboni, L. " A multi-criteria approach to sort and rank policies based on Delphi qualitative assessments and ELECTRE TRI: The case of smart grids in Brazil." Omega, 76, 100-111. 2018.
Dolowitz, D. Marsh. D."Who learns what from whom: a review of the policy transfer literature." Political studies, 1996.
Doumpos, M., & Figueira, J. R. " A multicriteria outranking approach for modeling corporate credit ratings: An application of the Electre Tri-nC method." Omega, 82, 166-180. 2019.
Figueira, J., Moussean V., & Roy. B.,"ELECTRE methodes. In Multiple criteria decision analysis: State of the art surveys." Springer, 2005.
Galo, N. R., Calache, L. D. D. R., & Carpinetti, L. C. R. "A group decision approach for supplier categorization based on hesitant fuzzy and ELECTRE TRI. ." International Journal of Production Economics, 202, 182-196. 2018.
Ganushchak-Yefimenko, L., Shcherbak, V., & Nifatova, O. " Managing a project of competitive-integrative benchmarking of higher educational institutions." Eastern-European journal of enterprise technologies. 2017.
Gidion, D. K., Hong, J., Adams, M. Z., & Khoveyni, M. " Network DEA models for assessing urban water utility efficiency." Utilities Policy, 57, 48-58.
Harsoyo, A., & Jati, H.Harsoyo, A., & Jati, H. " performance analysis of ministry’s website in Indonesia using entropy weightage method and electre ranking method. ."E-JPTE (Jurnal Elektronik Pendidikan Teknik Elektronika), 7(1), 1-8. 2018.
Hashemi, S. S., Hajiagha, S. H. R., Zavadskas, E. K., & Mahdiraji, H. A. (2016). "Multicriteria group decision making with ELECTRE III method based on interval-valued intuitionistic fuzzy information." Applied mathematical modelling, 40(2), 1554-1564., (2016).
Hassan, M. F. C., Rosli, M. U. M., & Redzuan, M. A. M. " Material selection in a sustainable manufacturing practice of a badminton racket frame using Elimination and Choice Expressing Reality (ELECTRE) Method. " Journal of Physics: Conference. 2018.
Hong, P., Hong, S., Roh, J. James, J., Park. K., "Evolving benchmarking practices: a review for research percpetives." (Benchmarking: An Internacional Journal), no. 19(4/5): 444-462 (2012).
Ishizaka, A., & Pereira, V. " Utilisation of ANPSort for sorting alternative with interdependent criteria illustrated through a researcher’s classification problem in an academic context." Soft Computing, 1-12. 2019.
Ishizaka, A., Giannoulis. C. "A web-based decision support system with ELECTRE III for a personalised ranking of british universitetes." Decision Support Systems, 2010.
Ishizaka, A., Tasiou, M., & Martínez, L. " Analytic hierarchy process-fuzzy sorting: An analytic hierarchy process–based method for fuzzy classification in sorting problems. ." Journal of the Operational Research Society, 1-20. 2019.
Ji, X., Wu, J., Zhu, Q., & Sun, J. " Using a hybrid heterogeneous DEA method to benchmark China’s sustainable urbanization: An empirical study." Annals of Operations Research, 278(1-2), 281-335. 2019.
La Fata, C. M., Lupo, T., & Piazza, T. " Service quality benchmarking via a novel approach based on fuzzy ELECTRE III and IPA: an empirical case involving the Italian public healthcare context. Health care management science, 22(1), 106-120." 2019.
Lundvall, B. Tomlison. M. "International benchmarking as a policy learning tool. The New Knowledge Economy in Europe." A strategy for Internacional Competitiveness and social Cohesion, 2012.
Millis, B. J., & Cottell Jr, P. G. (1997). Cooperative Learning for Higher Education Faculty. Series on Higher Education. Oryx Press, PO Box 33889, Phoenix, AZ 85067-3889.
Moore, R. "Making common sense common practice: Models for manufacturing excellence." Gulf Publishing Company, 1999.
Padró, F. F., & Sankey, M. " Benchmarking as an instrument for continuous improvement in a regulated higher education quality assurance environment. ." In Cases on Quality Initiatives for Organizational Longevity (pp. 35-73). IGI Global. 2018.
Paliulis, N. K., & Labanauskis, R. " Benchmarking as an Instrument for improvement of quality management in higher education." Business, management and education, 13(1), 140. 2015.
Papadopulos, A. Karagiannidis. A., "Application of the multicriteria analysis method ELECTRE III for the optimisation of decentralised energy systems." Omega, 2008.
Pereira, J., de Oliveira, E. C., Gomes, L. F., & Araújo, R. M. "Sorting retail locations in a large urban city by using ELECTRE TRI-C and trapezoidal fuzzy numbers. ." Soft Computing, 23(12), 4193-4206. 2019.
Petrović, M., Bojković, N., Anić, I., Petrović. D, "Benchmarking the digital divide using a multi-level outraking framework: Evidence from EBRD countries of operation." (Goverment Information Quaterly) 2012.
Petrović, M., Bojković, N., Anić, I., Stamenković, M., Pejčić-Tarle. S., "An ELECTRE-based decision aid tool for stepwise benchmarking: An aplication EU Digital Agenda targets." (Decision Support Systems) 2014.
Petrovic, M., Bojkovic, N., Stamenkovic, M., & Anic, I. "A sensitivity analysis of ELECTRE based stepwise benchmarking for policy: The case of EU digital agenda." Management: Journal of Sustainable Business and Management Solutions in Emerging Econo, 2018.
Petrović, M., Bojković, N., Stamenković, M., & Anić, I. "Supporting performance appraisal in ELECTRE based stepwise benchmarking model". Omega, 78, 237-251. 2018
Plaček, M., Ochrana, F., & Půček, M. " Benchmarking in Czech higher education. ." NISPAcee Journal of Public Administration and Policy, 8(2), 101-124. 2015.
R. Hambelton, J. Gross. "Local management in a global era." Public Management, 2008.
Ramón, N., Ruiz, J. L., & Sirvent, I. " Two-step benchmarking: Setting more realistically achievable targets in DEA. ." Expert Systems with Applications, 92, 124-131.
Ramsden, P. (2003). Learning to teach in higher education. Routledge.
Rose, R. "What is lesson-drawing?" Cambrige University Press, 1991.
Roy, B. "Classement et choix en presence de points de vue multiples." RAIRO- Operations Research-Recharche Operationnelle, 1968.
Roy, B., & Skalka. J. M. "ELECTRE Is: Aspects methodologiques etiquide d'utilisation LAMASADE." Unite associee an CNRS no 825, 1987.
S. Lim, H.Bae& L. H. Lee. "A study on the selection of benchmarking paths in DEA." Expert System with Applications, 2011.
Singh, A. " An integrated approach towards ranking hospitals using Fuzzy AHP and ELECTRE-I technique. ." International Journal of Healthcare Management, 1-10. 2019.
Spehl, M. S., Straub, C., Heinzmann, A., & Bode, S. F. " Student-perceived exam difficulty may trump the effects of different quality improvement measures regarding the students’ evaluation of a pediatric lecture series. ." BMC medical education, 19(1). 2019.
Sullivan, A. M., & Skanes, G. R. (1974). Validity of student evaluation of teaching and the characteristics of successful instructors. Journal of Educational Psychology, 66(4), 584.
Tavassoli, M. A., Darestani, S. A., & Tavassoli, S. A. " Supplier selection and evaluation using QFD and ELECTRE in quality management system environment (case study: Faravari & Sakht Company)." International Journal of Productivity and Quality Management. 2018.
Wachtel, H. K. (1998). Student evaluation of college teaching effectiveness: A brief review. Assessment & Evaluation in Higher Education, 23(2), 191-212.
Wang, Y., & Yeo, G. T. " Intermodal route selection for cargo transportation from Korea to Central Asia by adopting Fuzzy Delphi and Fuzzy ELECTRE I methods." Maritime Policy & Management, 45(1), 3-18. 2018.
Wei, W. A. N. G. (2007). Dilemma of the Criteria and Anxiety for the Reality: Reflections on the Current System for Evaluation of College Teachers' Classroom Teaching [J]. Journal of Zhejiang Normal University (Social Sciences), 3, 025.
Downloads
Published
2019-12-16
How to Cite
Lazarevic, I. (2019). Using the ELECTRE MLO Multi-Criteria Decision-Making Method in Stepwise Benchmarking – Application in Higher Education. Operational Research in Engineering Sciences: Theory and Applications, 2(3), 77–91. https://doi.org/10.31181/oresta1903077l
Issue
Section
Articles