Analysis of lack of agreement between MCDM methods related to the solution of a problem: Proposing a methodology for comparing methods to a reference

© Springer Nature Switzerland AG 2019. It is a proven fact that at present, there is not a course of action that can evaluate or validate the reliability of the solution reached by a MCDM method, because the `true¿ solution is not known, and it is impossible to make a comparison to assess the efficiency of a result found. This chapter presents a procedure that can help in this endeavour. It proposes to use a proxy of the true solution, to test a result of any MCDM method; this proxy solution must be the consequence of a more faithful model to replicate as much as possible real-world conditions, as well as the absence of subjectivity in criteria weighting, and the result achieved by an indisputable mathematical procedure. For this purpose, this book suggests using the SIMUS method that fulfils these conditions. In so doing, a problem is solved by this method and its result used as a benchmark to determine the closeness to this result by other methods. To measure the closeness to the proxy, it is suggested to use the Kendall tau rank correlation coefficient (Kendall, Biometrika 30(1¿2): 81¿89, 1938).