Appendix A. Comparison Between Solvers and Valid Inequalities for Exact Method
This Appendix presents the detailed results of the comparison between the commercial solvers Gurobi and CPLEX and valid inequalities for the exact method. In
Table A1, the results for each instance and solver are presented. For each instance, the following data are outlined: Upper Bound (UB) (i.e., the incumbent integer feasible solution obtained by the solver), computing time in seconds, optimality gap, and the lower bound (LB) (i.e., solution of the relaxed problem). The optimality gap is estimated as in Gurobi Optimization, LLC [
32] with the information of the UB and LB with Equation (A1).
From the detailed results, it can be observed that CPLEX occasionally reaches the optimal solution but lacks sufficient information to confirm this due to a weak lower bound. In contrast, a key strength of Gurobi lies in its ability to generate competitive lower bounds, which significantly reduces computing times. This capability enables Gurobi to converge more effectively on optimal solutions, enhancing its performance relative to CPLEX.
Table A1.
Detailed results for the comparison between solvers and VIs for the exact method.
Table A1.
Detailed results for the comparison between solvers and VIs for the exact method.
Gurobi |
---|
| 15_1 | 15_2 | 15_3 |
Formulations | UB | Comp. Time (sec) | opt. gap | LB | UB | Comp. Time (sec) | opt. gap | LB | UB | Comp. Time (sec) | opt. gap | LB |
Model (1) | 34.93 | 7203.08 | 35% | 22.64 | 33.37 | 7204.15 | 36% | 21.35 | 35.31 | 7203.75 | 34% | 23.33 |
Model (1) +
Equation (2) | 34.59 | 99.20 | 0% | 34.59 | 33.35 | 161.67 | 0% | 33.35 | 35.22 | 129.31 | 0% | 35.22 |
Model (1) +
Equation (3) | 34.59 | 15.40 | 0% | 34.59 | 33.35 | 21.23 | 0% | 33.35 | 35.22 | 50.60 | 0% | 35.22 |
Model (1) +
Equations (2) and (3) | 34.59 | 7.63 | 0% | 34.59 | 33.35 | 39.64 | 0% | 33.35 | 35.22 | 45.59 | 0% | 35.22 |
Model (1) +
Equation (4) | 34.93 | 7203.70 | 36% | 22.19 | 33.52 | 7204.27 | 38% | 20.65 | 35.71 | 7203.84 | 36% | 22.91 |
Model (1) +
Equations (2) and (4) | 34.59 | 104.81 | 0% | 34.59 | 33.35 | 115.65 | 0% | 33.35 | 35.22 | 126.38 | 0% | 35.22 |
Model (1) +
Equations (3) and (4) | 34.59 | 24.80 | 0% | 34.59 | 33.35 | 22.63 | 0% | 33.35 | 35.22 | 17.45 | 0% | 35.22 |
Model (1) +
Equations (2) and (4) | 34.59 | 10.91 | 0% | 34.59 | 33.35 | 46.10 | 0% | 33.35 | 35.22 | 23.84 | 0% | 35.22 |
CPLEX |
Formulations | UB | Comp. Time (sec) | opt. gap | LB | UB | Comp. Time (sec) | opt. gap | LB | UB | Comp. Time (sec) | opt. gap | LB |
Model (1) | 34.59 | 7203.66 | 42% | 20.08 | 33.35 | 7203.32 | 44% | 18.57 | 35.22 | 7209.65 | 37% | 22.03 |
Model (1) +
Equation (2) | 34.59 | 7208.26 | 20% | 27.60 | 33.35 | 7203.53 | 39% | 20.21 | 35.22 | 7205.12 | 19% | 28.36 |
Model (1) +
Equation (3) | 35.10 | 7203.38 | 43% | 19.87 | 33.49 | 7206.26 | 45% | 18.44 | 35.22 | 7206.83 | 39% | 21.37 |
Model (1) +
Equations (2) and (3) | 35.10 | 7210.45 | 20% | 28.12 | 35.16 | 7205.62 | 39% | 21.34 | 35.22 | 7213.45 | 19% | 28.43 |
Model (1) +
Equation (4) | 34.59 | 7203.27 | 42% | 20.08 | 33.35 | 7204.08 | 44% | 18.57 | 35.22 | 7203.04 | 37% | 22.03 |
Model (1) +
Equations (2) and (4) | 34.59 | 7208.77 | 20% | 27.62 | 33.64 | 7203.77 | 40% | 20.20 | 35.22 | 7210.53 | 19% | 28.36 |
Model (1) +
Equations (3) and (4) | 35.10 | 7202.95 | 43% | 19.87 | 33.49 | 7205.99 | 45% | 18.45 | 35.69 | 7209.10 | 40% | 21.38 |
Model (1) +
Equations (2) and (4) | 35.10 | 7210.04 | 20% | 28.14 | 33.93 | 7205.62 | 37% | 21.33 | 35.22 | 7205.89 | 19% | 28.42 |
Appendix B. Scatter Search. Statistical Summary of the Computational Experiments
This appendix contains the box-and-whisker plots of the 36 SS algorithm configurations considered with the instances of 15 (see
Figure A1,
Figure A2 and
Figure A3) and 30 (see
Figure A4,
Figure A5 and
Figure A6) collection points, and the corresponding statistical summary tables. Thus,
Table A2,
Table A3 and
Table A4 show the statistical summary of the experiments performed with the 15-1, 15-2, and 15-3 instances, respectively, and
Table A5,
Table A6 and
Table A7 show the statistical summary of the experiments performed with the 30-1, 30-2, and 30-3 instances, respectively. In each table, from left to right is reported, for each configuration of the SS algorithm: the minimum (the best value of the objective function found), the first quartile, the median, the second quartile, the (pseudo) median, the lower bound and the upper bound of a 95% confidence interval for the (pseudo) median, the total runtime (in seconds), of the 31 runs performed in each case, and the mean runtime of each run (in seconds). The pseudomedian of a distribution F is the median of the distribution of
, where
u and
v are independent, each with [
48].
Figure A1.
Instance 15-1. Box-and-whisker plots of the results grouped by combination methods, improvement method: EXC (white), INS (blue), and INV (gray), and local search sizes: 10, 20, and 30, from left to right.
Figure A1.
Instance 15-1. Box-and-whisker plots of the results grouped by combination methods, improvement method: EXC (white), INS (blue), and INV (gray), and local search sizes: 10, 20, and 30, from left to right.
Figure A2.
Instance 15-2. Box-and-whisker plots of the results grouped by combination methods, improvement method: EXC (white), INS (blue), and INV (gray), and local search sizes: 10, 20, and 30, from left to right.
Figure A2.
Instance 15-2. Box-and-whisker plots of the results grouped by combination methods, improvement method: EXC (white), INS (blue), and INV (gray), and local search sizes: 10, 20, and 30, from left to right.
Figure A3.
Instance 15-3. Box-and-whisker plots of the results grouped by combination methods, improvement method: EXC (white), INS (blue), and INV (gray), and local search sizes: 10, 20, and 30, from left to right.
Figure A3.
Instance 15-3. Box-and-whisker plots of the results grouped by combination methods, improvement method: EXC (white), INS (blue), and INV (gray), and local search sizes: 10, 20, and 30, from left to right.
Figure A4.
Instance 30-1. Box-and-whisker plots of the results grouped by combination methods, improvement method: EXC (white), INS (blue), and INV (gray), and local search sizes: 10, 20, and 30, from left to right.
Figure A4.
Instance 30-1. Box-and-whisker plots of the results grouped by combination methods, improvement method: EXC (white), INS (blue), and INV (gray), and local search sizes: 10, 20, and 30, from left to right.
Figure A5.
Instance 30-2. Box-and-whisker plots of the results grouped by combination methods, improvement method: EXC (white), INS (blue), and INV (gray), and local search sizes: 10, 20, and 30, from left to right.
Figure A5.
Instance 30-2. Box-and-whisker plots of the results grouped by combination methods, improvement method: EXC (white), INS (blue), and INV (gray), and local search sizes: 10, 20, and 30, from left to right.
Figure A6.
Instance 30-3. Box-and-whisker plots of the results grouped by combination methods, improvement method: EXC (white), INS (blue), and INV (gray), and local search sizes: 10, 20, and 30, from left to right.
Figure A6.
Instance 30-3. Box-and-whisker plots of the results grouped by combination methods, improvement method: EXC (white), INS (blue), and INV (gray), and local search sizes: 10, 20, and 30, from left to right.
Table A2.
Instance 15-1. Statistical summary (runtimes in seconds).
Table A2.
Instance 15-1. Statistical summary (runtimes in seconds).
Combin. Method | Improv. Method | Local Search Size | min | Q1 | Median | Q2 | (Pseudo) Median | lb | ub | Total Runtimes | Mean Runtimes |
---|
PMX | EXC | 10 | 34.59096 | 34.80424 | 34.98869 | 35.31725 | 35.10107 | 34.95119 | 35.31720 | 243.68339 | 7.86075 |
PMX | EXC | 20 | 34.59096 | 34.86188 | 34.98869 | 35.72651 | 35.21642 | 34.95989 | 35.40944 | 207.04524 | 6.67888 |
PMX | EXC | 30 | 34.59096 | 34.94258 | 34.98869 | 35.71786 | 35.24804 | 34.98868 | 35.49298 | 191.32109 | 6.17165 |
PMX | INS | 10 | 34.59096 | 34.93681 | 35.02904 | 35.60258 | 35.23934 | 35.00881 | 35.49601 | 263.45977 | 8.49870 |
PMX | INS | 20 | 34.59096 | 34.93681 | 35.12703 | 35.83891 | 35.35184 | 35.08669 | 35.59676 | 229.96111 | 7.41810 |
PMX | INS | 30 | 34.59096 | 34.93681 | 35.24808 | 35.49594 | 35.23083 | 35.04350 | 35.43840 | 217.88484 | 7.02854 |
PMX | INV | 10 | 34.59096 | 34.95987 | 35.08092 | 35.71498 | 35.30537 | 35.03196 | 35.52474 | 267.14046 | 8.61743 |
PMX | INV | 20 | 34.67166 | 35.08092 | 35.62852 | 36.01472 | 35.59175 | 35.37194 | 35.85050 | 231.33146 | 7.46231 |
PMX | INV | 30 | 34.59096 | 35.05786 | 35.91096 | 36.25105 | 35.67753 | 35.44991 | 35.97443 | 219.01970 | 7.06515 |
OX | EXC | 10 | 34.59096 | 34.93681 | 35.23079 | 35.70922 | 35.25384 | 35.07809 | 35.44986 | 231.14924 | 7.45643 |
OX | EXC | 20 | 34.59096 | 34.91952 | 35.30572 | 35.71498 | 35.27983 | 35.08385 | 35.48148 | 194.77790 | 6.28316 |
OX | EXC | 30 | 34.59096 | 34.67166 | 35.08092 | 35.82450 | 35.23946 | 34.95993 | 35.48443 | 182.80096 | 5.89681 |
OX | INS | 10 | 34.59096 | 34.74660 | 34.93681 | 34.98581 | 34.95990 | 34.80425 | 35.13281 | 264.53177 | 8.53328 |
OX | INS | 20 | 34.59096 | 34.59096 | 34.93681 | 35.25673 | 34.93688 | 34.78975 | 35.10975 | 229.01960 | 7.38773 |
OX | INS | 30 | 34.59096 | 34.78694 | 34.93681 | 35.26826 | 34.96274 | 34.90220 | 35.15868 | 216.53589 | 6.98503 |
OX | INV | 10 | 34.59096 | 34.98581 | 35.23079 | 35.40371 | 35.24462 | 35.10683 | 35.52475 | 267.98669 | 8.64473 |
OX | INV | 20 | 34.59096 | 34.93681 | 35.12703 | 36.02048 | 35.45007 | 35.04638 | 35.79576 | 232.05914 | 7.48578 |
OX | INV | 30 | 34.59096 | 34.93681 | 35.33454 | 36.06372 | 35.46722 | 35.15582 | 35.83898 | 219.81882 | 7.09093 |
CX | EXC | 10 | 34.59096 | 35.15585 | 35.44983 | 35.91961 | 35.52714 | 35.32585 | 35.74099 | 222.05486 | 7.16306 |
CX | EXC | 20 | 34.59096 | 34.98293 | 35.42101 | 35.86773 | 35.45504 | 35.22783 | 35.72363 | 189.66683 | 6.11828 |
CX | EXC | 30 | 34.59096 | 35.08092 | 35.38642 | 35.64005 | 35.41524 | 35.22788 | 35.62569 | 178.91450 | 5.77144 |
CX | INS | 10 | 34.93681 | 35.90520 | 36.30869 | 36.76118 | 36.33454 | 36.02624 | 36.65452 | 258.99309 | 8.35462 |
CX | INS | 20 | 34.59096 | 35.45847 | 35.97437 | 36.66031 | 36.05195 | 35.73220 | 36.42977 | 224.35371 | 7.23722 |
CX | INS | 30 | 34.59096 | 35.26249 | 36.15306 | 36.73236 | 36.07049 | 35.68336 | 36.42406 | 212.69208 | 6.86103 |
CX | INV | 10 | 34.67166 | 35.52476 | 36.03201 | 36.59114 | 36.08384 | 35.78712 | 36.43552 | 259.40189 | 8.36780 |
CX | INV | 20 | 34.59096 | 35.27402 | 35.96861 | 36.54503 | 35.91387 | 35.59974 | 36.23950 | 226.78883 | 7.31577 |
CX | INV | 30 | 34.59096 | 35.26826 | 35.91673 | 36.52773 | 35.90070 | 35.57952 | 36.19918 | 216.42255 | 6.98137 |
CX2 | EXC | 10 | 34.67166 | 35.49594 | 36.15306 | 36.69489 | 36.18476 | 35.85039 | 36.49609 | 232.64759 | 7.50476 |
CX2 | EXC | 20 | 34.59096 | 35.26537 | 35.96861 | 36.42974 | 35.89079 | 35.65446 | 36.24241 | 196.65155 | 6.34360 |
CX2 | EXC | 30 | 34.67166 | 35.72939 | 36.38939 | 36.79577 | 36.28275 | 36.00893 | 36.66612 | 185.13147 | 5.97198 |
CX2 | INS | 10 | 35.32878 | 36.62572 | 37.54800 | 38.30599 | 37.45871 | 36.94277 | 37.86217 | 266.94226 | 8.61104 |
CX2 | INS | 20 | 34.90223 | 36.48162 | 37.44424 | 38.03219 | 37.31848 | 36.66893 | 37.76419 | 230.21344 | 7.42624 |
CX2 | INS | 30 | 34.59096 | 36.49315 | 37.32896 | 38.08983 | 37.28032 | 36.84764 | 37.73815 | 217.89116 | 7.02875 |
CX2 | INV | 10 | 34.93681 | 36.59114 | 37.40389 | 37.99760 | 37.31742 | 36.89372 | 37.74691 | 269.12641 | 8.68150 |
CX2 | INV | 20 | 35.32878 | 36.64014 | 37.51341 | 38.25411 | 37.47034 | 36.96007 | 38.00915 | 232.88722 | 7.51249 |
CX2 | INV | 30 | 34.59096 | 36.42398 | 37.02345 | 37.68057 | 37.10931 | 36.65164 | 37.57973 | 220.83009 | 7.12355 |
Table A3.
Instance 15-2. Statistical summary (runtimes in seconds).
Table A3.
Instance 15-2. Statistical summary (runtimes in seconds).
Combin. Method | Improv. Method | Local Search Size | min | Q1 | Median | Q2 | (Pseudo) Median | lb | ub | Total Runtimes | Mean Runtimes |
---|
PMX | EXC | 10 | 33.34589 | 33.37472 | 33.49576 | 33.78974 | 33.60532 | 33.49580 | 33.73214 | 227.75893 | 7.34706 |
PMX | EXC | 20 | 33.34589 | 33.47847 | 33.68022 | 33.90214 | 33.72628 | 33.57073 | 33.96260 | 193.70328 | 6.24849 |
PMX | EXC | 30 | 33.34589 | 33.37472 | 33.49000 | 33.67157 | 33.50802 | 33.43241 | 33.72633 | 182.34684 | 5.88216 |
PMX | INS | 10 | 33.34589 | 33.49288 | 33.97996 | 34.43533 | 33.98722 | 33.74071 | 34.24511 | 263.04966 | 8.48547 |
PMX | INS | 20 | 33.46694 | 33.68886 | 34.00878 | 34.39210 | 34.05206 | 33.87327 | 34.21623 | 229.88504 | 7.41565 |
PMX | INS | 30 | 33.34589 | 33.49000 | 33.52459 | 34.17018 | 33.79832 | 33.56488 | 33.95395 | 217.47901 | 7.01545 |
PMX | INV | 10 | 33.34589 | 33.43236 | 33.64563 | 33.76668 | 33.66869 | 33.55622 | 33.78966 | 267.02398 | 8.61368 |
PMX | INV | 20 | 33.34589 | 33.51017 | 33.76668 | 33.95978 | 33.74652 | 33.65138 | 33.87620 | 230.50383 | 7.43561 |
PMX | INV | 30 | 33.34589 | 33.43236 | 33.55917 | 33.97707 | 33.70549 | 33.52462 | 33.85884 | 219.22672 | 7.07183 |
OX | EXC | 10 | 33.34589 | 33.44389 | 33.70328 | 33.86179 | 33.71767 | 33.57075 | 33.88770 | 229.91375 | 7.41657 |
OX | EXC | 20 | 33.34589 | 33.50729 | 33.76668 | 34.38345 | 33.94542 | 33.67742 | 34.10389 | 195.04656 | 6.29182 |
OX | EXC | 30 | 33.34589 | 33.47271 | 33.64563 | 33.77245 | 33.64563 | 33.56782 | 33.76668 | 182.48869 | 5.88673 |
OX | INS | 10 | 33.34589 | 33.37472 | 33.64563 | 33.81280 | 33.66285 | 33.53901 | 33.76086 | 264.40133 | 8.52908 |
OX | INS | 20 | 33.34589 | 33.37472 | 33.64563 | 33.81280 | 33.66868 | 33.55627 | 33.80125 | 229.29051 | 7.39647 |
OX | INS | 30 | 33.34589 | 33.43812 | 33.63987 | 33.74939 | 33.59379 | 33.51877 | 33.70334 | 217.31168 | 7.01005 |
OX | INV | 10 | 33.34589 | 33.64275 | 33.76668 | 34.32869 | 33.88645 | 33.70616 | 34.06637 | 268.06627 | 8.64730 |
OX | INV | 20 | 33.34589 | 33.64275 | 33.81280 | 34.25664 | 33.91238 | 33.74359 | 34.29691 | 232.63654 | 7.50440 |
OX | INV | 30 | 33.34589 | 33.52747 | 33.76668 | 34.06930 | 33.81849 | 33.66584 | 34.01446 | 220.26735 | 7.10540 |
CX | EXC | 10 | 33.34589 | 33.37472 | 33.49576 | 33.95978 | 33.66584 | 33.51021 | 33.89634 | 222.08047 | 7.16389 |
CX | EXC | 20 | 33.34589 | 33.42083 | 33.63987 | 33.91079 | 33.68013 | 33.55628 | 33.83583 | 189.45881 | 6.11157 |
CX | EXC | 30 | 33.34589 | 33.37472 | 33.70328 | 34.07507 | 33.74260 | 33.57067 | 34.00014 | 177.81074 | 5.73583 |
CX | INS | 10 | 33.34589 | 33.90502 | 34.45262 | 35.04057 | 34.46412 | 34.17891 | 34.76682 | 259.44712 | 8.36926 |
CX | INS | 20 | 33.49000 | 34.14135 | 34.59673 | 35.14144 | 34.64280 | 34.35470 | 34.94826 | 225.07482 | 7.26048 |
CX | INS | 30 | 33.37472 | 33.54188 | 34.43533 | 34.85323 | 34.30566 | 34.03188 | 34.62557 | 212.64264 | 6.85944 |
CX | INV | 10 | 33.34589 | 33.52459 | 33.65140 | 34.00013 | 33.76089 | 33.61400 | 33.91940 | 260.00214 | 8.38717 |
CX | INV | 20 | 33.34589 | 33.37472 | 33.63987 | 33.89926 | 33.66286 | 33.51309 | 33.88201 | 227.02476 | 7.32338 |
CX | INV | 30 | 33.34589 | 33.62546 | 33.87620 | 34.39786 | 33.97136 | 33.76384 | 34.12980 | 216.41019 | 6.98097 |
CX2 | EXC | 10 | 33.34589 | 33.53611 | 34.11830 | 35.05786 | 34.35471 | 33.93387 | 34.68322 | 231.42931 | 7.46546 |
CX2 | EXC | 20 | 33.37472 | 34.02607 | 34.57367 | 34.93681 | 34.56799 | 34.28830 | 34.84753 | 196.16718 | 6.32797 |
CX2 | EXC | 30 | 33.37472 | 33.66004 | 34.13559 | 34.86476 | 34.28402 | 33.97416 | 34.69187 | 183.38571 | 5.91567 |
CX2 | INS | 10 | 33.49000 | 34.93393 | 35.46712 | 35.78992 | 35.38606 | 35.08090 | 35.68042 | 265.78683 | 8.57377 |
CX2 | INS | 20 | 33.34589 | 34.79847 | 35.46712 | 35.92826 | 35.38210 | 35.03192 | 35.78415 | 230.63251 | 7.43976 |
CX2 | INS | 30 | 33.65140 | 34.34310 | 35.34031 | 35.64293 | 35.13424 | 34.79847 | 35.45847 | 218.36783 | 7.04412 |
CX2 | INV | 10 | 33.37472 | 34.28834 | 34.71777 | 35.78415 | 35.01603 | 34.58802 | 35.43836 | 268.83379 | 8.67206 |
CX2 | INV | 20 | 33.34589 | 33.79262 | 34.66013 | 35.42677 | 34.72070 | 34.28255 | 35.20772 | 233.39165 | 7.52876 |
CX2 | INV | 30 | 33.37472 | 33.66293 | 34.74660 | 35.31437 | 34.72647 | 34.33444 | 35.06652 | 221.32340 | 7.13946 |
Table A4.
Instance 15-3. Statistical summary (runtimes in seconds).
Table A4.
Instance 15-3. Statistical summary (runtimes in seconds).
Combin. Method | Improv. Method | Local Search Size | min | Q1 | Median | Q2 | (Pseudo) Median | lb | ub | Total Runtimes | Mean Runtimes |
---|
PMX | EXC | 10 | 35.21926 | 35.26249 | 35.58240 | 35.74957 | 35.54210 | 35.45850 | 35.67456 | 227.71527 | 7.34565 |
PMX | EXC | 20 | 35.21926 | 35.21926 | 35.58240 | 35.74957 | 35.54489 | 35.43258 | 35.66306 | 194.81453 | 6.28434 |
PMX | EXC | 30 | 35.21926 | 35.29708 | 35.66310 | 35.79568 | 35.55641 | 35.48434 | 35.72358 | 183.07657 | 5.90570 |
PMX | INS | 10 | 35.21926 | 35.49306 | 35.78415 | 36.02048 | 35.79617 | 35.63136 | 35.94266 | 266.05218 | 8.58233 |
PMX | INS | 20 | 35.21926 | 35.45847 | 35.71498 | 35.95996 | 35.74837 | 35.58237 | 35.90234 | 232.48314 | 7.49946 |
PMX | INS | 30 | 35.21926 | 35.58240 | 35.78415 | 35.98302 | 35.78413 | 35.64009 | 35.90807 | 219.23577 | 7.07212 |
PMX | INV | 10 | 35.21926 | 35.21926 | 35.62852 | 35.79568 | 35.58237 | 35.46714 | 35.72358 | 268.63915 | 8.66578 |
PMX | INV | 20 | 35.21926 | 35.37201 | 35.64581 | 35.78415 | 35.62559 | 35.50167 | 35.74958 | 231.71591 | 7.47471 |
PMX | INV | 30 | 35.21926 | 35.21926 | 35.40371 | 35.95420 | 35.60547 | 35.44114 | 35.79568 | 219.80032 | 7.09033 |
OX | EXC | 10 | 35.21926 | 35.31437 | 35.74957 | 35.98302 | 35.74375 | 35.56508 | 35.89941 | 242.16606 | 7.81181 |
OX | EXC | 20 | 35.21926 | 35.28843 | 35.62852 | 35.88214 | 35.57376 | 35.46711 | 35.76973 | 194.91102 | 6.28745 |
OX | EXC | 30 | 35.21926 | 35.28843 | 35.57664 | 35.76109 | 35.55928 | 35.44405 | 35.70923 | 181.91904 | 5.86836 |
OX | INS | 10 | 35.21926 | 35.28843 | 35.71498 | 35.79568 | 35.57664 | 35.48444 | 35.74958 | 264.82807 | 8.54284 |
OX | INS | 20 | 35.21926 | 35.28843 | 35.64581 | 36.00896 | 35.64977 | 35.48437 | 35.79566 | 229.24999 | 7.39516 |
OX | INS | 30 | 35.21926 | 35.29708 | 35.68616 | 35.91961 | 35.68610 | 35.50164 | 35.82444 | 217.21216 | 7.00684 |
OX | INV | 10 | 35.21926 | 35.21926 | 35.66310 | 36.04066 | 35.69477 | 35.47583 | 35.87061 | 269.37530 | 8.68953 |
OX | INV | 20 | 35.21926 | 35.68904 | 35.86485 | 36.17612 | 35.90231 | 35.74958 | 36.09830 | 233.15601 | 7.52116 |
OX | INV | 30 | 35.21926 | 35.57952 | 35.77262 | 36.13289 | 35.80140 | 35.66313 | 35.97141 | 220.73601 | 7.12052 |
CX | EXC | 10 | 35.21926 | 35.31437 | 35.71498 | 35.88791 | 35.68137 | 35.53626 | 35.80724 | 223.12399 | 7.19755 |
CX | EXC | 20 | 35.21926 | 35.30572 | 35.74957 | 36.02048 | 35.68054 | 35.53921 | 35.85622 | 190.05782 | 6.13090 |
CX | EXC | 30 | 35.21926 | 35.35472 | 35.83603 | 35.99743 | 35.79851 | 35.59677 | 35.92537 | 178.46300 | 5.75687 |
CX | INS | 10 | 35.66310 | 36.09254 | 36.45856 | 36.89664 | 36.51188 | 36.30293 | 36.73813 | 258.61783 | 8.34251 |
CX | INS | 20 | 35.21926 | 35.73227 | 36.25682 | 36.76118 | 36.24549 | 36.01479 | 36.44419 | 222.54077 | 7.17873 |
CX | INS | 30 | 35.21926 | 35.72939 | 36.06660 | 36.49891 | 36.09080 | 35.90226 | 36.30580 | 211.01199 | 6.80684 |
CX | INV | 10 | 35.21926 | 35.40371 | 35.84756 | 36.50468 | 35.97941 | 35.72075 | 36.19922 | 259.19600 | 8.36116 |
CX | INV | 20 | 35.21926 | 35.74957 | 36.02625 | 36.35193 | 36.03029 | 35.87642 | 36.17616 | 226.44557 | 7.30470 |
CX | INV | 30 | 35.21926 | 35.72363 | 36.15306 | 36.31734 | 36.12424 | 35.93112 | 36.32315 | 215.50162 | 6.95167 |
CX2 | EXC | 10 | 35.28843 | 35.78415 | 36.08965 | 36.75254 | 36.23662 | 35.97145 | 36.47011 | 231.04708 | 7.45313 |
CX2 | EXC | 20 | 35.21926 | 35.84468 | 36.36057 | 36.60843 | 36.27787 | 36.02330 | 36.49895 | 194.29054 | 6.26744 |
CX2 | EXC | 30 | 35.21926 | 35.94843 | 36.40668 | 36.78424 | 36.37367 | 36.13575 | 36.64306 | 182.08140 | 5.87359 |
CX2 | INS | 10 | 35.21926 | 36.23088 | 36.75830 | 37.21079 | 36.69778 | 36.38939 | 37.00328 | 264.41698 | 8.52958 |
CX2 | INS | 20 | 35.74957 | 36.45856 | 37.00040 | 37.55952 | 37.02864 | 36.72077 | 37.32900 | 228.83163 | 7.38167 |
CX2 | INS | 30 | 35.34031 | 36.16171 | 37.00616 | 37.49612 | 37.01976 | 36.59396 | 37.36073 | 216.29497 | 6.97726 |
CX2 | INV | 10 | 35.21926 | 36.28852 | 36.82747 | 37.39236 | 36.82747 | 36.53062 | 37.11280 | 267.69497 | 8.63532 |
CX2 | INV | 20 | 35.40371 | 36.49891 | 36.76983 | 37.17332 | 36.81017 | 36.59400 | 37.00332 | 231.97497 | 7.48306 |
CX2 | INV | 30 | 35.62852 | 36.30005 | 36.78136 | 37.04363 | 36.70892 | 36.48733 | 36.93411 | 219.82824 | 7.09123 |
Table A5.
Instance 30-1. Statistical summary (runtimes in seconds).
Table A5.
Instance 30-1. Statistical summary (runtimes in seconds).
Combin. Method | Improv. Method | Local Search Size | min | Q1 | Median | Q2 | (Pseudo) Median | lb | ub | Total Runtimes | Mean Runtimes |
---|
PMX | EXC | 10 | 51.06504 | 53.01911 | 53.87221 | 55.39396 | 54.18930 | 53.52346 | 54.83772 | 881.08183 | 28.42199 |
PMX | EXC | 20 | 51.18033 | 53.42548 | 54.44863 | 55.79457 | 54.54374 | 53.92409 | 55.20086 | 737.33660 | 23.78505 |
PMX | EXC | 30 | 51.91238 | 53.73099 | 54.49474 | 55.71675 | 54.66767 | 54.02208 | 55.32479 | 691.54074 | 22.30777 |
PMX | INS | 10 | 52.11989 | 54.03937 | 55.56688 | 56.29606 | 55.58562 | 54.85789 | 56.19518 | 1037.05853 | 33.45350 |
PMX | INS | 20 | 50.59814 | 54.06531 | 55.16339 | 56.55256 | 55.33776 | 54.59850 | 56.14619 | 894.97129 | 28.87004 |
PMX | INS | 30 | 51.80286 | 52.98452 | 54.90400 | 56.01361 | 54.74001 | 53.99612 | 55.47184 | 846.55571 | 27.30825 |
PMX | INV | 10 | 52.45998 | 54.74837 | 55.63029 | 56.65344 | 55.62599 | 55.00486 | 56.22979 | 1049.03119 | 33.83972 |
PMX | INV | 20 | 52.38505 | 54.78295 | 56.35658 | 56.71108 | 55.94052 | 55.19506 | 56.55546 | 907.41383 | 29.27141 |
PMX | INV | 30 | 52.83465 | 54.71378 | 55.44007 | 56.96470 | 55.59566 | 55.01924 | 56.40270 | 861.09960 | 27.77741 |
OX | EXC | 10 | 51.47430 | 53.61859 | 54.62732 | 56.40558 | 54.83195 | 54.15177 | 55.68505 | 905.71830 | 29.21672 |
OX | EXC | 20 | 51.75675 | 53.43413 | 54.18348 | 55.82916 | 54.48335 | 53.87801 | 54.98472 | 754.31409 | 24.33271 |
OX | EXC | 30 | 50.59814 | 54.25841 | 55.27291 | 56.51798 | 55.40981 | 54.77719 | 55.96461 | 700.88260 | 22.60912 |
OX | INS | 10 | 52.56950 | 53.86068 | 54.55239 | 55.61876 | 54.76566 | 54.20653 | 55.36514 | 1057.72009 | 34.12000 |
OX | INS | 20 | 50.60391 | 52.50321 | 53.79151 | 54.93282 | 53.78863 | 53.18339 | 54.39675 | 902.89111 | 29.12552 |
OX | INS | 30 | 50.24653 | 53.71081 | 54.22959 | 55.17780 | 54.48466 | 53.95291 | 55.12304 | 851.61238 | 27.47137 |
OX | INV | 10 | 51.42819 | 54.16618 | 55.20374 | 56.85518 | 55.38387 | 54.74837 | 56.03378 | 1064.09214 | 34.32555 |
OX | INV | 20 | 52.77125 | 54.39099 | 56.09719 | 57.55553 | 56.22526 | 55.43138 | 57.07703 | 908.57995 | 29.30903 |
OX | INV | 30 | 52.29858 | 54.99911 | 56.69667 | 57.31055 | 56.27156 | 55.67352 | 56.98488 | 859.53252 | 27.72686 |
CX | EXC | 10 | 51.66452 | 53.61570 | 54.53509 | 56.41422 | 54.93138 | 54.20077 | 55.50636 | 871.22559 | 28.10405 |
CX | EXC | 20 | 51.57806 | 53.76557 | 54.58121 | 55.61876 | 54.59850 | 54.04802 | 55.12304 | 725.63137 | 23.40746 |
CX | EXC | 30 | 49.95832 | 53.23815 | 54.28147 | 54.88671 | 54.19499 | 53.60122 | 54.70222 | 678.97770 | 21.90251 |
CX | INS | 10 | 53.24968 | 55.71964 | 57.51518 | 58.73719 | 57.18807 | 56.39117 | 57.99361 | 1034.47365 | 33.37012 |
CX | INS | 20 | 52.91535 | 55.81475 | 56.93300 | 57.86392 | 56.76440 | 56.18077 | 57.33073 | 882.38903 | 28.46416 |
CX | INS | 30 | 53.11134 | 55.20086 | 56.17789 | 57.46907 | 56.22405 | 55.56981 | 56.95313 | 832.18669 | 26.84473 |
CX | INV | 10 | 53.23815 | 55.70811 | 57.17510 | 58.92453 | 57.26012 | 56.43151 | 57.99938 | 1031.70938 | 33.28095 |
CX | INV | 20 | 53.77422 | 55.40837 | 56.99064 | 57.98208 | 56.79170 | 56.10001 | 57.48638 | 893.67188 | 28.82813 |
CX | INV | 30 | 53.61282 | 55.86662 | 56.58715 | 57.94462 | 56.78169 | 56.25282 | 57.35955 | 842.95357 | 27.19205 |
CX2 | EXC | 10 | 54.06819 | 55.67352 | 56.84654 | 58.18960 | 56.98344 | 56.27012 | 57.71981 | 936.78281 | 30.21880 |
CX2 | EXC | 20 | 52.18330 | 54.98182 | 56.52951 | 58.01955 | 56.34582 | 55.46310 | 57.23273 | 768.74164 | 24.79812 |
CX2 | EXC | 30 | 51.43972 | 55.82916 | 56.77160 | 57.58724 | 56.66455 | 55.92714 | 57.22404 | 711.29197 | 22.94490 |
CX2 | INS | 10 | 53.67623 | 55.57841 | 57.40566 | 59.18680 | 57.41143 | 56.59291 | 58.46916 | 1092.76569 | 35.25051 |
CX2 | INS | 20 | 54.44287 | 56.83501 | 58.17230 | 59.30209 | 58.09449 | 57.32208 | 58.91300 | 921.59958 | 29.72902 |
CX2 | INS | 30 | 54.12007 | 57.07422 | 58.22418 | 59.97073 | 58.26309 | 57.54977 | 59.12628 | 862.70223 | 27.82910 |
CX2 | INV | 10 | 54.64461 | 57.81780 | 58.97929 | 60.37134 | 59.11907 | 58.35099 | 59.77475 | 1097.34856 | 35.39834 |
CX2 | INV | 20 | 55.37090 | 57.79475 | 58.73143 | 60.02549 | 58.88416 | 58.22412 | 59.56438 | 931.48914 | 30.04804 |
CX2 | INV | 30 | 55.55536 | 57.01370 | 59.48654 | 60.08313 | 58.82654 | 57.99361 | 59.69982 | 873.67884 | 28.18319 |
Table A6.
Instance 30-2. Statistical summary (runtimes in seconds).
Table A6.
Instance 30-2. Statistical summary (runtimes in seconds).
Combin. Method | Improv. Method | Local Search Size | min | Q1 | Median | Q2 | (Pseudo) Median | lb | ub | Total Runtimes | Mean Runtimes |
---|
PMX | EXC | 10 | 49.74504 | 50.53474 | 51.48583 | 52.05937 | 51.35325 | 50.99587 | 51.75098 | 866.66081 | 27.95680 |
PMX | EXC | 20 | 49.94679 | 50.46845 | 51.42819 | 52.03919 | 51.25815 | 50.92378 | 51.57232 | 722.85330 | 23.31785 |
PMX | EXC | 30 | 49.08792 | 50.93535 | 51.83168 | 52.38793 | 51.71461 | 51.29557 | 52.11989 | 675.78662 | 21.79957 |
PMX | INS | 10 | 50.06207 | 51.80286 | 52.39657 | 52.93841 | 52.38352 | 51.93826 | 52.82593 | 1017.67223 | 32.82814 |
PMX | INS | 20 | 50.73649 | 51.46566 | 52.61561 | 53.16321 | 52.45854 | 52.03055 | 52.92112 | 876.12927 | 28.26223 |
PMX | INS | 30 | 50.06207 | 51.92103 | 52.83465 | 53.33614 | 52.76837 | 52.19771 | 53.14304 | 827.92987 | 26.70742 |
PMX | INV | 10 | 49.89491 | 51.62994 | 52.33317 | 52.94706 | 52.26113 | 51.81724 | 52.71078 | 1028.13709 | 33.16571 |
PMX | INV | 20 | 49.83727 | 51.60976 | 52.59256 | 53.28138 | 52.50612 | 52.08530 | 52.94996 | 886.08724 | 28.58346 |
PMX | INV | 30 | 51.27832 | 52.52627 | 53.02487 | 53.73387 | 53.17474 | 52.71361 | 53.61570 | 837.62361 | 27.02012 |
OX | EXC | 10 | 49.37037 | 50.88635 | 51.65876 | 52.55221 | 51.67893 | 51.26391 | 52.10836 | 895.56372 | 28.88915 |
OX | EXC | 20 | 49.58941 | 50.75954 | 51.50312 | 52.30435 | 51.55788 | 51.14574 | 52.01902 | 740.58223 | 23.88975 |
OX | EXC | 30 | 49.01299 | 50.79989 | 51.38208 | 52.10836 | 51.49444 | 51.06503 | 51.97289 | 683.61961 | 22.05225 |
OX | INS | 10 | 49.02452 | 50.57221 | 51.41666 | 51.94985 | 51.35324 | 50.95548 | 51.73083 | 1038.97999 | 33.51548 |
OX | INS | 20 | 49.88338 | 50.86618 | 51.64723 | 52.45710 | 51.71784 | 51.26103 | 52.12566 | 885.74781 | 28.57251 |
OX | INS | 30 | 48.69596 | 50.71919 | 51.44548 | 52.63579 | 51.64291 | 51.09963 | 52.13142 | 834.56697 | 26.92152 |
OX | INV | 10 | 50.48286 | 52.20636 | 53.24968 | 54.12295 | 53.29435 | 52.62714 | 53.97597 | 1062.18632 | 34.26407 |
OX | INV | 20 | 50.67308 | 52.33029 | 52.69055 | 53.60417 | 52.87072 | 52.53198 | 53.26700 | 901.22178 | 29.07167 |
OX | INV | 30 | 51.19186 | 52.32164 | 53.26120 | 54.10278 | 53.19059 | 52.66749 | 53.75693 | 840.90345 | 27.12592 |
CX | EXC | 10 | 50.41945 | 51.11692 | 51.92967 | 52.49457 | 51.88065 | 51.52046 | 52.26403 | 862.95733 | 27.83733 |
CX | EXC | 20 | 49.67587 | 51.18321 | 51.57806 | 52.00173 | 51.57229 | 51.26679 | 51.86627 | 714.57964 | 23.05096 |
CX | EXC | 30 | 49.16286 | 51.17745 | 51.53771 | 52.20924 | 51.63646 | 51.30712 | 52.05644 | 667.59255 | 21.53524 |
CX | INS | 10 | 52.06225 | 53.46872 | 54.12007 | 55.50060 | 54.42113 | 53.91260 | 55.06257 | 1018.25457 | 32.84692 |
CX | INS | 20 | 49.43378 | 52.99605 | 54.24688 | 55.59282 | 54.28946 | 53.56378 | 54.96741 | 870.52058 | 28.08131 |
CX | INS | 30 | 51.26679 | 53.56959 | 54.81754 | 55.93291 | 54.81466 | 54.18348 | 55.38243 | 818.01102 | 26.38745 |
CX | INV | 10 | 51.26679 | 53.46007 | 54.40252 | 55.13169 | 54.28145 | 53.79733 | 54.85797 | 1031.82092 | 33.28455 |
CX | INV | 20 | 50.55203 | 52.97299 | 54.14889 | 55.07116 | 53.98365 | 53.41391 | 54.56969 | 878.18085 | 28.32841 |
CX | INV | 30 | 51.72216 | 53.48024 | 54.45439 | 54.87518 | 54.18346 | 53.72225 | 54.63600 | 829.36701 | 26.75377 |
CX2 | EXC | 10 | 50.03902 | 52.26400 | 53.00758 | 53.74828 | 53.02915 | 52.52047 | 53.52927 | 926.92980 | 29.90096 |
CX2 | EXC | 20 | 50.64426 | 52.53492 | 53.39378 | 54.41693 | 53.42838 | 52.90093 | 53.94423 | 753.77314 | 24.31526 |
CX2 | EXC | 30 | 49.29544 | 52.77989 | 53.46295 | 54.33335 | 53.53701 | 53.03640 | 54.04514 | 694.61395 | 22.40690 |
CX2 | INS | 10 | 53.13439 | 54.16042 | 56.07990 | 57.96191 | 56.13610 | 55.41990 | 57.08287 | 1075.41473 | 34.69080 |
CX2 | INS | 20 | 54.31029 | 55.98191 | 57.20392 | 58.14060 | 57.16501 | 56.58138 | 57.78034 | 901.75945 | 29.08901 |
CX2 | INS | 30 | 52.19483 | 54.17771 | 56.18942 | 57.41719 | 56.06261 | 55.23833 | 56.99064 | 844.93842 | 27.25608 |
CX2 | INV | 10 | 53.14016 | 55.37955 | 57.09440 | 59.13492 | 57.36532 | 56.37963 | 58.25307 | 1078.62075 | 34.79422 |
CX2 | INV | 20 | 52.62138 | 54.54662 | 55.90121 | 57.41719 | 55.97614 | 55.17492 | 56.76584 | 908.90025 | 29.31936 |
CX2 | INV | 30 | 52.78278 | 55.54959 | 56.89841 | 58.22418 | 56.89121 | 56.17213 | 57.59300 | 852.43323 | 27.49785 |
Table A7.
Instance 30-3. Statistical summary (runtimes in seconds).
Table A7.
Instance 30-3. Statistical summary (runtimes in seconds).
Combin. Method | Improv. Method | Local Search Size | min | Q1 | Median | Q2 | (Pseudo) Median | lb | ub | Total Runtimes | Mean Runtimes |
---|
PMX | EXC | 10 | 48.80548 | 50.31282 | 51.12269 | 52.18906 | 51.19762 | 50.66731 | 51.71063 | 878.12475 | 28.32660 |
PMX | EXC | 20 | 48.86888 | 50.24653 | 51.19762 | 51.78557 | 51.08802 | 50.69614 | 51.61267 | 737.05760 | 23.77605 |
PMX | EXC | 30 | 49.00146 | 50.82871 | 51.43972 | 52.25535 | 51.50893 | 51.06798 | 51.91244 | 687.98596 | 22.19310 |
PMX | INS | 10 | 49.34155 | 51.71928 | 52.65020 | 53.71081 | 52.75107 | 51.96426 | 53.35920 | 1034.64337 | 33.37559 |
PMX | INS | 20 | 49.98138 | 50.97858 | 52.12566 | 53.48024 | 52.35316 | 51.73365 | 52.97304 | 889.41709 | 28.69087 |
PMX | INS | 30 | 50.32146 | 52.02190 | 52.27553 | 53.74540 | 52.69156 | 52.18037 | 53.16895 | 839.41356 | 27.07786 |
PMX | INV | 10 | 50.75378 | 51.88068 | 52.77701 | 53.37937 | 52.60985 | 52.18330 | 53.03928 | 1044.30079 | 33.68712 |
PMX | INV | 20 | 50.32146 | 52.21212 | 52.89230 | 53.93562 | 52.99758 | 52.47434 | 53.56091 | 898.29205 | 28.97716 |
PMX | INV | 30 | 49.53177 | 51.54924 | 52.67902 | 53.77422 | 52.72513 | 52.09107 | 53.35055 | 849.39456 | 27.39982 |
OX | EXC | 10 | 49.30696 | 50.99876 | 51.77981 | 52.55509 | 51.83583 | 51.31862 | 52.39653 | 902.29349 | 29.10624 |
OX | EXC | 20 | 48.04460 | 50.21194 | 50.92094 | 51.39360 | 50.84456 | 50.44251 | 51.18033 | 746.78063 | 24.08970 |
OX | EXC | 30 | 49.35884 | 50.72784 | 51.75675 | 52.20636 | 51.53190 | 51.08230 | 51.93259 | 693.01672 | 22.35538 |
OX | INS | 10 | 48.37316 | 50.33587 | 50.93247 | 51.41378 | 50.88780 | 50.50015 | 51.25238 | 1047.95678 | 33.80506 |
OX | INS | 20 | 48.67290 | 49.97561 | 50.95552 | 52.28129 | 51.12845 | 50.58085 | 51.65011 | 898.56316 | 28.98591 |
OX | INS | 30 | 48.41928 | 50.44251 | 51.58959 | 52.44845 | 51.47142 | 50.92670 | 52.00749 | 843.49820 | 27.20962 |
OX | INV | 10 | 50.23500 | 51.75387 | 53.35920 | 54.48898 | 53.15313 | 52.50898 | 53.77134 | 1059.09986 | 34.16451 |
OX | INV | 20 | 50.18312 | 51.58670 | 52.55797 | 54.14025 | 52.80439 | 52.11989 | 53.38225 | 902.16492 | 29.10209 |
OX | INV | 30 | 49.44530 | 53.01046 | 53.50907 | 54.46016 | 53.54265 | 53.01046 | 54.09119 | 850.08570 | 27.42212 |
CX | EXC | 10 | 49.48565 | 50.92382 | 51.81439 | 52.36487 | 51.75675 | 51.25526 | 52.14295 | 868.52623 | 28.01698 |
CX | EXC | 20 | 48.88041 | 50.47421 | 51.70487 | 52.40234 | 51.55848 | 51.08527 | 52.07383 | 723.63057 | 23.34292 |
CX | EXC | 30 | 49.69893 | 50.71055 | 51.46854 | 52.58679 | 51.56590 | 51.08810 | 52.04494 | 674.05238 | 21.74363 |
CX | INS | 10 | 51.36478 | 53.25832 | 54.80025 | 55.67640 | 54.65565 | 53.92409 | 55.41418 | 1034.39624 | 33.36762 |
CX | INS | 20 | 50.30417 | 52.67326 | 54.29876 | 55.59859 | 54.42990 | 53.52059 | 55.25562 | 876.13563 | 28.26244 |
CX | INS | 30 | 51.71063 | 53.73387 | 55.01352 | 55.96750 | 54.90544 | 54.22383 | 55.49483 | 825.90955 | 26.64224 |
CX | INV | 10 | 51.52042 | 53.36208 | 54.66767 | 55.97614 | 54.69505 | 54.03649 | 55.37667 | 1040.66017 | 33.56968 |
CX | INV | 20 | 52.21788 | 54.01920 | 54.92706 | 55.78592 | 55.00488 | 54.51204 | 55.53518 | 885.35162 | 28.55973 |
CX | INV | 30 | 50.79989 | 53.96155 | 54.99046 | 55.87527 | 54.94723 | 54.32758 | 55.52077 | 836.78412 | 26.99304 |
CX2 | EXC | 10 | 50.10242 | 52.08531 | 53.34190 | 54.89536 | 53.43557 | 52.66749 | 54.18924 | 937.06006 | 30.22774 |
CX2 | EXC | 20 | 50.20041 | 52.57238 | 53.72234 | 54.74549 | 53.70649 | 53.03064 | 54.48321 | 764.68281 | 24.66719 |
CX2 | EXC | 30 | 49.74504 | 51.88933 | 53.54365 | 54.41981 | 53.26409 | 52.64732 | 54.01055 | 705.87219 | 22.77007 |
CX2 | INS | 10 | 50.43675 | 55.15763 | 56.20095 | 57.53824 | 56.22256 | 55.56400 | 56.93588 | 1071.65137 | 34.56940 |
CX2 | INS | 20 | 51.17456 | 54.32470 | 56.20671 | 57.95038 | 56.17357 | 55.27579 | 57.12034 | 904.03375 | 29.16238 |
CX2 | INS | 30 | 52.90959 | 55.56688 | 57.45754 | 59.60759 | 57.51518 | 56.47475 | 58.59597 | 845.40639 | 27.27117 |
CX2 | INV | 10 | 53.34767 | 56.06549 | 57.84951 | 59.19833 | 57.70828 | 56.74855 | 58.57580 | 1076.21986 | 34.71677 |
CX2 | INV | 20 | 54.40828 | 56.43440 | 57.59588 | 58.92165 | 57.78786 | 56.99640 | 58.69108 | 910.16465 | 29.36015 |
CX2 | INV | 30 | 52.94417 | 55.71099 | 56.89265 | 58.72278 | 56.89121 | 56.17213 | 57.59300 | 853.29243 | 27.52556 |