*5.3. Parameter Setting*

In MCR-Q(λ) learning, six parameters γ, λ, α, *q*0, *J* and *W*, have grea<sup>t</sup> influence on the effect of the algorithm [36]. After a large number of simulation tests using trial-and-error, all the parameters can be set as indicated in Table 1.

#### *5.4. Algorithm Flow of the OCECF*

Generally speaking, the algorithm flow of OCECF based on MCR-Q(λ) learning is shown in Algorithm 1.


14: Output: optimal variable *x* and corresponding optimal function value.


**Table 1.** Parameter setting of MCR-Q(λ) learning.
