An improved differential evolution algorithm in training and encoding prior knowledge into feedforward networks with application in chemistry

• Published in: Chemometrics and intelligent laboratory systems 2002-10, Vol.64 (1), p.27-43
• Main Authors: Chen, Chong-wei, Chen, De-zhao, Cao, Guang-zhi
• Format: Article
• Language: English
• Subjects: Feedforward network; Flip operation; Improved differential evolution; Levenberg–Marquardt descent strategy; Prior knowledge; Random perturbation strategy
• ISSN: 0169-7439; 1873-3239
• DOI: 10.1016/S0169-7439(02)00048-5

Prior-knowledge-based feedforward networks have shown superior performance in modeling chemical processes. In this paper, an improved differential evolution (IDEP) algorithm is proposed to encode prior knowledge simultaneously into networks in training process. With regard to monotonic prior knowledge, IDEP algorithm employs a flip operation to adjust those prior-knowledge-violating networks to conform to the monotonicity. In addition, two strategies, Levenberg–Marquardt descent (LMD) strategy and random perturbation (RP) strategy, are adopted to speed up the differential evolution (DE) in the algorithm and prevent it from being trapped by some local minimums, respectively. To demonstrate the IDEP algorithm's efficiency, we apply it to model two chemical curves with the increasing monotonicity constraint. For comparison, four network-training algorithms without prior-knowledge constraints, as well as three existing prior-knowledge-based algorithms (which have some relationship and similarities with IDEP algorithm), are employed to solve the same problems. The simulation results show that IDEP's performance is better than all other algorithms. As a conclusion, IDEP algorithm and its promising prospective will be discussed in detail at the end of this paper.