Learning knowledge bases of multi-objective evolutionary fuzzy systems by simultaneously optimizing accuracy, complexity and partition integrity

Abstract  In the last few years, several papers have exploited multi-objective evolutionary algorithms (MOEAs) to generate Mamdani fuzzy
rule-based systems (MFRBSs) with different trade-offs between interpretability and accuracy. In this fra…

Abstract  

In the last few years, several papers have exploited multi-objective evolutionary algorithms (MOEAs) to generate Mamdani fuzzy
rule-based systems (MFRBSs) with different trade-offs between interpretability and accuracy. In this framework, a common approach
is to distinguish between interpretability of the rule base (RB), also known as complexity, and interpretability of fuzzy
partitions, also known as integrity of the database (DB). Typically, complexity has been used as one of the objectives of
the MOEAs, while partition integrity has been ensured by enforcing constraints on the membership function (MF) parameters.
In this paper, we propose to adopt partition integrity as an objective of the evolutionary process. To this aim, we first
discuss how partition integrity can be measured by using a purposely defined index based on the similarity between the partitions
learned during the evolutionary process and the initial interpretable partitions defined by an expert. Then, we introduce
a three-objective evolutionary algorithm which generates a set of MFRBSs with different trade-offs between complexity, accuracy
and partition integrity by concurrently learning the RB and the MF parameters of the linguistic variables. Accuracy is assessed
in terms of mean squared error between the actual and the predicted values, complexity is calculated as the total number of
conditions in the antecedents of the rules and integrity is measured by using the purposely defined index. The proposed approach
has been experimented on six real-world regression problems. The results have been compared with those obtained by applying
the same MOEA, but with only accuracy and complexity as objectives, both to learn only RBs, and to concurrently learn RBs
and MF parameters, with and without constraints on the parameter tuning. We show that our approach achieves the best trade-offs
between interpretability and accuracy. Finally, we compare our approach with a similar MOEA recently proposed in the literature.

  • Content Type Journal Article
  • Category Focus
  • Pages 1-20
  • DOI 10.1007/s00500-010-0665-0
  • Authors
    • Michela Antonelli, Dipartimento di Ingegneria dell’Informazione: Elettronica, Informatica, Telecomunicazioni, University of Pisa, Largo Lucio Lazzarino 1, 56122 Pisa, Italy
    • Pietro Ducange, Dipartimento di Ingegneria dell’Informazione: Elettronica, Informatica, Telecomunicazioni, University of Pisa, Largo Lucio Lazzarino 1, 56122 Pisa, Italy
    • Beatrice Lazzerini, Dipartimento di Ingegneria dell’Informazione: Elettronica, Informatica, Telecomunicazioni, University of Pisa, Largo Lucio Lazzarino 1, 56122 Pisa, Italy
    • Francesco Marcelloni, Dipartimento di Ingegneria dell’Informazione: Elettronica, Informatica, Telecomunicazioni, University of Pisa, Largo Lucio Lazzarino 1, 56122 Pisa, Italy

Connecting Community-Grids by supporting job negotiation with coevolutionary Fuzzy-Systems

Abstract  We utilize a competitive coevolutionary algorithm (CA) in order to optimize the parameter set of a Fuzzy-System for job negotiation
between Community-Grids. In a Community-Grid, users are submitting jobs to their local High Perform…

Abstract  

We utilize a competitive coevolutionary algorithm (CA) in order to optimize the parameter set of a Fuzzy-System for job negotiation
between Community-Grids. In a Community-Grid, users are submitting jobs to their local High Performance Computing (HPC) sites
over time. Now, we assume that Community-Grids are interconnected such that the exchange of jobs becomes possible: Each Community
strives for minimizing the response time for their own members by trying to distribute workload to other communities in the
Grid environment. For negotiation purpose, a Fuzzy-System is used to steer each site’s decisions whether to distribute or
accept workload in a beneficial, yet egoistic direction. In such a system, it is essential that communities can only benefit
if the workload is equitably (not necessarily equally) portioned among all participants. That is, if one community egoistically
refuses to execute foreign jobs regularly, other HPC sites suffer from overloading. This, on the long run, deteriorates the
opportunity to utilize them for job delegation. Thus, the egoistic community will degrade its own average performance. This
scenario is particularly suited for the application of a competitive CA: the Fuzzy-Systems of the participating communities
are modeled as species, which evolve in different populations while having to compete within the commonly shared ecosystem.
Using real workload traces and Grid setups, we show that the opportunistic cooperation leads to significant improvements for
both each community and the overall system.

  • Content Type Journal Article
  • Pages 1-13
  • DOI 10.1007/s00500-010-0667-y
  • Authors
    • Alexander Fölling, Robotics Research Institute, TU Dortmund University, 44221 Dortmund, Germany
    • Christian Grimme, Robotics Research Institute, TU Dortmund University, 44221 Dortmund, Germany
    • Joachim Lepping, Robotics Research Institute, TU Dortmund University, 44221 Dortmund, Germany
    • Alexander Papaspyrou, Robotics Research Institute, TU Dortmund University, 44221 Dortmund, Germany

Algorithms for computing the optimal transitive approximation of a proximity relation

Abstract  Three ways for generating the optimal transitive approximations or a suboptimal transitive approximation are given in this
paper. The first one can obtain all the optimal transitive approximations for any proximity relation. Howeve…

Abstract  

Three ways for generating the optimal transitive approximations or a suboptimal transitive approximation are given in this
paper. The first one can obtain all the optimal transitive approximations for any proximity relation. However, trying to find
all the optimal transitive approximations can be very expensive. The second one gives a method to obtain a suboptimal transitive
approximation which can frequently generate an optimal transitive approximation. Furthermore, starting from the transitive
closure the third method is proposed which can obtain a locally optimal transitive approximation. Finally, numerical experiments
are carried out to show the abilities of these algorithms and compare them to other existing approximation algorithms.

  • Content Type Journal Article
  • Pages 1023-1038
  • DOI 10.1007/s00500-010-0658-z
  • Authors
    • Guan Nan Deng, School of Sciences, Northeast Dianli University, Jilin, 132012 China
    • Kai Hu, School of Mathematical Sciences, Liaocheng University, Shandong, 252059 China
    • Hong Xing Li, School of Electronic and Information Engineering, Dalian University of Technology, Dalian, 116024 China

Chaos-based multi-objective immune algorithm with a fine-grained selection mechanism

Abstract  In this paper, we propose a chaos-based multi-objective immune algorithm (CMIA) with a fine-grained selection mechanism based
on the clonal selection principle. Taking advantage of the ergodic and stochastic properties of chaotic s…

Abstract  

In this paper, we propose a chaos-based multi-objective immune algorithm (CMIA) with a fine-grained selection mechanism based
on the clonal selection principle. Taking advantage of the ergodic and stochastic properties of chaotic sequence, a novel
mutation operator, named as chaos-based mutation (CM) operator, is proposed. Moreover, the information of diversity estimation
is also adopted in the CM operator for nondominated solutions to adjust mutation steps adaptively, which encourages searching
less-crowded regions with relative large step sizes. When comparing with polynomial mutation operator that is used in many
state-of-the-art multi-objective optimization evolutionary algorithms, simulations show that it is effective to enhance the
search performance. On the other hand, in order to increase the population diversity, a fine-grained selection mechanism is
proposed in this paper, which seems to be remarkably effective in two-objective benchmark functions. When comparing with two
state-of-the-art multi-objective evolutionary algorithms (NSGA-II and SPEA-2) and a new multi-objective immune algorithm (NNIA),
simulation results of CMIA indicate the effectiveness of the fine-grained selection mechanism and the remarkable performance
in finding the true Pareto-optimal front, especially on some benchmark functions with many local Pareto-optimal fronts.

  • Content Type Journal Article
  • Pages 1-16
  • DOI 10.1007/s00500-010-0661-4
  • Authors
    • Jianyong Chen, Department of Computer Science and Technology, Shenzhen University, Shenzhen, 518060 People’s Republic of China
    • Qiuzhen Lin, Department of Computer Science and Technology, Shenzhen University, Shenzhen, 518060 People’s Republic of China
    • Zhen Ji, Department of Computer Science and Technology, Shenzhen University, Shenzhen, 518060 People’s Republic of China

A note on group decision-making procedure based on incomplete reciprocal relations

Abstract  In a very recent paper by Xu and Chen (Soft Comput 12:515–521, 2008), a novel procedure for group decision making with incomplete reciprocal relations was developed. In this note, we examine
the function between the fuzzy prefere…

Abstract  

In a very recent paper by Xu and Chen (Soft Comput 12:515–521, 2008), a novel procedure for group decision making with incomplete reciprocal relations was developed. In this note, we examine
the function between the fuzzy preference relation and its corresponding priority vector developed by Xu and Chen with a numerical
example and show that the function does not hold in general cases. Then, we deduce an exact function between the additive
transitivity fuzzy preference relation and its corresponding priority vector. Based on this, we develop a procedure for the
decision making with an incomplete reciprocal relation and also develop a procedure for the group decision making with incomplete
reciprocal relations. In order to compare the performances of our method with Xu and Chen’s method in fitting the reciprocal
relation, we introduce some criteria. Theoretical analysis and numerical examples have shown that the function deduced by
us is more reasonable and effective than Xu and Chen’s.

  • Content Type Journal Article
  • Pages 1-12
  • DOI 10.1007/s00500-010-0662-3
  • Authors
    • Yejun Xu, Business School, HoHai University, Nanjing, 210098 Jiangsu China
    • Qingli Da, School of Economics and Management, Southeast University, Nanjing, 210096 Jiangsu China
    • Huimin Wang, Business School, HoHai University, Nanjing, 210098 Jiangsu China

Genetic fuzzy rule-based scheduling system for grid computing in virtual organizations

Abstract  One of the most challenging problems when facing the implementation of computational grids is the system resources effective
management commonly referred as to grid scheduling. A rule-based scheduling system is presented here to sc…

Abstract  

One of the most challenging problems when facing the implementation of computational grids is the system resources effective
management commonly referred as to grid scheduling. A rule-based scheduling system is presented here to schedule computationally
intensive Bag-of-Tasks applications on grids for virtual organizations. There exist diverse techniques to develop rule-base
scheduling systems. In this work, we suggest the joining of a gathering and sorting criteria for tasks and a fuzzy scheduling
strategy. Moreover, in order to allow the system to learn and thus to improve its performance, two different off-line optimization
procedures based on Michigan and Pittsburgh approaches are incorporated to apply Genetic Algorithms to the fuzzy scheduler
rules. A complex objective function considering users differentiation is followed as a performance metric. It not only provides
the conducted system evaluation process a comparison with other classical approaches in terms of accuracy and convergence
behaviour characterization, but it also analyzes the variation of a wide set of evolution parameters in the learning process
to achieve the best performance.

  • Content Type Journal Article
  • Pages 1-17
  • DOI 10.1007/s00500-010-0660-5
  • Authors
    • R. P. Prado, Telecommunication Engineering Department, Jaen University, Alfonso X el Sabio, 28 Linares, Jaen, Spain
    • S. García-Galán, Telecommunication Engineering Department, Jaen University, Alfonso X el Sabio, 28 Linares, Jaen, Spain
    • A. J. Yuste, Telecommunication Engineering Department, Jaen University, Alfonso X el Sabio, 28 Linares, Jaen, Spain
    • J. E. Muñoz Expósito, Telecommunication Engineering Department, Jaen University, Alfonso X el Sabio, 28 Linares, Jaen, Spain

Dependence-space-based attribute reduction in consistent decision tables

Abstract  This paper proposes a novel approach to attribute reduction in consistent decision tables within the framework of dependence
spaces. For a consistent decision table

(U,AÈ{d}),
an equivalence relation r on the conditional attrib…

Abstract  

This paper proposes a novel approach to attribute reduction in consistent decision tables within the framework of dependence
spaces. For a consistent decision table

(U,AÈ{d}),

an equivalence relation r on the conditional attribute set A and a congruence relation R on the power set of A are constructed, respectively. Two closure operators, T

r
and T

R
, and two families of closed sets,

Cr

and

CR,

are then constructed with respect to the two equivalence relations. After discussing the properties of

Cr

and

CR,

the necessary and sufficient condition for

Cr=CR

is obtained and employed to formulate an approach to attribute reduction in consistent decision tables. It is also proved,
under the condition

Cr=CR,

that a relative reduct is equivalent to a

R

-reduction defined by Novotny and Pawlak (Fundam Inform 16:275–287, 1992).

  • Content Type Journal Article
  • Pages 261-268
  • DOI 10.1007/s00500-010-0656-1
  • Authors
    • Ju-Sheng Mi, College of Mathematics and Information Science, Hebei Normal University, Shijiazhuang, 050016 Hebei People’s Republic of China
    • Yee Leung, Department of Geography and Resource Management, Center for Environmental Policy and Resource Management, and Institute of Space and Earth Information Science, The Chinese University of Hong Kong, Hong Kong, People’s Republic of China
    • Wei-Zhi Wu, School of Mathematics, Physics and Information Science, Zhejiang Ocean University, Zhoushan, 316004 Zhejiang People’s Republic of China

Fuzzy classification in dynamic environments

Abstract  The persistence and evolution of systems essentially depend on their adaptivity to new situations. As an expression of intelligence,
adaptivity is a distinguishing quality of any system that is able to learn and to adjust itself in…

Abstract  

The persistence and evolution of systems essentially depend on their adaptivity to new situations. As an expression of intelligence,
adaptivity is a distinguishing quality of any system that is able to learn and to adjust itself in a flexible manner to new
environmental conditions and such ability ensures self-correction over time as new events happen, new input becomes available,
or new operational conditions occur. This requires self-monitoring of the performance in an ever-changing environment. The
relevance of adaptivity is established in numerous domains and by versatile real-world applications. The present paper presents
an incremental fuzzy rule-based system for classification purposes. Relying on fuzzy min–max neural networks, the paper explains
how fuzzy rules can be continuously online generated to meet the requirements of non-stationary dynamic environments, where
data arrives over long periods of time. The approach proposed to deal with an ambient intelligence application. The simulation
results show its effectiveness in dealing with dynamic situations and its performance when compared with existing approaches.

  • Content Type Journal Article
  • Pages 1009-1022
  • DOI 10.1007/s00500-010-0657-0
  • Authors
    • Abdelhamid Bouchachia, Department of Informatics, University of Klagenfurt, Klagenfurt, Austria

Euler method for solving hybrid fuzzy differential equation

Abstract  In this paper, we study the numerical method for solving hybrid fuzzy differential using Euler method under generalized Hukuhara
differentiability. To this end, we determine the Euler method for both cases of H-differentiability. A…

Abstract  

In this paper, we study the numerical method for solving hybrid fuzzy differential using Euler method under generalized Hukuhara
differentiability. To this end, we determine the Euler method for both cases of H-differentiability. Also, the convergence
of the proposed method is studied and the characteristic theorem is given for both cases. Finally, some numerical examples
are given to illustrate the efficiency of the proposed method under generalized Hukuhara differentiability instead of suing
Hukuhara differentiability.

  • Content Type Journal Article
  • Pages 1-7
  • DOI 10.1007/s00500-010-0659-y
  • Authors
    • T. Allahviranloo, Department of Mathematics, Science and Research Branch, Islamic Azad University, Tehran, Iran
    • S. Salahshour, Department of Mathematics, Mobarakeh Branch, Islamic Azad University, Mobarakeh, Iran

Improving the performance of differential evolution algorithm using Cauchy mutation

Abstract  Differential evolution (DE) is a powerful yet simple evolutionary algorithm for optimization of real-valued, multimodal functions.
DE is generally considered as a reliable, accurate and robust optimization technique. However, the a…

Abstract  

Differential evolution (DE) is a powerful yet simple evolutionary algorithm for optimization of real-valued, multimodal functions.
DE is generally considered as a reliable, accurate and robust optimization technique. However, the algorithm suffers from
premature convergence and/or slow convergence rate resulting in poor solution quality and/or larger number of function evaluation
resulting in large CPU time for optimizing the computationally expensive objective functions. Therefore, an attempt to speed
up DE is considered necessary. This research introduces a modified differential evolution (MDE) that enhances the convergence
rate without compromising with the solution quality. The proposed MDE algorithm maintains a failure_counter (FC) to keep a tab on the performance of the algorithm by scanning or monitoring the individuals. Finally, the individuals that
fail to show any improvement in the function value for a successive number of generations are subject to Cauchy mutation with
the hope of pulling them out of a local attractor which may be the cause of their deteriorating performance. The performance
of proposed MDE is investigated on a comprehensive set of 15 standard benchmark problems with varying degrees of complexities
and 7 nontraditional problems suggested in the special session of CEC2008. Numerical results and statistical analysis show
that the proposed modifications help in locating the global optimal solution in lesser numbers of function evaluation in comparison
with basic DE and several other contemporary optimization algorithms.

  • Content Type Journal Article
  • Pages 991-1007
  • DOI 10.1007/s00500-010-0655-2
  • Authors
    • Musrrat Ali, Department of Paper Technology, Indian Institute of Technology Roorkee, Roorkee, 247667 India
    • Millie Pant, Department of Paper Technology, Indian Institute of Technology Roorkee, Roorkee, 247667 India