Skip to main content
SpringerLink
Log in

pClass+: A Novel Evolving Semi-Supervised Classifier

  • Published:
International Journal of Fuzzy Systems Aims and scope Submit manuscript

Abstract

A novel evolving semi-supervised classifier, namely Parsimonious Classifier+ (pClass+), is proposed in this paper. pClass+ enhances a recently developed classifier, namely pClass, for a semi-supervised learning scenario. As with its predecessor, pClass+ is capable of initiating its learning process from scratch with an empty rule base and adopts an open network structure, where fuzzy rules are evolved, pruned, and recalled automatically on demands. The novelty of pClass+ lies in an online active learning technique, which decreases operator’s annotation efforts and expedites its training process. pClass+ is also equipped with a new parameter identification strategy to cope with the class overlapping situation. The efficacy of pClass+ has been experimentally validated with numerous synthetic and real-world study cases, confirmed by thorough statistical tests and comparisons against state-of-the art classifiers, where pClass+ outperforms its counterparts in achieving the best trade-off between accuracy and complexity.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Notes

  1. http://moa.cms.waikato.ac.nz/datasets/.

  2. ftp://ncdc.noaa.gov/pub/data/gsod/.

  3. http://www.ics.uci.edu/mlearn/MLRepository.html.

References

  1. Maturino-Lozoya, H., Munoz-Rodriguez, D., Jaimes-Romera, F., Tawfik, H.: Handoff algorithms based on fuzzy classifiers. IEEE Trans. Veh. Technol. 49(6), 2286–2294 (2000)

    Article  Google Scholar 

  2. Santos, R., Dougherty, E., Jaakko, J.A.: Creating fuzzy rules for image classification using biased data clustering. In: SPIE Proceedings Series International Society for Optical Engineering, Society of Photo-Optical Instrumentation Engineers, Bellingham, WA, pp. 151–159 (1999)

  3. Lughofer, E.: On-line evolving image classifiers and their application to surface inspection. Image Vis. Comput. 28(7), 1065–1079 (2010)

    Article  Google Scholar 

  4. Vapnik, V.N.: The Statistical Learning Theory. Springer-Verlag, New York (1998)

    MATH  Google Scholar 

  5. Haykin, S.: Neural Networks: A Comprehensive Foundation, 2nd edn. Prentice Hall inc., Upper Saddle River (1999)

    MATH  Google Scholar 

  6. Huang, G.-B., Zhu, Q.-Y., Siew, C.-K.: Extreme learning machine: theory and applications. Neurocomputing 70(1–3), 489–501 (2006)

    Article  Google Scholar 

  7. Hastie, T., Tibshirani, R., Friedman, J.: The Elements of Statistical Learning: Data Mining, Inference and Prediction, 2nd edn. Springer, New York (2009)

    Book  MATH  Google Scholar 

  8. Bishop, C.M.: Pattern Recognition and Machine Learning. Springer, New York (2007)

    MATH  Google Scholar 

  9. Angelov, P., Filev, D.: An approach to online identification of Takagi-Sugeno fuzzy models. IEEE Trans. Syst. Man Cybern. B 34, 484–498 (2004)

    Article  Google Scholar 

  10. Lughofer, E., Buchtala, O.: Reliable all-pairs evolving fuzzy classifiers. IEEE Trans. Fuzzy Syst. 21(4), 625–641 (2013)

    Article  Google Scholar 

  11. Bouchachia, A.: An evolving classification cascade with self-learning. Evol. Syst. 1(3), 143–160 (2010)

    Article  Google Scholar 

  12. Bouchachia, A., Vanaret, C.: GT2FC: an online growing interval type-2 self-learning fuzzy classifier. IEEE Trans. Fuzzy Syst. 22(4), 999–1018 (2014)

    Article  Google Scholar 

  13. Subramanian, K., Das, A.K., Sundaram, S., Ramasamy, S.: Meta-cognitive interval type-2 fuzzy inference system and its projection-based learning algorithm. Syst. Evol. (2014). doi:10.1007/s12530-013-9102-9

    Google Scholar 

  14. Pratama, M., Anavatti, S., Lughofer, E.: Evolving fuzzy rule-based classifier based on GENEFIS. In: Proceedings of the IEEE Conference on Fuzzy Systems, Hyderabad, India (2013)

  15. Lughofer, E.: Evolving Fuzzy Systems—Methodologies, Advanced Concepts and Applications. Springer, Heidelberg (2011)

    Book  MATH  Google Scholar 

  16. Pratama, M., Lu, J., Anavatti, S.: Recurrent classifier based on an incremental meta-cognitive-based scaffolding algorithm. Submitted to IEEE Trans. Fuzzy Syst. (2014)

  17. Lughofer, E.: Single-pass active learning with conflict and ignorance. Evol. Syst. 3(4), 251–271 (2012)

    Article  Google Scholar 

  18. Pratama, M., Anavatti, S., Lughofer, E., Lim, C.-P.: gClass: an incremental meta-cognitive-based scaffolding theory. Submitted to a special issue on IEEE Comput. Intell. Mag. (2014)

  19. Subramanian, K., Savita, R. Suresh, S.: A meta-cognitive interval type-2 fuzzy inference system classifier and its projection based learning algorithm. In: Proceedings of the IEEE EAIS 2013 Workshop (SSCI 2013 Conference), Singapore, pp. 48–55 (2013)

  20. Pratama, M., Anavatti, S., Lughofer, E.: pClas, an effective classifier to streaming examples”. IEEE Trans. Fuzzy Syst. (2014). doi:10.1109/TFUZZ.2014.2312983

    Google Scholar 

  21. Pratama, M., Anavatti, S., Lughofer, E.: An incremental classification from data streams with parsimonious classifier. In: Proceeding of 8th Helenic Conference on Artificial Intelligence (2014)

  22. Lughofer, E.: On-line incremental feature weighting in evolving fuzzy classifiers. Fuzzy Sets Syst. 163(1), 1–23 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  23. Lemos, A., Caminhas, W., Gomide, F.: Multivariable Gaussian evolving fuzzy modeling system. IEEE Trans. Fuzzy Syst. 19(1), 91–104 (2011)

    Article  Google Scholar 

  24. Pratama, M., Anavatti, S., Lughofer, E.: Evolving fuzzy rule-based classifier based on GENEFIS. In: Proceedings of the IEEE Conference on Fuzzy Systems, Hyderabad, India (2013)

  25. Pratama, M., Anavatti, S., Angelov, P., Lughofer, E.: PANFIS: a novel incremental learning. IEEE Trans. Neural Netw. Learn. Syst. (online and in press) (2013)

  26. Pratama, M., Er, M.-J., Li, X., Oentaryo, R.J., Lughofer, E., Arifin, I.: Data driven modelling based on dynamic parsimonious fuzzy neural network. Neurocomputing 110, 18–28 (2013)

    Article  Google Scholar 

  27. Vigdor, B., Lerner, B.: The Bayesian ARTMAP. IEEE Trans. Neural Netw. 18(6), 1628–1644 (2007)

    Article  Google Scholar 

  28. Yap, K.S., Lim, C.P., Au, M.T.: Improved GART Neural network model for pattern classification and rule extraction with application to power system. IEEE Trans. Neural Netw. 22(12), 2310–2323 (2011)

    Article  Google Scholar 

  29. Rong, H.-J., Sundarajan, N., Huang, G.-B., Zhao, G.-S.: Extended sequential adaptive fuzzy inference system for classification problems. Evol. Syst. 2(2), 71–82 (2011)

    Article  Google Scholar 

  30. Wang, L., Ji, H.-B., Jin, Y.: Fuzzy passive-aggressive classification: a robust and efficient algorithm for online classification problems. Inf. Sci. 220, 46–63 (2013)

    Article  Google Scholar 

  31. Ditzler, G., Polikar, R.: Incremental learning of concept drift from streaming imbalanced data. IEEE Trans. Knowl. Data Eng. 25(10), 2283–2301 (2012)

    Article  Google Scholar 

  32. Bartett, F.C.: Remembering: A study in Experimental and Social Psychology. Cambridge University Press, Cambridge (1932)

    Google Scholar 

  33. Xu, Y., Wong, K.W., Leung, C.S.: Generalized recursive least square to the training of neural network. IEEE Trans. Neural Netw. 17(1), 19–34 (2006)

    Article  Google Scholar 

  34. Xiong, H., Swamy, M.N.S., Ahmad, M.O.: Optimizing the kernel in the empirical feature space. IEEE Trans. Neural Netw. 16(2), 460–474 (2005)

    Article  Google Scholar 

  35. K. Subramanian, S. Suresh, N. Sundararajan: A meta-cognitive neuro-fuzzy inference system (McFIS) for sequential classification systems. IEEE Trans. Fuzzy Syst. (on-line and in-press) (2013)

  36. Babu, G.S., Suresh, S.: Sequential projection-based metacognitive learning in a radial basis function network for classification problems. IEEE Trans. Neural Netw. Learn. Syst. 24(2), 194–206 (2013)

    Article  Google Scholar 

  37. Street, W.N., Kim, Y.: A streaming ensemble algorithm SEA for large- scale classification. In: Proceeding of 7th ACM SIGKDD, pp. 377–382 (2001)

  38. Zliobaite, I., Bifet, A., Pfahringer, B., Holmes, G.: Active Learning with drifting streaming data. IEEE Trans. Neural Netw. Learn. Syst. 25(1), 27–39 (2014)

    Article  Google Scholar 

  39. LMinku, L., Yao, X.: DDD: A new ensemble approach for dealing with drifts. IEEE Trans. Knowl. Data Eng. 24(4), 619–633 (2012)

    Article  Google Scholar 

  40. LMinku, L., White, A.P., Yao, X.: The impact of diversity on online ensemble learning in the presence concept of drift. IEEE Trans. Knowl. Data Eng. 22(5), 730–742 (2010)

    Article  Google Scholar 

  41. Pratama, M., Anavatti, S., Lughofer, E.: GENFIS: towards an effective localist network. IEEE Trans. Fuzzy Syst. (on line and in press) (2013)

  42. Liang, N.-Y., Huang, G.-B., Saratchandran, P., Sundararajan, N.: A fast and accurate on-line sequential learning algorithm for feedforward networks. IEEE Trans. Neural Networks 17(6), 1411–1423 (2006)

    Article  Google Scholar 

  43. Demsar, J.: Statistical comparisons of classifiers over multiple datasets. J. Mach. Learn. Res. 7, 1–30 (2006)

    MathSciNet  MATH  Google Scholar 

  44. Lughofer, E., Angelov, P.: Handling drifts and shifts in on-line data streams with evolving fuzzy systems. Appl. Soft Comput. 11(2), 2057–2068 (2011)

    Article  Google Scholar 

  45. Lughofer, E.: On-line active learning with enhanced reliability concepts. In: Proceedings of the IEEE EAIS (Evolving and Adaptive Intelligent Systems) Conference, Madrid (2012)

  46. Lee, C.C.: Fuzzy logic in control systems: Fuzzy logic controller. IEEE Trans. Syst. Man Cybern. pt. I, II 20, 404–436 (1990)

  47. Angelov, P., Lughofer, E., Zhou, X.: Evolving fuzzy classifiers using different model architectures. Fuzzy Sets Syst. 159(23), 3160–3182 (2008)

    Article  MathSciNet  MATH  Google Scholar 

Download references

Acknowledgments

The first author acknowledges the Latrobe university start-up grant and the UNSW publication fellowship. The second author also acknowledges support by the Austrian COMET-K2 programme of the Linz Center of Mechatronics (LCM), which is funded by the Austrian federal government and the federal state of Upper Austria. This publication reflects only the authors’ views.

Author information

Authors and Affiliations

  1. Department of Computer Science and IT, Latrobe University, Melbourne, VIC, 3083, Australia

    Mahardhika Pratama, Wenny Rahayu & Tharam Dillon

  2. Department of Knowledge-Based Mathematical Systems, Johannes Kepler University, Linz, Austria

    Edwin Lughofer

  3. Centre of Intelligent System Research, Deakin University, Geelong Waurn Ponds Campus, VIC, 3216, Burwood, Australia

    Chee Peng Lim

  4. School of Aerospace Mechanical and Manufacturing Engineering, Royal Melbourne Institute of Technology, Melbourne, Australia

    Agus Budiyono

Authors
  1. Mahardhika Pratama
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Edwin Lughofer
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chee Peng Lim
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Wenny Rahayu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Tharam Dillon
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Agus Budiyono
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mahardhika Pratama.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Pratama, M., Lughofer, E., Lim, C.P. et al. pClass+: A Novel Evolving Semi-Supervised Classifier. Int. J. Fuzzy Syst. 19, 863–880 (2017). https://doi.org/10.1007/s40815-016-0236-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40815-016-0236-3

Keywords

Search

Navigation