A Truly Online Learning Algorithm using Hybrid Fuzzy ARTMAP and Online Extreme Learning Machine for Pattern Classification

Shen Yuong Wong, Keem Siah Yap, Hwa Jen Yap, Shing Chiang Tan

Research output: Contribution to journalArticle

12 Citations (Scopus)

Abstract

This paper presents a Hybrid Fuzzy ARTMAP (FAM) and Online Extreme learning machine (OELM), hereafter denoted as FAM-OELM, which enables online learning to start from the first trained data samples without having to set up an initialization phase which requires a chunk of data samples to be ready prior to training. The idea of developing FAM-OELM is motivated by the ELM concept proposed by Huang et al., for being an efficient learning algorithm that provides better generalization performance at a much faster learning speed. However, different from the batch learning ELM and its variant called the online sequential extreme learning machine which still requires an initial offline training phase before it can turn into online training, the proposed FAM-OELM showcases a framework that enable online learning to commence right from the first data sample. Here, classification can be conducted at any time during the training phase. Such appealing feature of the proposed algorithm has strictly fulfilled the criteria of being truly sequential, while many of the existing algorithms are not. In addition, FAM-OELM automatically grows hidden neuron such that the network can accommodate new information without over fitting and compromising on the knowledge learnt earlier. The simulation results reveal the efficacy and validity of FAM-OELM when it is applied to a real world application and various benchmark problems.

Original languageEnglish
Pages (from-to)585-602
Number of pages18
JournalNeural Processing Letters
Volume42
Issue number3
DOIs
Publication statusPublished - 01 Dec 2015

Fingerprint

Learning algorithms
Pattern recognition
Learning systems
Learning
Benchmarking
Machine Learning
Neurons

All Science Journal Classification (ASJC) codes

  • Software
  • Neuroscience(all)
  • Computer Networks and Communications
  • Artificial Intelligence

Cite this

@article{d9c37f2e745d4e899f8d8e77d8ff8968,
title = "A Truly Online Learning Algorithm using Hybrid Fuzzy ARTMAP and Online Extreme Learning Machine for Pattern Classification",
abstract = "This paper presents a Hybrid Fuzzy ARTMAP (FAM) and Online Extreme learning machine (OELM), hereafter denoted as FAM-OELM, which enables online learning to start from the first trained data samples without having to set up an initialization phase which requires a chunk of data samples to be ready prior to training. The idea of developing FAM-OELM is motivated by the ELM concept proposed by Huang et al., for being an efficient learning algorithm that provides better generalization performance at a much faster learning speed. However, different from the batch learning ELM and its variant called the online sequential extreme learning machine which still requires an initial offline training phase before it can turn into online training, the proposed FAM-OELM showcases a framework that enable online learning to commence right from the first data sample. Here, classification can be conducted at any time during the training phase. Such appealing feature of the proposed algorithm has strictly fulfilled the criteria of being truly sequential, while many of the existing algorithms are not. In addition, FAM-OELM automatically grows hidden neuron such that the network can accommodate new information without over fitting and compromising on the knowledge learnt earlier. The simulation results reveal the efficacy and validity of FAM-OELM when it is applied to a real world application and various benchmark problems.",
author = "Wong, {Shen Yuong} and Yap, {Keem Siah} and Yap, {Hwa Jen} and Tan, {Shing Chiang}",
year = "2015",
month = "12",
day = "1",
doi = "10.1007/s11063-014-9374-5",
language = "English",
volume = "42",
pages = "585--602",
journal = "Neural Processing Letters",
issn = "1370-4621",
publisher = "Springer Netherlands",
number = "3",

}

A Truly Online Learning Algorithm using Hybrid Fuzzy ARTMAP and Online Extreme Learning Machine for Pattern Classification. / Wong, Shen Yuong; Yap, Keem Siah; Yap, Hwa Jen; Tan, Shing Chiang.

In: Neural Processing Letters, Vol. 42, No. 3, 01.12.2015, p. 585-602.

Research output: Contribution to journalArticle

TY - JOUR

T1 - A Truly Online Learning Algorithm using Hybrid Fuzzy ARTMAP and Online Extreme Learning Machine for Pattern Classification

AU - Wong, Shen Yuong

AU - Yap, Keem Siah

AU - Yap, Hwa Jen

AU - Tan, Shing Chiang

PY - 2015/12/1

Y1 - 2015/12/1

N2 - This paper presents a Hybrid Fuzzy ARTMAP (FAM) and Online Extreme learning machine (OELM), hereafter denoted as FAM-OELM, which enables online learning to start from the first trained data samples without having to set up an initialization phase which requires a chunk of data samples to be ready prior to training. The idea of developing FAM-OELM is motivated by the ELM concept proposed by Huang et al., for being an efficient learning algorithm that provides better generalization performance at a much faster learning speed. However, different from the batch learning ELM and its variant called the online sequential extreme learning machine which still requires an initial offline training phase before it can turn into online training, the proposed FAM-OELM showcases a framework that enable online learning to commence right from the first data sample. Here, classification can be conducted at any time during the training phase. Such appealing feature of the proposed algorithm has strictly fulfilled the criteria of being truly sequential, while many of the existing algorithms are not. In addition, FAM-OELM automatically grows hidden neuron such that the network can accommodate new information without over fitting and compromising on the knowledge learnt earlier. The simulation results reveal the efficacy and validity of FAM-OELM when it is applied to a real world application and various benchmark problems.

AB - This paper presents a Hybrid Fuzzy ARTMAP (FAM) and Online Extreme learning machine (OELM), hereafter denoted as FAM-OELM, which enables online learning to start from the first trained data samples without having to set up an initialization phase which requires a chunk of data samples to be ready prior to training. The idea of developing FAM-OELM is motivated by the ELM concept proposed by Huang et al., for being an efficient learning algorithm that provides better generalization performance at a much faster learning speed. However, different from the batch learning ELM and its variant called the online sequential extreme learning machine which still requires an initial offline training phase before it can turn into online training, the proposed FAM-OELM showcases a framework that enable online learning to commence right from the first data sample. Here, classification can be conducted at any time during the training phase. Such appealing feature of the proposed algorithm has strictly fulfilled the criteria of being truly sequential, while many of the existing algorithms are not. In addition, FAM-OELM automatically grows hidden neuron such that the network can accommodate new information without over fitting and compromising on the knowledge learnt earlier. The simulation results reveal the efficacy and validity of FAM-OELM when it is applied to a real world application and various benchmark problems.

UR - http://www.scopus.com/inward/record.url?scp=84952987391&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84952987391&partnerID=8YFLogxK

U2 - 10.1007/s11063-014-9374-5

DO - 10.1007/s11063-014-9374-5

M3 - Article

VL - 42

SP - 585

EP - 602

JO - Neural Processing Letters

JF - Neural Processing Letters

SN - 1370-4621

IS - 3

ER -