07-28-2023-1201 - A multilayer perceptron (MLP) (DRAFT)

From Wikipedia, the free encyclopedia

"MLP" is not to be confused with "NLP", which refers to natural language processing.

Part of a series on
Machine learning and data mining

Paradigms

Problems

Supervised learning (classification • regression)

Clustering

Dimensionality reduction

Structured prediction

Anomaly detection

Artificial neural network Autoencoder Cognitive computing Deep learning DeepDream Multilayer perceptron RNN LSTM GRU ESN reservoir computing Restricted Boltzmann machine GAN Diffusion model SOM Convolutional neural network U-Net Transformer Vision Spiking neural network Memtransistor Electrochemical RAM (ECRAM)

Reinforcement learning

Learning with humans

Model diagnostics

Mathematical foundations

Machine-learning venues

Related articles

v t e

A multilayer perceptron (MLP) is a fully connected class of feedforward artificial neural network (ANN). The term MLP is used ambiguously, sometimes loosely to mean any feedforward ANN, sometimes strictly to refer to networks composed of multiple layers of perceptrons (with threshold activation)^{[citation needed]}; see § Terminology. Multilayer perceptrons are sometimes colloquially referred to as "vanilla" neural networks, especially when they have a single hidden layer.^[1]

An MLP consists of at least three layers of nodes: an input layer, a hidden layer and an output layer. Except for the input nodes, each node is a neuron that uses a nonlinear activation function. MLP utilizes a chain rule^[2] based supervised learning technique called backpropagation or reverse mode of automatic differentiation for training.^{[3][4][5][6][7]} Its multiple layers and non-linear activation distinguish MLP from a linear perceptron. It can distinguish data that is not linearly separable.^[8] 

https://en.wikipedia.org/wiki/Multilayer_perceptron