Logistic Disjunctive Normal Networks

About

Logistic Disjunctive Normal Network (LDNN) is a novel classification scheme, which consists of one adaptive layer of feature detectors implemented by logistic sigmoid functions followed by two fixed layers of logical units that compute conjunctions and disjunctions, respectively. LDNN is a general binary classifier that is designed to find the classification function in disjunctive normal form. In short, LDNN forms the decision function by disjunction of conjunction of half-spaces defined by perceptrons and approximated by logistic neurons. The training is done by back-propagation of the error in order to minimize an objective function. LDNN achieves state-of-the-art results on general classification problems. It is a flexible and promising structure that can be used in a variety of structures for different machine learning tasks including regression, object recognition, scene labeling and shape modeling.

Introduction to LDNN

Related Work

Disjunctive Normal Shape Model

Disjunctive Normal Shape Model (DNSM) is a differentiable implicit and parametric shape model where the parameters of the model are the angles and positions of linear discriminants which form the boundary of the shape.

We evaluated performance of LDNN using several benchmark datasets on different classification tasks including general binary datasets and large computer vision and object recognition data such as MNIST, CIFAR10 and SVHN.

 

Cascaded Hierarchical Model which is an image segmentation and scene labeling framework, was tested on many different benchmark and practical data. It is being extensively used in segmentation of Electron Microscopy images

Our proposed structure for regression which we refer to as LPBN is a promising method. It is based on a new and effective set of basis functions. We evaluated its performance using different regression benchmarks.

 

© 2014

Scientific Computing and Imaging Institute