Scalable and Interpretable One-class SVMs with Deep Learning and Random Fourier Features

Minh-Nghia Nguyen, Vien Ngo

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

One-class support vector machine (OC-SVM) for a long time has been one of the most effective anomaly detection methods and extensively adopted in both research as well as industrial applications. The biggest issue for OC-SVM is yet the capability to operate with large and high-dimensional datasets due to optimization complexity. Those problems might be mitigated via dimensionality reduction techniques such as manifold learning or autoencoder. However, previous work often treats representation learning and anomaly prediction separately. In this paper, we propose autoencoder based one-class support vector machine (AE-1SVM) that brings OC-SVM, with the aid of random Fourier features to approximate the radial basis kernel, into deep learning context by combining it with a representation learning architecture and jointly exploit stochastic gradient descent to obtain end-to-end training. Interestingly, this also opens up the possible use of gradient-based attribution methods to explain the decision making for anomaly detection, which has ever been challenging as a result of the implicit mappings between the input space and the kernel space. To the best of our knowledge, this is the first work to study the interpretability of deep learning in anomaly detection. We evaluate our method on a wide range of unsupervised anomaly detection tasks in which our end-to-end training architecture achieves a performance significantly better than the previous work using separate training.
Original languageEnglish
Title of host publicationMachine Learning and Knowledge Discovery in Databases
PublisherSpringer
Pages157-172
ISBN (Electronic)978-3-030-10925-7
ISBN (Print)978-3-030-10924-0
DOIs
Publication statusEarly online date - 18 Jan 2019
EventEuropean Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases - Dublin, Ireland
Duration: 10 Sep 201814 Sep 2018

Publication series

NameLecture Notes in Computer Science
Volume11051
ISSN (Print)0302-9743

Conference

ConferenceEuropean Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases
CountryIreland
CityDublin
Period10/09/201814/09/2018

Fingerprint Dive into the research topics of 'Scalable and Interpretable One-class SVMs with Deep Learning and Random Fourier Features'. Together they form a unique fingerprint.

Cite this