Semi-supervised anomaly detection algorithm based on KL divergence (SAD-KL)

Understand

The unlabeled data are generally assumed to be normal data in detecting abnormal data via semisupervised learning.

• This assumption, however, causes inevitable detection error when distribution of unlabeled data is different from distribution of labeled normal dataset.
• To deal the problem caused by distribution gap between labeled and unlabeled data, we propose a semi-supervised anomaly detection algorithm using KL divergence (SAD-KL).
• The proposed SAD-KL is composed of two steps: (1) estimating KL divergence of probability density functions (PDFs) of the local outlier factors (LOFs) of the labeled normal data and the unlabeled data (2) estimating detection probability and threshold for detecting normal data in unlabeled data by using the KL divergence.