Simultaneous feature selection and clustering is a major challenge in unsupervised learning. In particular, there has been significant research into saliency measures for features that result in good clustering. However, as datasets become larger and more complex, there is a need to adopt a finer-grained approach to saliency by measuring it in relation to a part of a model. Another issue is learning the feature saliency and advanced model parameters. We address the first by presenting a novel Gaussian mixture model, which explicitly models the dependency of individual mixture components on each feature giving a new component-based feature saliency measure. For the second, we use Markov Chain Monte Carlo sampling to estimate the model and hidden variables. Using a synthetic dataset, we demonstrate the superiority of our approach, in terms of clustering accuracy and model parameter estimation, over an approach using a model-based feature saliency with expectation maximisation. We performed an evaluation of our approach with six synthetic trajectory datasets. To demonstrate the generality of our approach, we applied it to a network traffic flow dataset for intrusion detection. Finally, we performed a comparison with state-of-the-art clustering techniques using three real-world trajectory datasets of vehicle traffic.
|Number of pages||15|
|Journal||IEEE Transactions on Knowledge and Data Engineering|
|Early online date||22 Aug 2019|
|Publication status||Early online date - 22 Aug 2019|
Hong, X., Miller, P., Zhou, J., Li, L., Crookes, D., Lu, Y., Li, X., & Zhou, H. (2019). Component-based Feature Saliency for Clustering. IEEE Transactions on Knowledge and Data Engineering. https://doi.org/10.1109/TKDE.2019.2936847