Deep Low-Rank Multi-View Subspace Clustering

doi:10.7652/xjtuxb202111014

您当前的位置：

首页 >

文章列表页 >

Deep Low-Rank Multi-View Subspace Clustering

更新时间：2025-07-09

- Deep Low-Rank Multi-View Subspace Clustering
- Vol. 55, Issue 11, Pages: 125-135(2021)
- 作者机构：
  
  西安交通大学软件学院,西安,710049
- 作者简介：
- 基金信息：
- DOI：10.7652/xjtuxb202111014
  CLC： TP181
- Online First：10 November 2021，
  
  Published：2021
- 稿件说明：
移动端阅览
Deep Low-Rank Multi-View Subspace Clustering[J]. 2021, 55(11): 125-135.
DOI：

Deep Low-Rank Multi-View Subspace Clustering[J]. 2021, 55(11): 125-135. DOI： 10.7652/xjtuxb202111014.

摘要

针对目前深度多视角子空间聚类算法因为缺少对自表达矩阵的低秩表示约束而导致的模型缺乏鲁棒性的问题

提出了深度低秩多视角子空间聚类算法。在深度多视角子空间聚类算法的基础上

通过矩阵分解将自表达层分解为多视角一致性自表达层和单视角特异性自表达层

得到具有低秩线型约束的双层自表达模块; 强制所有视角的一致性自表达层的参数相同、特异性自表达层的参数各不相同

充分利用多视角数据的互补性; 将自表达模块嵌入到每个视角的深度自编码器中

得到可以通过反向传播算法求解的深度低秩多视角子空间聚类模型; 在深度模型训练中

一致性自表达层学习多视角数据的一致性信息

特异性自表达层学习单个视角的独特信息

双层自表达模块隐性地添加了低秩表示约束。6个公开数据集上的实验结果表明:与深度多视角子空间聚类算法相比

所提算法的聚类正确率平均提升了0.064

标准化互信息提升了0.064; 所提算法的正确率和标准化互信息优于其他11种先进聚类算法的

聚类正确率最大提升了0.097

标准化互信息最大提升了0.103。

Abstract

To deal with the problem that the current deep multi-view subspace clustering methods lack robustness due to the lack of low-rank representation constraints on the self-representation matrix

we propose a novel deep low-rank multi-view subspace clustering(DLRMSC)method. Based on the deep multi-view subspace clustering algorithm

the self-expression layer is split into two low-rank linear self-expression layers: the commonly shared self-expression layer and the view-specific self-expression layer

which becomes a double-layer self-expression module with low-rank constraint. To make full use of the complementarity of multi-view data

the parameters of the commonly shared self-expression layer are forced to be the same

but the parameters of specific self-expression layer are different. We embed the self-expression module in the middle of the deep auto-encoder of each view

so as to obtain a deep low-rank multi-view subspace clustering model which can be solved by backpropagation. In the training stage

the commonly shared self-expression layer extracts the common information of multi-view data

the view-specific self-expression layer extracts the specific information of each view

and the double-layer self-expression module guarantees low-rank representation constraint. The experimental results on six public datasets show that compared with the deep multi-view subspace clustering algorithm

the clustering accuracy and normalized mutual information(NMI)of this proposed method on six datasets are significantly improved

where the average accuracy is increased by 0.064 and the average NMI is increased by 0.064. The DLRMSC method substantially outperforms the eleven comparative state-of-the-art clustering methods

and its accuracy is increased by 0.097 and NMI is increased by 0.103 at most.

关键词

Keywords

references

VIDAL R. Subspace clustering [J]. IEEE Signal Processing Magazine, 2011, 28(2): 52-68.

LAUER F, SCHNÖRR C. Spectral clustering of linear subspaces for motion segmentation [C]∥Proceedings of the 2009 IEEE 12th International Conference on Computer Vision. Piscataway, NJ, USA: IEEE, 2009: 678-685.

RAO S, TRON R, VIDAL R, et al. Motion segmentation in the presence of outlying, incomplete, or corrupted trajectories [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2010, 32(10): 1832-1845.

CAO Xiaochun, ZHANG Changqing, FU Huazhu, et al. Diversity-induced multi-view subspace clustering [C]∥Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition(CVPR). Piscataway, NJ, USA: IEEE, 2015: 586-594.

ZHANG Changqing, FU Huazhu, LIU Si, et al. Low-rank tensor constrained multiview subspace clustering [C]∥Proceedings of the 2015 IEEE International Conference on Computer Vision(ICCV). Piscataway, NJ, USA: IEEE, 2015: 1582-1590.

NTOUTSI E, STEFANIDIS K, RAUSCH K, et al. “Strength lies in differences”: diversifying friends for recommendations through subspace clustering [C]∥Proceedings of the 23rd ACM International Conference on Information and Knowledge Management. New York, USA: ACM, 2014: 729-738.

ZHANG A, FAWAZ N, IOANNIDIS S, et al. Guess who rated this movie: identifying users through subspace clustering[EB/OL]. [2021-01-01]. https: ∥arxiv.org/abs/1408.2055.

武继刚, 陈招红, 孟敏, 等. 基于低秩稀疏表示的子空间学习研究综述 [J]. 华中科技大学学报(自然科学版), 2021, 49(2): 1-19.

WU Jigang, CHEN Zhaohong, MENG Min, et al. Survey of subspace learning via low-rank sparse representation [J]. Journal of Huazhong University of Science and Technology(Natural Science Edition), 2021, 49(2): 1-19.

LI Chunguang, VIDAL R. Structured sparse subspace clustering: a unified optimization framework [C]∥Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition(CVPR). Piscataway, NJ, USA: IEEE, 2015: 277-286.

YOU Chong, ROBINSON D P, VIDAL R. Scalable sparse subspace clustering by orthogonal matching pursuit [C]∥Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition(CVPR). Piscataway, NJ, USA: IEEE, 2016: 3918-3927.

ELHAMIFAR E, VIDAL R. Sparse subspace clustering: algorithm, theory, and applications [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2013, 35(11): 2765-2781.

LIU Guangcan, LIN Zhouchen, YAN Shuicheng, et al. Robust recovery of subspace structures by low-rank representation [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2013, 35(1): 171-184.

WANG Yuxiang, XU Huan, LENG Chenlei. Provable subspace clustering: when LRR meets SSC [J]. IEEE Transactions on Information Theory, 2019, 65(9): 5406-5432.

JI Pan, ZHANG Tong, LI Hongdong, et al. Deep subspace clustering networks [C]∥Proceedings of the 31st Annual Conference on Neural Information Processing Systems(NIPS). Vancouver, Canada: NIPS, 2017: 24-33.

KHEIRANDISHFARD M, ZOHRIZADEH F, KAMANGAR F. Deep low-rank subspace clustering [C]∥Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops(CVPRW). Piscataway, NJ, USA: IEEE, 2020: 3776-3781.

ZHAO Jing, XIE Xijiong, XU Xin, et al. Multi-view learning overview: recent progress and new challenges [J]. Information Fusion, 2017, 38: 43-54.

LOWE D G. Distinctive image features from scale-invariant keypoints [J]. International Journal of Computer Vision, 2004, 60(2): 91-110.

OJALA T, PIETIKAINEN M, MAENPAA T. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002, 24(7): 971-987.

DALAL N, TRIGGS B. Histograms of oriented gradients for human detection [C]∥Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition(CVPR). Piscataway, NJ, USA: IEEE, 2005: 886-893.

XIA Rongkai, PAN Yan, DU Lei, et al. Robust multi-view spectral clustering via low-rank and sparse decomposition [C]∥Proceedings of the 28th AAAI Conference on Artificial Intelligence. Palo Alto, CA, USA: AAAI, 2014: 2149-2155.

ZHANG Changqing, HU Qinghua, FU Huazhu, et al. Latent multi-view subspace clustering [C]∥Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition(CVPR). Piscataway, NJ, USA: IEEE, 2017: 4333-4341.

LUO Shirui, ZHANG Changqing, ZHANG Wei, et al. Consistent and specific multi-view subspace clustering [C]∥Proceedings of the 32nd AAAI Conference on Artificial Intelligence. Palo Alto, CA, USA: AAAI, 2018: 3730-3737.

ABAVISANI M, PATEL V M. Deep multimodal subspace clustering networks [J]. IEEE Journal of Selected Topics in Signal Processing, 2018, 12(6): 1601-1614.

ZHANG Changqing, LIU Yeqing, FU Huazhu. AE2-nets: autoencoder in autoencoder networks [C]∥Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR). Piscataway, NJ, USA: IEEE, 2019: 2572-2580.

LUXBURG U. A tutorial on spectral clustering [J]. Statistics and Computing, 2007, 17(4): 395-416.

ZHU Wencheng, LU Jiwen, ZHOU Jie. Structured general and specific multi-view subspace clustering [J]. Pattern Recognition, 2019, 93: 392-403.

DANG Zhiyuan, DENG Cheng, YANG Xu, et al. Multi-scale fusion subspace clustering using similarity constraint [C]∥Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR). Piscataway, NJ, USA: IEEE, 2020: 6657-6666.

ZHANG Xianchao, MU Jie, ZONG Linlin, et al. End-to-end deep multimodal clustering [C]∥Proceedings of the 2020 IEEE International Conference on Multimedia and Expo(ICME). Piscataway, NJ, USA: IEEE, 2020: 1-6.

ZHOU Runwu, SHEN Yidong. End-to-end adversarial-attention network for multi-modal clustering [C]∥Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR). Piscataway, NJ, USA: IEEE, 2020: 14607-14616.

何士豪, 张玉龙, 唐启凡. 互补与一致的多视角子空间聚类网络 [J]. 西安交通大学学报, 2021, 55(7): 166-178.

He Shihao, ZHANG Yulong, TANG Qifan. Complementary and consistent multi view subspace clustering network [J]. Journal of Xi'an Jiaotong University, 2021, 55(7): 166-178.

NIE Feiping, LI Jing, LI Xuelong. Parameter-free auto-weighted multiple graph learning: a framework for multiview clustering and semi-supervised classification [C]∥Proceedings of the 25th International Joint Conference on Artificial Intelligence. Sacramento, CA, USA: IJCAI, 2016: 1881-1887.

BRBIAC'U M, KOPRIVA I. Multi-view low-rank sparse subspace clustering [J]. Pattern Recognition, 2018, 73: 247-258.

ZHENG Qinghai, ZHU Jihua, TIAN Zhiqiang, et al. Constrained bilinear factorization multi-view subspace clustering [J]. Knowledge-Based Systems, 2020, 194: 105514.

OLSHAUSEN B A, FIELD D J. Emergence of simple-cell receptive field properties by learning a sparse code for natural images [J]. Nature, 1996, 381: 607-609.

LI Feifei, FERGUS R, PERONA P. Learning generative visual models from few training examples: an incremental Bayesian approach tested on 101 object cate-gories [J]. Computer Vision and Image Understanding, 2007, 106(1): 59-70.

KUHN H W. The Hungarian method for the assignment problem [J]. Naval Research Logistics Quarterly, 1955, 2(1/2): 83-97.

KUMAR A, RAI P, DAUME H. Co-regularized multi-view spectral clustering [C]∥Proceedings of the 25th Annual Conference on Neural Information Processing Systems(NIPS). Vancouver, Canada: NIPS, 2011: 1413-1421.

ZHU Pengfei, HUI Binyuan, ZHANG Changqing, et al. Multi-view deep subspace clustering networks [EB/OL]. [2021-01-01]. https: ∥arxiv.org/abs/1908.01978.

WANG Qianqian, CHENG Jiafeng, GAO Quanxue, et al. Deep multi-view subspace clustering with unified and discriminative learning [J/OL]. IEEE Transactions on Multimedia. [2021-01-01]. https: ∥ieeexplore.ieee.org/stamp/stamp.jsp?tp=arnumber=9204408.

KINGMA D, BA J. Adam: a method for stochastic optimization [C/OL]∥Proceedings of the 2015 International Conference on Learning Representations. London, UK: ICLR, 2015. [2021-01-01]. https: ∥arxiv.org/pdf/1412.6980v8.pdf.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

A Robust Subspace Clustering Algorithm

A Matrix Factorization Algorithm with Hybrid Implicit and Explicit Attributes for Recommender Systems

Singular Value Decomposition Recommendation Algorithm Considering User's Preference for Item Attributes

A Recommendation Algorithm Trading off Performance and Privacy Protection

Individual Identification Method of Communication Emitters Using Polarization Feature

Related Author

张军英

彭柳青

张志勇 2

彭勤科 1

赵长伟 1

张猛

李林峰

Related Institution

School of Computer Science and Engineering, Xidian University

School of Electronic and Information Engineering, Xi'an Jiaotong University

School of Information and Engineering, Henan University of Science and Technology

School of Computer and Information Technology, Beijing Jiaotong University

西安交通大学电子与信息学部

⁰