A greedy layer-wise dictionary training algorithm based on genetic approach is presented to solve the problem of too large residual in sparse representation. The algorithm firstly changes the data samples to one-dimension vectors. Then the greedy layer-wise dictionary training algorithm is employed to separate the dictionary training problem into several sub-problems. When the proposed algorithm is used to train every dictionary layer
and a genetic approach is used to find the optimal solution in every dictionary layer with a high probability. Finally
each dictionary layer is connected to get the final dictionary. When one dictionary layer is trained
matrices with numbers are used to describe the classes. Then
the average residual energy of low rank approximations is used as a measure of fitness
and Winners are selected by matching. New individuals are generated by single point crossover and mutation. Experiments about the sparse representation of the short binary sequences show that the reconstruction SNR of the proposed algorithm is 10 or more times higher than that of traditional kernel singular value decomposition algorithms under the same sparsity constraint when the number of training data samples is small.
关键词
Keywords
references
RUBINSTEIN R, BRUCKSTEIN A M, ELAD M. Dictionaries for sparse representation modeling [J]. Proceedings of the IEEE, 2010, 98(6): 1045-1057.
CHEN S, DONOHO D, SAUNDERS M. Atomic decomposition by basis pursuit [J]. SIAM Journal on Scientific Computing, 1999, 20(1): 33-61.
AHARON M, ELAD M, BRUCKTEIN A. K-SVD: an algorithm for designing overcomplete dictionaries for sparse representation [J]. IEEE Transactions on Signal Processing, 2006, 54(11): 4311-4322.
LEE H, BATTLE A, RAINA R,et al.Efficient sparse coding algorithms [J]. Advances in Neural Information Processing Systems, 2007, 19(1), 801-808.
MAIRAL J, BACH F, PONCE J, et al. Online dictionary learning for sparse coding [C]∥Proceeding of ICML'09. Montreal, Canada: Association for Computing Machinery, 2009: 689-696.
MAIRAL J, SAPIRO G, ELAD M. Multiscale sparse image representation with learned dictionaries [C]∥Proceedings of ICIP'07. San Antonio, TX, USA: Society for Industrial and Applied Mathematics Publications, 2007: 214-241.
RUBINSTEIN R, ZIBULEVSKY M, ELAD M. Double sparsity: learning sparse dictionaries for sparse signal approximation [J]. IEEE Transactions of Signal Processing, 2010, 58(3):1553-1564.
XU Zongben, SUN Jian. Image inpainting by patch propagation using patch sparsity [J]. IEEE Transactions on Image Processing, 2010, 19(5): 1153-1165.
WANG Guodong, YANG Jianhong, LI Min, et al. Wideband noise removing algorithm based on adaptive sparse representation [J].Chinese Journal of Scientific Instrument, 2011, 32(8):1818-1823.
FENG Lang, WANG Ping, XU Tingfa, et al. Dual dictionary sparse restoration of blurred images [J]. Optics and Precision Engineering, 2011, 19(8):1982-1989.
AHARON M, ELAD M, BRUCKTEIN A. On the uniqueness of overcomplete dictionaries, and a practical way to retrieve them [J]. Linear Algebra and Its Applications, 2006, 416(1): 48-67.