Abstract
Subspace Indexing with Interpolation (SIM-I) on Stiefel and Grassmann manifolds is proposed in this work. Given a partition of some original high-dimensional data set, SIM-I is constructed via two steps: in the first step we build linear affinity-aware subspace models based on each partition; in the second step we interpolate between several adjacent linear subspace models constructed in the first step using the 'center of mass' calculation on Stiefel and Grassmann manifolds. Through these two steps, SIM-I builds a globally nonlinear and smoothly regularized low-dimensional embedding model of the original data set. Furthermore, given sufficiently many training samples on the data manifold either labelled by some pre-trained learning model such as Deep Neural Networks (DNNs) or provided with original natural labels, we first apply SIM-I on this data set and then perform nearest-neighbor classification on the resulting low-dimensional embedding. This helps us to build a Lightweight Inference Engine (LIE) carrying similar level of feature extraction by the pre-trained learning model. For DNNs, such LIE can be interpreted as some (nonstandard) shallow neural network with a wide first hidden layer. From this perspective, SIM-I provides a way to exchange deep network for wide but shallow ones and may provide some new insights to interpret DNNs.
Original language | English (US) |
---|---|
Title of host publication | Proceedings - 2023 IEEE International Conference on Big Data, BigData 2023 |
Editors | Jingrui He, Themis Palpanas, Xiaohua Hu, Alfredo Cuzzocrea, Dejing Dou, Dominik Slezak, Wei Wang, Aleksandra Gruca, Jerry Chun-Wei Lin, Rakesh Agrawal |
Publisher | Institute of Electrical and Electronics Engineers Inc. |
Pages | 17-26 |
Number of pages | 10 |
ISBN (Electronic) | 9798350324457 |
DOIs | |
State | Published - 2023 |
Event | 2023 IEEE International Conference on Big Data, BigData 2023 - Sorrento, Italy Duration: Dec 15 2023 → Dec 18 2023 |
Publication series
Name | Proceedings - 2023 IEEE International Conference on Big Data, BigData 2023 |
---|
Conference
Conference | 2023 IEEE International Conference on Big Data, BigData 2023 |
---|---|
Country/Territory | Italy |
City | Sorrento |
Period | 12/15/23 → 12/18/23 |
Bibliographical note
Publisher Copyright:© 2023 IEEE.