APSIPA Transactions on Signal and Information Processing > Vol 13 > Issue 1

Locally-Structured Unitary Network

Yasas Godage, Niigata University, Japan, Eisuke Kobayashi, Niigata University, Japan, Shogo Muramatsu, Niigata University, Japan, shogo@eng.niigata-u.ac.jp
 
Suggested Citation
Yasas Godage, Eisuke Kobayashi and Shogo Muramatsu (2024), "Locally-Structured Unitary Network", APSIPA Transactions on Signal and Information Processing: Vol. 13: No. 1, e9. http://dx.doi.org/10.1561/116.00000308

Publication Date: 27 May 2024
© 2024 Y. Godage, E. Kobayashi and S. Muramatsu
 
Subjects
Denoising,  Dynamics,  Image and video processing,  Signal decompositions,  Signal reconstruction,  Sparse representations,  Subband and transform methods,  Filtering, estimation, identification,  Deep learning,  Dimensionality reduction
 
Keywords
Tangent space samplingshift-variabilityunitaritylinear transformsself-supervised learning
 

Share

Open Access

This is published under the terms of CC BY-NC.

Downloaded: 319 times

In this article:
Introduction 
Review of Linear Dimensional Reduction 
Locally-structured Unitary Network 
Construction Examples 
Performance Evaluation of LSUN 
Conclusion 
Convolutional Dictionary Learning 
Nonseparable Critically Sampled Lapped Transform (NSCLT) 
References 

Abstract

This paper proposes a novel learnable linear transform, locallystructured unitary network (LSUN), that captures tangent spaces of a manifold latent in high-dimensional data, enabling effective, systematic, and highly interpretable data-driven dimensionality reduction. LSUN provides a linear layer that has locally controllable filter kernels with shift-variability under the structural constraint of global unitary property. It is similar to a convolutional layer as the filter kernels share the properties of overlapping and locality, while fixed kernels are not repeated. The kernels can be trained in a self-supervised manner owing to the unitary property. The proposed method can be a candidate for realizing manifold learning. Although local selection of filter kernels, such as sparse modeling, can capture tangent spaces as a set of coordinates, the set of kernels is redundant, and the filters are not very interpretable. To address these problems, this study utilizes a method that locally controls coordinate axes by combining some primitive local linear operations that preserve unitarity, such as Givens rotation, shift, and butterfly operations. This study evaluates the ability to capture the tangent space of the proposed LSUN through low-dimensional approximation and dynamical system modeling experiments.

DOI:10.1561/116.00000308