Adaptive data-driven subsampling for efficient neural network inference

Machidon, Alina Luminita (author), Pejović, Veljko (author)

In this paper we present a novel data-driven subsampling method that can be seamlessly integrated into any neural network architecture to identify the most informative subset of samples within the original acquisition domain for a variety of tasks that rely on deep learning inference from sampled signals. In contrast to existing methods that require signal transformation into a sparse basis, expensive signal reconstruction as an intermediate step, and that can support a single predefined sampling rate only, our approach allows the sampling inference pipeline to adapt to multiple sampling rates directly in the original signal domain. The key innovations enabling such operation are a custom subsampling layer and a novel training mechanism. Through extensive experiments with four data sets and four different network architectures, our method demonstrates a simple yet powerful sampling strategy that allows the given network to be efficiently utilized at any given sampling rate, while the inference accuracy degrades smoothly and gradually as the sampling rate is reduced. Experimental comparison with state-of-the-art sparse sensing and learning techniques demonstrates competitive inference accuracy at different sampling rates, coupled with a significant improvement in computational efficiency, and the crucial ability to operate at arbitrary sampling rates without the need for retraining.

• Language: English
• Keywords: nonuniform sampling, compressive sensing, deep learning, EEG classification, speech recognition, image classification
• Work type: Article
• Typology: 1.01 - Original Scientific Article
• Organization: FRI - Faculty of Computer and Information Science
• Publication status: Published
• Publication version: Version of Record
• Year: 2024
• Number of pages: Str. 5163-5171
• Numbering: Vol. 18, iss. 6/7
• PID: 20.500.12556/RUL-159774
• UDC: 004
• ISSN on article: 1863-1703
• DOI: 10.1007/s11760-024-03223-z
• COBISS.SI-ID: 199953155
• Publication date in RUL: 24.07.2024

Record is a part of a journal

• Title: Signal, image and video processing
• Publisher: Springer Nature
• ISSN: 1863-1703
• COBISS.SI-ID: 13373718

Licences

• License: CC BY 4.0, Creative Commons Attribution 4.0 International
• Link: http://creativecommons.org/licenses/by/4.0/
• Description: This is the standard Creative Commons license that gives others maximum freedom to do what they want with the work as long as they credit the author.

Secondary language

• Language: Slovenian
• Keywords: neenakomerno vzorčenje, kompresijsko zaznavanje, globoko učenje, klasifikacija EEG, prepoznavanje govora, klasifikacija slike