Approximate multiple kernel learning with least-angle regression

Stražar, Martin (avtor), Curk, Tomaž (avtor)

Kernel methods provide a principled way for general data representations. Multiple kernel learning and kernel approximation are often treated as separate tasks, with considerable savings in time and memory expected if the two are performed simultaneously. Our proposed Mklaren algorithm selectively approximates multiple kernel matrices in regression. It uses Incomplete Cholesky Decomposition and Least-angle regression (LAR) to select basis functions, achieving linear complexity both in the number of data points and kernels. Since it approximates kernel matrices rather than functions, it allows to combine an arbitrary set of kernels. Compared to single kernel-based approximations, it selectively approximates different kernels in different regions of the input spaces. The LAR criterion provides a robust selection of inducing points in noisy settings, and an accurate modelling of regression functions in continuous and discrete input spaces. Among general kernel matrix decompositions, Mklaren achieves minimal approximation rank required for performance comparable to using the exact kernel matrix, at a cost lower than 1% of required operations. Finally, we demonstrate the scalability and interpretability in settings with millions of data points and thousands of kernels.

• Jezik: Angleški jezik
• Ključne besede: kernel methods, kernel approximation, multiple kernel learning, least-angle regression
• Vrsta gradiva: Članek v reviji
• Tipologija: 1.01 - Izvirni znanstveni članek
• Organizacija: FRI - Fakulteta za računalništvo in informatiko
• Status publikacije: Objavljeno
• Različica publikacije: Objavljena publikacija
• Leto izida: 2019
• Št. strani: Str. 245-258
• Številčenje: Vol. 340
• PID: 20.500.12556/RUL-125566
• UDK: 004
• ISSN pri članku: 0925-2312
• DOI: 10.1016/j.neucom.2019.02.030
• COBISS.SI-ID: 1538162883
• Datum objave v RUL: 25.03.2021

Gradivo je del revije

• Naslov: Neurocomputing
• Skrajšan naslov: Neurocomputing
• Založnik: Elsevier
• ISSN: 0925-2312
• COBISS.SI-ID: 172315

Licence

• Licenca: CC BY 4.0, Creative Commons Priznanje avtorstva 4.0 Mednarodna
• Povezava: http://creativecommons.org/licenses/by/4.0/deed.sl
• Opis: To je standardna licenca Creative Commons, ki daje uporabnikom največ možnosti za nadaljnjo uporabo dela, pri čemer morajo navesti avtorja.
• Začetek licenciranja: 25.03.2021

Sekundarni jezik

• Jezik: Slovenski jezik
• Ključne besede: jedrne metode, aproksimacija jeder, učenje z več jedrnimi funkcijami, regresija najmanjših kotov