Vizualizacija zvokov na podlagi podobnosti

Zupančič, Rok (author), Marolt, Matija (mentor)

Diplomska naloga govori o vizualizaciji zbirke zvočnih posnetkov po kriteriju medsebojne podobnosti. Produkt diplomskega dela je spletna aplikacija, ki vsebuje grafično vizualizacijo izračunanih podatkov in meta podatke opazovanih posnetkov. Delovno množico sestavljajo zvočni posnetki, ki smo jih pridobili s spletne strani projekta Work With Sounds ter nekaterih drugih. Najprej smo za vsak posnetek izračunali 27 nizkonivojskih značilk, na podlagi katerih smo določili podobnosti. Posnetke smo nato s hierarhičnem grozdenjem združili v gruče. Končno vizualizacijo smo izdelali z grafičnimi elementi SVG, ki jih na podlagi podatkov generira knjižnica D3 javascript. S slednjo smo realizirali tudi uporabniško interakcijo ter omogočili ogled slike zvoka in predvajanje posnetka. Vizualizacija temelji na predlogi "zoomable circle packing".

• Language: Unknown
• Keywords: zvok, vizualizacija, podobnost, d3.js
• Work type: Bachelor thesis/paper
• Organization: FRI - Faculty of Computer and Information Science
• Year: 2015
• PID: 20.500.12556/RUL-72182
• COBISS.SI-ID: 1536478147
• Publication date in RUL: 08.09.2015

Secondary language

• Language: Unknown
• Title: Similarity-based visualization of sounds

Abstract

The thesis focuses on the visualization of a collection of sound recordings by the criterion of mutual similarity. The product of the thesis is an online application, which includes a graphic visualization of the calculated data and metadata of the observed recordings. The studied group consists of sound recordings, which we acquired from the website of the Work With Sounds project and a few other sites. First we calculated 27 low-level features of each recording, which were the basis on which we determined the similarities. Then we used hierarchical clustering to combine the recordings into groups. The final visualization was made with SVG graphic elements, which are based on data and generated by the D3 JavaScript library. We used the library to realise the user interaction and make it possible to see the picture of sound and play the recording. The visualization is based on the zoomable circle packing method.

• Keywords: sound, visualization, similarity, d3.js