Urban Sound & Sight

sounds
Download Site Fuentes2022

General information

Label Value Description
Name Urban Sound & Sight Full dataset name
ID sounds/urbansas Datalist id for external indexing
Abbreviation Urbansas Official dataset abbreviation, e.g. one used in the original paper
Provider NYU
Year 2022 Dataset release year
Modalities Audio Video Data modalities included in the dataset
Collection name Urbansas Common name for all related datasets, used to group datasets coming from same source
Research domain SED Strong annotation Related domains, e.g., Scenes, Mobile devices, Audio-visual, Open set, Ambient noise, Unlabelled, Multiple sensors, SED, SELD, Tagging, FL, Strong annotation, Weak annotation, Unlabelled, Multi-annotator
Related datasets name
License
  • Non-commercial
Download Download (9.6 GB)
Companion site Site Link to the companion site for the dataset
Citation [Fuentes2022] Urban Sound & Sight: Dataset And Benchmark For Audio-Visual Urban Scene Understanding

Audio

Label Value Description

Data

Data type Audio Possible values: Audio | Features
File format
File format type Constant Possible values: Constant | Variable
File format wav Possible value: wav | aiff | flac | mp3 | aac | ogg
Lossy compression No is audio compressed in a lossy manner
Bit rate 24 Bit depth of audio, possible values: 8 | 16 | 24 | 32
Sampling rate (kHz) 48 kHz Sampling rate in kHz, possible values: 8 | 16 | 22.05 | 32 | 44.1 | 48
Channels
Setup Binaural Possible values: Mono | Stereo | Binaural | Ambisonic | Array | Multi-Channel | Variable
Number of channels 2
Material
Source MAVD TAU-UAVS2021-DEV Possible values: Original | Youtube | Freesound | Online | Crowdsourced | [Dataset name]

Content

Content type Freefield Possible values: Freefield | Synthetic | Isolated
Scene Constant Is the scene class constant for single recording, possible values: Constant | Variable

Recording

Setup Uncontrolled Possible values: Near-field | Far-field | Mixed | Uncontrolled | Unknown
Setup count 2 Amount of different recording setups (microphone and recording device) used
Spot type Fixed Possible values: Fixed | Moving | Unknown

Files

Count 1080 files Total number of files
Total duration (minutes) 179 min Total duration of the dataset in minutes
File length Constant Characterization of the file lengths, possible values: Constant | Quasi-constant | Variable
File length (seconds) 10 sec Approximate length of files

Meta

Label Value Description
Types Event List of meta data types provided for the data, possible values: Event, Tag, Scene, Caption, Geolocation, Spatial location, Annotator, Timestamp, Presence, Proximity, etc.

Event

Classes 5 Number of event classes
Classes False Possible values: True | False | Almost
Classes
  • car
  • offscreen
  • motorbike
  • bus
  • truck
Annotation
Type Strong Possible values: Strong | Weak | Location | None
Source Experts Possible values: Experts | Crowdsourced | Synthetic | Metadata | Automatic
Annotations per item 1 How many annotations there are available per item (possible multi-annotator setup)
Labelled amount (%) 100 % Percentage of all data, amount of data which is labelled
Validated amount (%) 100 % Percentage of all data, amount of data which is validated by human
Strong annotations amount (%) 100 % Percentage of all data, amount of data which has strong annotations
Overlapping event instances Yes
Labeling
Hierarchical No
Instance
Count 1957 Count of all event instances in the dataset
Average instances per class 391.4 Average per class instance count

Cross-validation setup

Label Value Description
Provided No

Baseline

Label Value Description
Download Download Link to baseline system source code
Citation [Fuentes2022] Paper to cite for the baseline