MACS: Multi-Annotator Captioned Soundscapes

captions

General information

Label Value Description
Name MACS: Multi-Annotator Captioned Soundscapes Full dataset name
ID captions/macs Datalist id for external indexing
Abbreviation MACS Official dataset abbreviation, e.g. one used in the original paper
Provider TAU
Year 2021 Dataset release year
Modalities Audio Data modalities included in the dataset
Collection name MACS Common name for all related datasets, used to group datasets coming from same source
Research domain Captioning Scenes Multi-annotator Related domains, e.g., Scenes, Mobile devices, Audio-visual, Open set, Ambient noise, Unlabelled, Multiple sensors, SED, SELD, Tagging, FL, Strong annotation, Weak annotation, Unlabelled, Multi-annotator
Related datasets name
License Free
Download Download (2.8MB)
Citation [Martin2021] Diversity and bias in audio captioning datasets

Audio

Label Value Description

Data

Data type Audio Possible values: Audio | Features
File format
File format type Constant Possible values: Constant | Variable
File format wav Possible value: wav | aiff | flac | mp3 | aac | ogg
Lossy compression No is audio compressed in a lossy manner
Bit rate 24 Bit depth of audio, possible values: 8 | 16 | 24 | 32
Sampling rate (kHz) 48 kHz Sampling rate in kHz, possible values: 8 | 16 | 22.05 | 32 | 44.1 | 48
Channels
Setup Binaural Possible values: Mono | Stereo | Binaural | Ambisonic | Array | Multi-Channel | Variable
Number of channels 2
Material
Source TAU-ASC2019-DEV Possible values: Original | Youtube | Freesound | Online | Crowdsourced | [Dataset name]
Variability sources Country City Location Position Possible values: Country | City | Location | Position | Device

Content

Content type Freefield Possible values: Freefield | Synthetic | Isolated
Scene Constant Is the scene class constant for single recording, possible values: Constant | Variable

Recording

Setup Uncontrolled Possible values: Near-field | Far-field | Mixed | Uncontrolled | Unknown
Setup count 1 Amount of different recording setups (microphone and recording device) used
Spot type Fixed Possible values: Fixed | Moving | Unknown

Files

Count 3920 files Total number of files
Total duration (minutes) 653.333333333 min Total duration of the dataset in minutes
File length Constant Characterization of the file lengths, possible values: Constant | Quasi-constant | Variable
File length (seconds) 10 sec Approximate length of files

Meta

Label Value Description
Types Tag Scene Caption List of meta data types provided for the data, possible values: Event, Tag, Scene, Caption, Geolocation, Spatial location, Annotator, Timestamp, Presence, Proximity, etc.

Scene

Classes 10 Number of scene classes
Classes True Possible values: True | False | Almost
Classes
  • airport
  • bus
  • metro station
  • metro
  • park
  • public square
  • shopping mall
  • street traffic
  • street pedestrian
  • tram

Event

Classes 10 Number of event classes
Classes False Possible values: True | False | Almost
Annotation
Type Weak Possible values: Strong | Weak | Location | None
Source Crowdsourced Possible values: Experts | Crowdsourced | Synthetic | Metadata | Automatic
Annotations per item 5 How many annotations there are available per item (possible multi-annotator setup)
Labelled amount (%) 100 % Percentage of all data, amount of data which is labelled
Strong annotations amount (%) 0 % Percentage of all data, amount of data which has strong annotations
Labeling
Hierarchical No
Instance

Caption

Annotation
Languages English Languages used for annotation
Source Crowdsourced Possible values: Experts | Crowdsourced | Synthetic | Metadata | Automatic
Captions per item 5 How many annotations there are available per item (possible multi-annotator setup)

Cross-validation setup

Label Value Description
Provided No