General information | |||||
| Label | Value | Description | |||
|---|---|---|---|---|---|
| Name | AVE: The Audio-Visual Event Dataset | Full dataset name | |||
| ID | sounds/ave | Datalist id for external indexing | |||
| Abbreviation | AVE | Official dataset abbreviation, e.g. one used in the original paper | |||
| Provider | UR | ||||
| Year | 2018 | Dataset release year | |||
| Modalities | Audio Video | Data modalities included in the dataset | |||
| Collection name | AVE | Common name for all related datasets, used to group datasets coming from same source | |||
| Research domain | SED Audio-visual | Related domains, e.g., Scenes, Mobile devices, Audio-visual, Open set, Ambient noise, Unlabelled, Multiple sensors, SED, SELD, Tagging, FL, Strong annotation, Weak annotation, Unlabelled, Multi-annotator | |||
| Related datasets name | |||||
| Download | Download (None) | ||||
| Companion site | Site | Link to the companion site for the dataset | |||
| Citation | [Tian2018] Audio-Visual Event Localization in Unconstrained Videos | ||||
Audio | |||||
| Label | Value | Description | |||
Data | |||||
| Data type | Audio Features | Possible values: Audio | Features | |||
File format | |||||
| File format type | Constant | Possible values: Constant | Variable | |||
| Lossy compression | Yes | is audio compressed in a lossy manner | |||
Channels | |||||
| Setup | Mono | Possible values: Mono | Stereo | Binaural | Ambisonic | Array | Multi-Channel | Variable | |||
| Number of channels | 1 | ||||
Material | |||||
| Source | Youtube | Possible values: Original | Youtube | Freesound | Online | Crowdsourced | [Dataset name] | |||
Content | |||||
| Content type | Freefield | Possible values: Freefield | Synthetic | Isolated | |||
Recording | |||||
| Setup | Unknown | Possible values: Near-field | Far-field | Mixed | Uncontrolled | Unknown | |||
| Spot type | Unknown | Possible values: Fixed | Moving | Unknown | |||
Files | |||||
| Count | 4143 files | Total number of files | |||
| Total duration (minutes) | 690.5 min | Total duration of the dataset in minutes | |||
| File length | Constant | Characterization of the file lengths, possible values: Constant | Quasi-constant | Variable | |||
| File length (seconds) | 10 sec | Approximate length of files | |||
Meta | |||||
| Label | Value | Description | |||
| Types | Event | List of meta data types provided for the data, possible values: Event, Tag, Scene, Caption, Geolocation, Spatial location, Annotator, Timestamp, Presence, Proximity, etc. | |||
Scene | |||||
Event | |||||
| Classes | 28 | Number of event classes | |||
Annotation | |||||
| Type | Strong | Possible values: Strong | Weak | Location | None | |||
| Annotations per item | 1 | How many annotations there are available per item (possible multi-annotator setup) | |||
| Labelled amount (%) | 100 % | Percentage of all data, amount of data which is labelled | |||
| Strong annotations amount (%) | 100 % | Percentage of all data, amount of data which has strong annotations | |||
| Overlapping event instances | Yes | ||||
Labeling | |||||
| Hierarchical | Yes | ||||
| Ontology name | Yes | ||||
Instance | |||||
| Count | 4143 | Count of all event instances in the dataset | |||
| Average instances per class | 147.964285714 | Average per class instance count | |||
Cross-validation setup | |||||
| Label | Value | Description | |||
| Provided | Yes | ||||
| Folds | 1 | ||||
| Sets | Train Val Test | Set types provided in the split, possible values: Train | Test | Val | Dev | Eval | |||
Baseline | |||||
| Label | Value | Description | |||
| Download | Download | Link to baseline system source code | |||
| Citation | [Tian2018] | Paper to cite for the baseline | |||