General information |
Label |
Value |
Description |
|
Name |
AVE: The Audio-Visual Event Dataset |
Full dataset name |
|
ID |
sounds/ave
|
Datalist id for external indexing |
|
Abbreviation |
AVE |
Official dataset abbreviation, e.g. one used in the original paper |
|
Provider |
UR |
|
|
Year |
2018 |
Dataset release year |
|
Modalities |
Audio
Video
|
Data modalities included in the dataset |
|
Collection name |
AVE |
Common name for all related datasets, used to group datasets coming from same source |
|
Research domain |
SED
Audio-visual
|
Related domains, e.g., Scenes, Mobile devices, Audio-visual, Open set, Ambient noise, Unlabelled, Multiple sensors, SED, SELD, Tagging, FL, Strong annotation, Weak annotation, Unlabelled, Multi-annotator |
|
Related datasets name |
|
|
|
Download |
Download
(None)
|
|
|
Companion site |
Site
|
Link to the companion site for the dataset |
|
Citation |
[Tian2018] Audio-Visual Event Localization in Unconstrained Videos
|
|
Audio |
Label |
Value |
Description |
|
Data |
|
|
Data type |
Audio
Features
|
Possible values: Audio | Features |
|
|
File format |
|
|
|
File format type |
Constant
|
Possible values: Constant | Variable |
|
|
|
Lossy compression |
Yes
|
is audio compressed in a lossy manner |
|
|
Channels |
|
|
|
Setup |
Mono
|
Possible values: Mono | Stereo | Binaural | Ambisonic | Array | Multi-Channel | Variable |
|
|
|
Number of channels |
1 |
|
|
|
Material |
|
|
|
Source |
Youtube
|
Possible values: Original | Youtube | Freesound | Online | Crowdsourced | [Dataset name] |
|
Content |
|
|
Content type |
Freefield
|
Possible values: Freefield | Synthetic | Isolated |
|
Recording |
|
|
Setup |
Unknown
|
Possible values: Near-field | Far-field | Mixed | Uncontrolled | Unknown |
|
|
Spot type |
Unknown
|
Possible values: Fixed | Moving | Unknown |
|
Files |
|
|
Count |
4143 files |
Total number of files |
|
|
Total duration (minutes) |
690.5 min |
Total duration of the dataset in minutes |
|
|
File length |
Constant
|
Characterization of the file lengths, possible values: Constant | Quasi-constant | Variable |
|
|
File length (seconds) |
10 sec |
Approximate length of files |
Meta |
Label |
Value |
Description |
|
Types |
Event
|
List of meta data types provided for the data, possible values: Event, Tag, Scene, Caption, Geolocation, Spatial location, Annotator, Timestamp, Presence, Proximity, etc. |
|
Scene |
|
Event |
|
|
Classes |
28 |
Number of event classes |
|
|
Annotation |
|
|
|
Type |
Strong
|
Possible values: Strong | Weak | Location | None |
|
|
|
Annotations per item |
1 |
How many annotations there are available per item (possible multi-annotator setup) |
|
|
|
Labelled amount (%) |
100 % |
Percentage of all data, amount of data which is labelled |
|
|
|
Strong annotations amount (%) |
100 % |
Percentage of all data, amount of data which has strong annotations |
|
|
|
Overlapping event instances |
Yes
|
|
|
|
Labeling |
|
|
|
Hierarchical |
Yes
|
|
|
|
|
Ontology name |
Yes
|
|
|
|
Instance |
|
|
|
Count |
4143 |
Count of all event instances in the dataset |
|
|
|
Average instances per class |
147.964285714 |
Average per class instance count |
Cross-validation setup |
Label |
Value |
Description |
|
|
Provided |
Yes
|
|
|
|
Folds |
1 |
|
|
|
Sets |
Train
Val
Test
|
Set types provided in the split, possible values: Train | Test | Val | Dev | Eval |
Baseline |
Label |
Value |
Description |
|
|
Download |
Download
|
Link to baseline system source code |
|
|
Citation |
[Tian2018]
|
Paper to cite for the baseline |