Annotation phase progress and results

Terminology

Annotation Phase

A phase characterises the work carried out on a campaign. There are two types of phase:

• "Annotation": This type of phase is used to make an initial annotation of the campaign, based on empty spectrograms. This type of phase can also be used to import external annotations, for example from automatic detectors.
• "Verification": Verification phases are used to validate/invalidate annotations made in the “Annotation” phase. If a user is assigned to both phases, he will not be able to validate his own annotations.

The two phases can take place simultaneously.

Annotation Campaign

A campaign refers to the annotations of a dataset with a defined set of labels and tasks. Each campaign is defined by a name, a dataset and spectrogram configurations. A campaign is made up of phases.

Annotator

The user that will create annotations on a given annotation campaign.

Annotation

It defines the assignment of a label in a specific segment. The annotation can be represented as a box within the segment (i.e. strong detection). It is drawn by the user and must frame the sound of interest. Another possible representation is the presence of a sound of interest in the whole segment (i.e. weak detection). In APLOSE, the annotator can also leave a comment and/or express its confidence on any annotation.

Label

A label defining a specific sound. It can define sounds of interest such as the species and their vocalization or a boat passage.

It can be grouped into a Label set

Confidence

An indicator that represents the level of confidence the annotator has in each annotation. This indicator can be customized, it can be a Boolean value or a level from 0 to 3 for instance.

It can be grouped into a Confidence set

Acoustic features

If the campaign allow it, you can specify your annotation features.

From the phase detail, you can access its progression through the button:

From here, you can then download the results and status CSV files.

Results

A table containing all annotations and comments left by the campaign annotators.

Column	Type	Description
dataset	string	Name of the dataset.
analysis	string	Name of the analysis.
filename	string	Name of the file.
annotation_id	int	ID of the annotation
is_update_of_id	int	In the case this annotation is an update/correction of an other, this is the ID of the base annotation
start_time	float	Relative start of the annotation
end_time	float	Relative end of the annotation
start_frequency min_frequency	int	Lower frequency of the annotation
end_frequency max_frequency	int	Higher frequency of the annotation
annotation	string	Label of the annotation
annotator	string	Author of the annotation or comment
annotator_expertise	NOVICE / AVERAGE / EXPERT	Expertise level of the annotator at the time the annotation was made
start_datetime	timestamp	Absolute start of the annotation
end_datetime	timestamp	Absolute end of the annotation
is_box	boolean	Either the annotation is a box or a weak annotation
type	WEAK / POINT / BOX	Type of the annotation
confidence_indicator_label	string	The name of the level of confidence (if exists)
confidence_indicator_level	string [int]/[int]	The level of confidence on the maximum level available (if exists)
comments	string	Comment left by the annotator.
created_at_phase	ANNOTATION / VERIFICATION	Phase on which the annotation was created
signal_quantity	SINGLE / MULTIPLE	The amount of signals in the box. If multiple, none of the following are filled
signal_is_intensity_too_low	boolean	If the signal intensity is too low to correctly fill the features
signal_does_overlap_other_signals	boolean	If the signal overlaps other signals
signal_start_frequency	int	Frequency at start of signal (in Hz)
signal_end_frequency	int	Frequency at the end of the signal (in Hz))
signal_relative_min_frequency_count	int	Number of relative minimums
signal_relative_max_frequency_count	int	Number of relative maxima
signal_steps_count	int	Number of steps in the signal
signal_has_harmonics	boolean	If the signal contains harmonics
signal_trend	FLAT / ASCENDING / DESCENDING / MODULATED	General trend of the signal
signal_sidebands	boolean	If the signal has sidebands
signal_subharmonics	boolean	If the signal has subharmonics
signal_frequency_jumps	boolean / int	If the signal has frequency jumps, if it does it can contain the jump counts
signal_deterministic_chaos	boolean	If the signal has deterministic chaos

Status

A table indicating the submission status for all files and by all annotators.

Column	Type	Description
dataset	string	Name of the dataset.
filename	string	Name of the file.
[Annotators]	UNASSIGNED CREATED FINISHED	State of submission of the annotator (column) on the file (line)