TRECVID 2019 ActEV: Activities in Extended Video

New TRECVID ActEV Deadline: October 01, 2019: 1:00 PM EST, But we will keep the leaderboard running till Nov 15.

ActEV is an series of evaluations to accelerate development of robust, multi-camera, automatic activity detection algorithms for forensic and real-time alerting applications. Each evaluation will challenge systems with new data, system requirements, and/or new activities. For more details about the previous evaluations and example videos see the main ActEV page and click on the example videos tab

An ActEV activity is defined to be “one or more people performing a specified movement or interacting with an object or group of objects”. Activity detection technologies process extended video streams, such as those from a IP camera, and automatically detects all instances of the activity by: (1) identifying the type of activity, (2) producing a confidence score indicating the presence of instance, (3) temporally localizing the instance by indicating the begin and end times, and (4) optionally, detecting and tracking the objects (people, vehicles, objects) involved in the activity.

The ActEV evaluation is being conducted to assess the robustness of automatic activity detection for a multi-camera streaming video environment.

NIST invites all organizations, particularly universities and corporations, to submit their results using their technologies to the ActEV evaluation server. The evaluation is open worldwide. Participation is free. NIST does not provide funds to participants.

To take part in the ActEV evaluation you need to register on the actev.nist.gov website and acknowledge that you have read and accepted the data license to download the data.

In the TrecVID ActEV 2019 evaluation, there is one Activity Detection (AD) task for detecting and localizing of activities
For the Activity Detection task, given a target activity, a system automatically detects and temporally localizes all instances of the activity. For a system-identified activity instance to be evaluated as correct, the type of activity must be correct and the temporal overlap must fall within a minimal requirement as described in the Evaluation Plan.

The TrecVID ActEV 2019 evaluation is only based on the VIRAT V1 and V2 dataset

The Multiview Extended Video with Activities (MEVA) will be used in a future evaluation, but we would like the participants to help us annotate the data for the 38 activities as defines in the annotation guide (coming soon) . The data will be provided in MPEG-4 and AVI format. Please click on the data tab for information on how to download the data.

The main scoring metrics will be based on detection, temporal localization using evaluation measures that include the Probability of Missed Detection and Time-Based False Alarm” (TFA) measure. See details in the evaluation plans. NIST maintains the ActEV Scoring Software on the Scoring software for the Activities in Extended Video (ActEV) evaluation GitHub repo. (e.g., Probability of Missed Detection, Time-Based False Alarm” (TFA)) (see: Evaluation Plan).

Scoring software for the TRECVID Activities in Extended Video (ActEV) evaluation

ActEV NIST team (ActEV-nist@nist.gov)