Main Menu

Home
Organizers
Important Dates
Results
Contest Description
Evaluation Criteria
Download
Participation

Evaluation metrics

The cooking motion labels assigned into the testing video is evaluated by the accuracy score calculated from precision and recall manner. The precision and recall are given by

where TP, FP and FN denote the number of labels assigned correctly, assigned wrongly, unassigned wrongly respectively. Then, their harmonic mean (F-measure) is calculated by following formula.

Actually, the F-measure is calculated for each cooking motion label. Suppose the result is composed of N kinds of cooking motion labels, the final score is given by averaging all F-measures,

where Fi is a F-measure for each cooking motion label. The Fig.1 shows examples of evaluation.



Fig.1 Examples of calculating Final Score.