Human Counting Evaluation

We focus on crowd counting on drone-captured scenes. In particular, given an input frame in bird-view, we require a counting method to estimate the number of people and density map in an image accurately.

For this task, the performance is evaluated by both MAE and MSE scores, same as in [1]. Notably, the MAE score is used as the primary metric for ranking methods. The metrics are described in the following table.

MEASURE	PERFECT	DESCRIPTION
MAE	0	Mean absolute error between the predicted number of people and ground-truth in evaluation
MSE	0	Mean squared error between the predicted number of people and ground-truth in evaluation

References:

[1] Wen, L., Du, D., Zhu, P., Hu, Q., Wang, Q., Bo, L., & Lyu, S. (2019). Drone-based Joint Density Map Estimation, Localization and Tracking with Space-Time Multi-Scale Attention Network.arXiv preprint arXiv:1912.01811.