EvAAL-ETRI on-site and off-site Indoor Localization Competition
Banff, Alberta, Canada
13-16 October 2015
EvAAL is a competition that aims at establishing benchmarks and evaluation metrics for comparing Ambient Assisted Living solutions.
EvAAL stands for "evaluating AAL systems through competitive benchmarking". Since 2011 we have organised one or more international competitions on specific aspects of AAL systems, with the long-term goal of evaluating complete AAL systems.
In 2015 we have three tracks, namely smartphone based positioning and Wi-Fi fingerprinting in large environments. The first one is an on-line competition and the competitors can use any sensor available on the smartphones while in the other one the competitors will have access to a large Wi-Fi fingerprint database, to which they will apply their algorithms offline. Further details are available in the Call for Competition. Proceedings to be published in the proceedings of IPIN 2015.
Purpose of Competition
The purpose of the IPIN 2015 competition is manifold. We want to establish a well-agreed performance evaluation method for indoor positioning systems as well as to provide opportunities for the participants to learn about the evaluating methods of positioning systems. In addition, we expect to observe a number of different positioning techniques and compare the advantages and disadvantages of various positioning techniques.
Evaluation Process for the on-line competition
For the on-site tracks, an "actor" walks along a predefined path while carrying the competitors' equipment, that is a smartphone fro track 1 and foot-mounted device for track 2. The path goes through some tens of reference points, where the actor will mark a timestamp using the EvAAL measurement app. Errors are the distance between the real coordinates of reference points and those estimated by the competitor. The final score is the third quartile of errors. See the Technical Annex for more details.
If you are curious or interested in how EvAAL work, you can subscribe to the low-traffic Contest mailing list, where our community shares news and views on the EvAAL competition.