Detailed Results - The EvAAL Framework ..::The EvAAL Framework::..

The EvAAL Framework

A summary of the results of the 2016 IPIN competition is available. The following pictures depict the details, which can be downloaded in their complete form for track 1 and track 3 (spreadsheet, maps).

Track 1: Smartphone based positioning (on-site)

NAVINDOOR - Best Result

Median	3.8
Mean	4.5
RMS	2.9
3rd quartile	5.4

SAMSUNG - Best Result

Median	6.2
Mean	7.0
RMS	4.6
3rd quartile	8.2

WIMAG - Best Result

Median	11.4
Mean	13.7
RMS	9.7
3rd quartile	18.7

WMLOC - Best Result

Median	28.4
Mean	29.3
RMS	11.9
3rd quartile	36.0

XMUH - Best Result

Median	39.2
Mean	33.4
RMS	18.3
3rd quartile	47.4

XPOSITION - Best Result

Median	29.2
Mean	33.3
RMS	21.0
3rd quartile	49.8

Track 2: Pedestrian Dead Reckoning (on-site)

SYSNAV - Best Result

3rd Quartile : 11.19 m, 26.19m (with floor penalty)

Mean : 17.20 m

Median : 7.03 m

Std : 23.65 m

RPE : 122.24 m

Travelled distance : 1344.98 m

NESL - Best Result

3rd Quartile : 1.50 m

Mean : 1.35 m

Median : 1.10 m

Std : 0.91 m

RPE : 1.42 m

Travelled distance : 1023.6m

XIAMEN UNIV. - Best Result

All key points are recorded, but floor identification was not done for floors 2 ~ 4.

3rd Quartile : 54.79m, 83.36m(with floor penalty)

Mean : 48.79m

Median : 48.6m

Std : 10.2 m

RPE : 61.01 m

Travelled distance : 532.27 m

Univ. Deusto - Best Result

3rd Quartile : 67.97 m

Mean : 60.13 m

Median : 59.88 m

Std : 18.93 m

RPE : 126.78 m

Travelled distance : 962.33 m

Univ. Parma - Best Result

3rd Quartile : 41.11 m

Mean : 30.73 m

Median : 29.03 m

Std : 12.92 m

RPE : 20.78 m

Travelled distance : 812.29 m

Tanjin Univ. Best Result

This trial is incomplete, so the result will not be considered as an official record.

3rd Quartile : 127.28 m

Mean : 62.98 m

Median : 30.81 m

Std : 59.09 m

RPE : 71.63 m

Travelled distance : 532.27 m

Track 3: Smartphone-based Positioning (Off-site)

HFTS - Best Result

	XY-Error	Floor Rate
Logfile01	2.5	100.00%
Logfile02	3.51	89.01%
Logfile03	15.96	84.62%
Logfile04	2.03	100.00%
Logfile05	4.49	100.00%
Logfile06	1.73	100.00%
Logfile07	5.52	100.00%
Logfile08	11.41	88.10%
Logfile09	2.23	100.00%
	3rd-Quartile	5.8m

hfts

UMinho - Best Result

	XY-Error	Floor Rate
Logfile01	3.71	97.83%
Logfile02	3.3	80.22%
Logfile03	12.04	100.00%
Logfile04	4.32	100.00%
Logfile05	4.7	97.62%
Logfile06	5.76	100.00%
Logfile07	4.45	100.00%
Logfile08	10.45	100.00%
Logfile09	5.5	100.00%
	3rd-Quartile	7.3m

minho

BlockDox - Best Result

	XY-Error	Floor Rate
Logfile01	3.2	78.26%
Logfile02	3.8	87.91%
Logfile03	13.26	87.69%
Logfile04	3.66	100.00%
Logfile05	5.9	90.48%
Logfile06	4.51	100.00%
Logfile07	6.2	92.31%
Logfile08	9.49	90.48%
Logfile09	5.17	100.00%
	3rd-Quartile	7.8m

hfts

FHWS - Best Result

	XY-Error	Floor Rate
Logfile01	5.02	93.48%
Logfile02	4.5	78.02%
Logfile03	16.74	100.00%
Logfile04	5.94	100.00%
Logfile05	8.18	100.00%
Logfile06	4.23	100.00%
Logfile07	6.32	100.00%
Logfile08	19.73	100.00%
Logfile09	4.39	100.00%
	3rd-Quartile	8.8m

hfts

Marauder's - Best Result

	XY-Error	Floor Rate
Logfile01	24.77	39.13%
Logfile02	12.51	32.97%
Logfile03	31.17	18.46%
Logfile04	27.82	42.67%
Logfile05	16.18	35.71%
Logfile06	23.97	100.00%
Logfile07	46.3	26.15%
Logfile08	16.59	50.00%
Logfile09	26.7	100.00%
	3rd-Quartile	40.9m

Track 4: Robot Based Positioning

ATLAS - Best Result

3rd-Quartile: 106mm

Mean error: 80.12mm

cdf_atlas

trayectoria_atlas

TOPO-rtls - Best Result

3rd-Quartile: 311mm

Mean error: 220.48mm