IPIN2022 Competition Track2 Scoring Summary

1.1 Teams

Team1: SZUSCRI, Shenzhen University, Smart City Research Institute
Team2: CamLoc, Beijing University of Posts and Telecommunications

1.2 Scoring trials

1.2.1 Scoring trials - ground truth

Trial1 trials_set3_cut750_gt/trial_21_0.csv
Trial2 trials_set3_cut750_gt/trial_41_0.csv

Scoring	Length	Number of	Number of
trial		images	reference points
Trial1	170m	735	80
Trial2	136m	750	64

1.2.2 Scoring trials - log files

1.3 Evaluation scripts

Evaluation script for Team1 track2_evaluation_team1.py

Sample run for Team1:

# Make sure that the following python packages are installed: numpy, pandas, matplotlib, pyproj
python3 track2_evaluation_team1.py
# expected output:
#  plots: plots/team1_errcdf.png, plots/team1_trial1_trj.png, plots/team1_trial2_trj.png
# errors: ['trial1_team1: err75 = 28.151m', 'trial2_team1: err75 = 3.225m']

Evaluation script for Team2 track2_evaluation_team2.py

Sample run for Team2:

# Make sure that the following python packages are installed: numpy, pandas, matplotlib, pyproj
python3 track2_evaluation_team2.py
# expected output:
#  plots: plots/team2_errcdf.png, plots/team2_trial1_trj.png, plots/team2_trial2_trj.png
# errors: ['trial1_team2: err75 = 2.055m', 'trial2_team2: err75 = 2.844m']

1.3.1 Results summary

Errors at \(75^{th}\) percentile:

Trial	Team	75% error, m
Trial1	Team1	28.151
Trial1	Team2	2.055
Trial2	Team1	3.225
Trial2	Team2	2.844

IPIN2022 Competition Track2 Scoring Summary

Table of Contents

1 IPIN2022 Competition Track2

1.1 Teams

1.2 Scoring trials

1.2.1 Scoring trials - ground truth

1.2.2 Scoring trials - log files

1.3 Evaluation scripts

1.3.1 Results summary

1.3.2 Plots Team1

1.3.3 Plots Team2