<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=utf-8"><meta name=Generator content="Microsoft Word 14 (filtered medium)"><!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:Helvetica;
panose-1:2 11 6 4 2 2 2 2 2 4;}
@font-face
{font-family:Helvetica;
panose-1:2 11 6 4 2 2 2 2 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0cm;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
span.apple-converted-space
{mso-style-name:apple-converted-space;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 70.85pt 70.85pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-US link=blue vlink=purple style='word-wrap: break-word;-webkit-nbsp-mode: space;line-break:after-white-space'><div class=WordSection1><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Dear Joaquin Torres,<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Thank you very much for this decision.<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><div><p class=MsoNormal><span lang=PL style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Best Regards<o:p></o:p></span></p><p class=MsoNormal><span lang=PL style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span lang=PL style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Jarek (Jerry) Karciarz<o:p></o:p></span></p><p class=MsoNormal><span lang=PL style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><img width=132 height=21 id="Picture_x0020_1" src="cid:image001.png@01D50755.414DF3E0" alt=samsungLogo2016></span><span lang=PL style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p></o:p></span></p><p class=MsoNormal><span style='font-family:"Arial","sans-serif";color:#7D9EC0;background:white'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-family:"Arial","sans-serif";color:#7D9EC0;background:white'>Senior Professional</span><span style='color:#1F497D'><o:p></o:p></span></p><p class=MsoNormal><span style='font-family:"Arial","sans-serif";color:#7D9EC0;background:white'>Head of <b>Network Analytics</b></span><span style='color:#1F497D'><o:p></o:p></span></p><p class=MsoNormal><b><span style='font-family:"Arial","sans-serif";color:#7D9EC0'>Samsung R&D Institute Poland</span></b><span style='font-family:"Arial","sans-serif";color:#7D9EC0'> </span><span style='color:#1F497D'><o:p></o:p></span></p><p class=MsoNormal><span style='font-family:"Arial","sans-serif";color:#7D9EC0'>Samsung Electronics </span><span style='color:#1F497D'><o:p></o:p></span></p><p class=MsoNormal><span style='font-family:"Arial","sans-serif";color:#7D9EC0'>Office: +48 22 377 8784</span><span style='color:#1F497D'><o:p></o:p></span></p><p class=MsoNormal><span style='font-family:"Arial","sans-serif";color:#7D9EC0'>Cell: +48 600 098 433 </span><span style='color:#1F497D'><o:p></o:p></span></p><p class=MsoNormal><span style='font-family:"Arial","sans-serif";color:#75787B'><a href="mailto:j.karciarz@samsung.com">j.karciarz@samsung.com</a> <o:p></o:p></span></p></div><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><div><div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm'><p class=MsoNormal><b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span></b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'> Joaquín Torres Sospedra [mailto:jtorres@uji.es] <br><b>Sent:</b> Friday, May 10, 2019 4:55 PM<br><b>To:</b> Jarek (Jerry) Karciarz<br><b>Cc:</b> Francesco Potortì; contest@evaal.aaloa.org; Yuqin Wang<br><b>Subject:</b> Re: [evaal contest] Question about competition<o:p></o:p></span></p></div></div><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Dear Jarek Karciarz,<o:p></o:p></p><div><p class=MsoNormal><o:p> </o:p></p></div><div><p class=MsoNormal>After some deliberation we have decided to publish the ground truth data for the previous competitions.<o:p></o:p></p></div><div><p class=MsoNormal>Next week we will publicly release this data in the EvAAL website as well as other repositories.<o:p></o:p></p></div><div><p class=MsoNormal><o:p> </o:p></p></div><div><p class=MsoNormal>Best regards,<o:p></o:p></p><div><div><div><div><div><div><div><div><p class=MsoNormal><span style='font-size:9.0pt;font-family:"Helvetica","sans-serif";color:black'>-- <br><b>Joaquín Torres-Sospedra</b><br>Postdoc @ <a href="http://geotec.uji.es/">GEOTEC</a><br>Universitat Jaume I, Castellón, Spain<br>Social media: <a href="https://twitter.com/jtorres_phd">@jtorres_phd</a> - <a href="https://www.researchgate.net/profile/Joaquin_Torres-Sospedra">LinkedIn</a> - <a href="https://www.researchgate.net/profile/Joaquin_Torres-Sospedra">ResearchGate</a><br>Web:<span class=apple-converted-space> </span><a href="http://jtorr.es">http://jtorr.es</a><o:p></o:p></span></p></div></div></div></div></div></div></div></div><div><p class=MsoNormal><br><br><o:p></o:p></p><div><p class=MsoNormal>El 10 may 2019, a las 8:52, Jarek (Jerry) Karciarz <<a href="mailto:j.karciarz@samsung.com">j.karciarz@samsung.com</a>> escribió:<o:p></o:p></p></div><p class=MsoNormal><o:p> </o:p></p><div><div><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Dear Joaquin,</span><o:p></o:p></p></div><div><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span><o:p></o:p></p></div><div><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Thank you so much for explanations and considering the release of ground truth evaluation data.</span><o:p></o:p></p></div><div><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span><o:p></o:p></p></div><div><div><p class=MsoNormal><span lang=PL style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Best Regards</span><o:p></o:p></p></div><div><p class=MsoNormal><span lang=PL style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span><o:p></o:p></p></div><div><p class=MsoNormal><span lang=PL style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Jarek (Jerry) Karciarz</span><o:p></o:p></p></div><div><p class=MsoNormal><span lang=PL style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span><o:p></o:p></p></div><div><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><image001.png></span><o:p></o:p></p></div><div><p class=MsoNormal><span style='font-family:"Arial","sans-serif";color:#7D9EC0;background:white'> </span><o:p></o:p></p></div><div><p class=MsoNormal><span style='font-family:"Arial","sans-serif";color:#7D9EC0;background:white'>Senior Professional</span><o:p></o:p></p></div><div><p class=MsoNormal><span style='font-family:"Arial","sans-serif";color:#7D9EC0;background:white'>Head of<span class=apple-converted-space> </span><b>Network Analytics</b></span><o:p></o:p></p></div><div><p class=MsoNormal><b><span style='font-family:"Arial","sans-serif";color:#7D9EC0'>Samsung R&D Institute Poland</span></b><o:p></o:p></p></div><div><p class=MsoNormal><span style='font-family:"Arial","sans-serif";color:#7D9EC0'>Samsung Electronics<span class=apple-converted-space> </span></span><o:p></o:p></p></div><div><p class=MsoNormal><span style='font-family:"Arial","sans-serif";color:#7D9EC0'>Office: +48 22 377 8784</span><o:p></o:p></p></div><div><p class=MsoNormal><span style='font-family:"Arial","sans-serif";color:#7D9EC0'>Cell: +48 600 098 433<span class=apple-converted-space> </span></span><o:p></o:p></p></div><div><p class=MsoNormal><span style='font-family:"Arial","sans-serif";color:#75787B'><a href="mailto:j.karciarz@samsung.com"><span style='color:purple'>j.karciarz@samsung.com</span></a></span><o:p></o:p></p></div></div><div><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'> </span><o:p></o:p></p></div><div><div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm'><div><p class=MsoNormal><b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span></b><span class=apple-converted-space><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'> </span></span><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>Joaquín Torres Sospedra [<a href="mailto:jtorres@uji.es"><span style='color:purple'>mailto:jtorres@uji.es</span></a>]<span class=apple-converted-space> </span><br><b>Sent:</b><span class=apple-converted-space> </span>Thursday, May 09, 2019 11:08 PM<br><b>To:</b><span class=apple-converted-space> </span>Jarek (Jerry) Karciarz<br><b>Cc:</b><span class=apple-converted-space> </span>Francesco Potortì;<span class=apple-converted-space> </span><a href="mailto:contest@evaal.aaloa.org"><span style='color:purple'>contest@evaal.aaloa.org</span></a>; Yuqin Wang<br><b>Subject:</b><span class=apple-converted-space> </span>Re: [evaal contest] Question about competition</span><o:p></o:p></p></div></div></div><div><p class=MsoNormal> <o:p></o:p></p></div><div><div><p class=MsoNormal>Dear Jarek Karciarz,<o:p></o:p></p></div><div><div><p class=MsoNormal> <o:p></o:p></p></div></div><div><div><p class=MsoNormal>Sorry for my late reply, I have been out of the office the last two days. <o:p></o:p></p></div></div><div><div><p class=MsoNormal> <o:p></o:p></p></div></div><div><div><p class=MsoNormal>The datasets collected for the Track 3 (Smartphone-based off-site) can be reached from the EvAAL website (except the ones of the IPIN 2018 conference). Although we are working to create a common repository, you can find all datasets in the links below:<o:p></o:p></p></div></div><div><div><p class=MsoNormal><a href="http://indoorloc.uji.es/ipin2016track3/"><span style='color:purple'>http://indoorloc.uji.es/ipin2016track3/</span></a><br><a href="http://indoorloc.uji.es/ipin2017track3/"><span style='color:purple'>http://indoorloc.uji.es/ipin2017track3/</span></a><br><a href="http://ipin-conference.org/2018/ipincompetition"><span style='color:purple'>http://ipin-conference.org/2018/ipincompetition</span></a><br><a href="http://indoorloc.uji.es/ipin2019track3/"><span style='color:purple'>http://indoorloc.uji.es/ipin2019track3/</span></a> <o:p></o:p></p></div></div><div><div><div><p class=MsoNormal> <o:p></o:p></p></div></div><div><div><p class=MsoNormal>We are organizing this track in the current format since 2016. In 2016, we provided training and evaluation data. Since 2017, we provide training, validation and evaluation data. The validation data sets contain the location of some landmarks and they can be used to evaluate your model based built on the training data sets.<o:p></o:p></p></div></div><div><div><p class=MsoNormal> <o:p></o:p></p></div></div><div><div><p class=MsoNormal>It is true that we provided blind evaluation data for the competition and the ground truth is not available. We are now discussing about this matter and the decision is not easy to take. We will answer your request about releasing the Ground Truth of the evaluation sets (2016, 2017 and 2018) tomorrow.<o:p></o:p></p></div></div><div><div><p class=MsoNormal> <o:p></o:p></p></div></div><div><div><p class=MsoNormal>In the meanwhile, if you have any question about track 3 or the datasets format, please let me know. <o:p></o:p></p></div></div></div><div><div><p class=MsoNormal> <o:p></o:p></p></div></div><div><div><div><div><div><div><div><div><div><div><p class=MsoNormal><span style='font-size:9.0pt;font-family:"Helvetica","sans-serif"'>-- <br><b>Joaquín Torres-Sospedra</b><br>Postdoc @ <a href="http://geotec.uji.es/"><span style='color:purple'>GEOTEC</span></a><br>Universitat Jaume I, Castellón, Spain<br>Social media: <a href="https://twitter.com/jtorres_phd"><span style='color:purple'>@jtorres_phd</span></a> - <a href="https://www.researchgate.net/profile/Joaquin_Torres-Sospedra"><span style='color:purple'>LinkedIn</span></a> - <a href="https://www.researchgate.net/profile/Joaquin_Torres-Sospedra"><span style='color:purple'>ResearchGate</span></a><br>Web:<span class=apple-converted-space> </span><a href="http://jtorr.es/"><span style='color:purple'>http://jtorr.es</span></a></span><o:p></o:p></p></div></div></div></div></div></div></div></div></div><div><p class=MsoNormal> <o:p></o:p></p></div><div><div><p class=MsoNormal> <o:p></o:p></p></div></div><div><div><p class=MsoNormal> <o:p></o:p></p></div></div><div><div><p class=MsoNormal> <o:p></o:p></p></div></div><div><div><p class=MsoNormal><br><br><br><o:p></o:p></p></div><div><div><p class=MsoNormal>El 9 may 2019, a las 11:01, Jarek (Jerry) Karciarz <<a href="mailto:j.karciarz@samsung.com"><span style='color:purple'>j.karciarz@samsung.com</span></a>> escribió:<o:p></o:p></p></div></div><div><p class=MsoNormal> <o:p></o:p></p></div><div><div><div><p class=MsoNormal>Dear Joaquin, Francesco,<br><br>Thanks for your response. Sharing data from 2018 competition would be highly appreciated.<br>However our question is a little bit wider. The data shared from 2017 and before editions are so called training and evaluation data. Training data contain Wi-Fi and other sensor readings plus true locations. That’s fine. The evaluation data don’t contain locations because the location should be estimated by the competing algorithm. That’s obvious. Our question was, could you please share the true locations for the evaluation data for 2018 and before editions?. This would help us to real test the performance of our algorithm on data from past competition editions and compare to other participants, especially to the winners.<br>Thank you in advance for understanding.<br><br>Best Regards<br><br>Jarek (Jerry) Karciarz<br><br><br><br>Senior Professional<br>Head of Network Analytics<br>Samsung R&D Institute Poland<span class=apple-converted-space> </span><br>Samsung Electronics<span class=apple-converted-space> </span><br>Office: +48 22 377 8784<br>Cell: +48 600 098 433<span class=apple-converted-space> </span><br><a href="mailto:j.karciarz@samsung.com"><span style='color:purple'>j.karciarz@samsung.com</span></a><span class=apple-converted-space> </span><br><br>-----Original Message-----<br>From: Francesco Potortì [<a href="mailto:Potorti@isti.cnr.it"><span style='color:purple'>mailto:Potorti@isti.cnr.it</span></a>]<span class=apple-converted-space> </span><br>Sent: Wednesday, May 08, 2019 6:14 PM<br>To: Jarek (Jerry) Karciarz<br>Cc:<span class=apple-converted-space> </span><a href="mailto:contest@evaal.aaloa.org"><span style='color:purple'>contest@evaal.aaloa.org</span></a>; 'Yuqin Wang'<br>Subject: Re: [evaal contest] Question about competition<br><br><br><br><o:p></o:p></p></div><div><p class=MsoNormal>We have the question regarding off-line, smartphone based track. Is it<span class=apple-converted-space> </span><br>possible you to share ground true locations for previous contests<span class=apple-converted-space> </span><br>editions? Say for years 2015-2018?<br><br>This would greatly let us challenge our solution against corresponding<span class=apple-converted-space> </span><br>winners.<o:p></o:p></p></div><p class=MsoNormal style='margin-bottom:12.0pt'><br>Jarek,<br><br>on<span class=apple-converted-space> </span><a href="http://evaal.aaloa.org/"><span style='color:purple'>http://evaal.aaloa.org</span></a><span class=apple-converted-space> </span>you find data for past editions until 2017.<br>We are still working on publishing data for 2018, sorry about that.<br><br>Since you are specifically interested in smartphone off-site, you may want to ask for details to the Track 3 chair Joaquín Torres Sospedra <<a href="mailto:jtorres@uji.es"><span style='color:purple'>jtorres@uji.es</span></a>>.<br><br>Sincerely<br><br>--<span class=apple-converted-space> </span><br>IPIN'19<span class=apple-converted-space> </span><a href="http://ipin2019.isti.cnr.it/"><span style='color:purple'>http://ipin2019.isti.cnr.it</span></a><span class=apple-converted-space> </span> Voice: +39.050.621.3058<br>Francesco Potortì (ricercatore) Mobile: +39.348.8283.107<br>ISTI - Area della ricerca CNR Skype: wnlabisti<br>via G. Moruzzi 1, I-56124 Pisa Web: <a href="http://fly.isti.cnr.it/"><span style='color:purple'>http://fly.isti.cnr.it</span></a><br><br><br><o:p></o:p></p></div></div></div><div><p class=MsoNormal> <o:p></o:p></p></div></div></div><p class=MsoNormal><span style='display:none'><o:p> </o:p></span></p></div></div><p class=MsoNormal><o:p> </o:p></p></div></div><table id=bannersignimg data-cui-lock="true" namo_lock><tr><td><p> </p>
</td></tr></table><table id=confidentialsignimg data-cui-lock="true" namo_lock><tr><td><p> <img style="border: 0px solid currentColor; border-image: none; width: 520px; height: 144px; display: inline-block;" unselectable="on" data-cui-image="true" src="cid:cafe_image_0@s-core.co.kr"> </p>
</td></tr></table></body></html><img src='http://ext.w1.samsung.net/mail/ext/v1/external/status/update?userid=j.karciarz&do=bWFpbElEPTIwMTkwNTEwMTUyNDQ0ZXVjYXMxcDE2NTJlYWEwOTczYmIxN2FiOTMzYjA0MjFmMTk5YjczZiZyZWNpcGllbnRBZGRyZXNzPWNvbnRlc3RAZXZhYWwuYWFsb2Eub3Jn' border=0 width=0 height=0 style='display:none'>