[evaal contest] EvAAL- a note about the evaluation criteria

[Stefano Chessa]

Dear competitors,

 

here are some details on the criteria the evaluation committee used to give
the scores that you can read at
http://evaal.aaloa.org/home/winners-in-evaal-competition.

 

About user acceptance: the general topics on which the evaluation committee
members were called to judge are defined in
http://evaal.aaloa.org/current-competition/instruction.

After the interview with the competitor, members met to have a brief
discussion on the interview and to clarify each other's views.  Then all
were called to give their vote, without giving any justification.

 

About integrability: the criteria used to give this score are listed in the
technical annex http://evaal.aaloa.org/current-competition/techannex and
were:

 

2 points for availability of libraries for integration;

2 points for use of open solutions for libraries: 

 2 points for use of standards:  

 2 points for availability of tools for testing/monitoring the system;

1 point for availability of sample applications;

1 point for availability of documentation (beyond the submitted paper)

 

In contrast with the vote on user acceptance, after the interview the
evaluation committee discussed and reached an agreement on each point; the
idea was that the results hold not be of personal opinion of evaluators, but
reflect as much as possible an objective situation.  We have not publish yet
the detailed scores yet, we plan to do this in the next days.

 

If any of you has questions, it would be nice to discuss them on this list.
If you would like a private conversation, please feel free to contact me
directly.

 

Best regards,

                Stefano

 

--------------------------------------------------------------------

Stefano Chessa

Dipartimento di Informatica - Universita' di Pisa 

Largo B. Pontecorvo 3, 56127 Pisa, Italy 

 

Phone: ++39 050 2213122

Phone (ISTI) : ++39 050 3152887

Fax: ++39 050 2212726

 

 <http://www.di.unipi.it/~ste> http://www.di.unipi.it/~ste

 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://evaal.aaloa.org/pipermail/contest/attachments/20111003/683b7a8f/attachment.html>