Towards standard methods and metrics for evaluating IA

[Rashmi Sinha <rashmi AT rashmisinha.com>]

At 08:10 PM 6/18/2003 -0300, Livia Labate wrote:
> I personally would find great value in a 'resource centre' or something to
> learn about different metrics and their usage (benchmarking). And by metrics
> I am including guidelines, patterns, rules-of-thumb, do's, not just
> evaluation metrics (Peter Boersma mentioned this in a previous message, I
> agree with this wider scope).

The wider scope does seem to make sense.

> When I saw the invitation to participate in this group (on the AIfIA members
> list?), my first thought was "hummm I hope they plan on listing lots of the
> metrics used out there and gather resources for each, so we can make
> comparisons and suggest usage" So that idea kind of stuck with me.

I think its a crucial question as to whether the onus is on the group to go 
and decide what to list, or to create an infrastructure for allowing people 
to share material themselves. I think the latter approach might be more 
sustainable...

Thoughts?

-Rashmi