[Clam-devel] Re: [PATCH] evaluation framework for different segmentation algorithms

[Roman Goj]

Roman Goj wrote:
> Umm, scratch this last patch...

(...)

> but, Rome wasn't built in a day (not even a night in this case), so:
> TODO: (more for me than for the list perhaps)
> * names of files should be given as parameters, not hardcoded (in the
> morning)
> * the length of the file should be taken from the pool (in the morning)
> ** this means some avoiding of calls after the end of arrays I think...
> (in the morning)
> * write some tests! (I think I'll skip this for now, though... I've been
> checking by hand on each step, everything seems to calculate what it
> should...)
> * some general cleanup (I think I'll skip this for now - post GSoC (so -
> in 5 days ;) ) - as everything seems to be working and there are still
> some other things to finish...)
> * get some sleep... (I think I'll skip this for... nope, wait, I won't
> ZZzzzzz.....

So - morning (uhm, noon and some of afternoon actually...) came and with
it come the mentioned fixes:
* names of files are given as parameters
* second bullet was simpler then I thought it would be and correct
length of file is now used to compute the recall precision (now the
script uses the maximum of two values: the end of the last segment for
the ground truth segmentation and for the computed segmentation
* test are written... but just in the form of two .pool files to be used
as ground truth and computed pool (the two files attached)

I forgot yestarday about important TODOs:
* allow different attributes as Segmentation (not only Chords_Harte)
* allow different hop sizes
* generally there's room for improvement/rethinking:
** http://www.music-ir.org/mirex2007/index.php?title=Audio_Chord_Detection
** http://en.wikipedia.org/wiki/Recall_(information_retrieval)

but I guess these are post GSoC TODOs...

cheers!
roman
-------------- next part --------------
A non-text attachment was scrubbed...
Name: testComputed.pool
Type: text/xml
Size: 1355 bytes
Desc: not available
URL: <http://lists.clam-project.org/pipermail/clam-devel-clam-project.org/attachments/20070816/e6c18f18/attachment-0002.xml>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: testGroundTruth.pool
Type: text/xml
Size: 1194 bytes
Desc: not available
URL: <http://lists.clam-project.org/pipermail/clam-devel-clam-project.org/attachments/20070816/e6c18f18/attachment-0003.xml>