Previously, we performed the RDF(S) interoperability benchmarking where we assessed the interoperability of tools using RDF(S) as interchange language [1]. This time we consider OWL as interchange language instead of RDF(S) and we aim for a fully automatic execution of the experiments.

The benchmarking will be carried out by performing interoperability experiments according to a common experimentation framework; then, their results will be collected, analysed and written in a public report, along with the best practices and tool improvement recommendations found.

Experiments to be performed
---------------------------

The experiment to be performed consists on measuring the interoperability of the tools participating in the benchmarking by interchanging ontologies from one tool to another. From these measurements, we will extract the current interoperability between the tools, the causes of problems, and improvement recommendations.

In this benchmarking activity we consider interoperability between tools using an interchange language. To interchange ontologies from one tool to another, they must first be exported from the origin tool to a file, which must then be imported into the destination tool. As any ontology exported by a tool is usually represented in the RDF/XML syntax, we will use this format for the interchange.

The execution of the experiments will be fully automatic. To that end, the IBSE tool has been developed. To be able to automatically perform the experiments, for each tool a method must be implemented as shown in the IBSE web page [3].

The ontologies that will be interchanged between all the tools are those of the OWL Import Benchmark Suite. 

Timeline
--------

The timeline for the benchmarking is the following:

30th June 2007    Implementation of the interfaces for the tools
15th July 2007    Execution of the experiments
20th August 2007  Analysis of the results

Participating in the benchmarking
---------------------------------

Every organisation is welcome to participate in OWL interoperability benchmarking. Organizations participating in the benchmarking are expected to implement the required IBSE method for their tool (an easy task) and to analyse the results of their tool.

If you want to participate in the benchmarking or have some further question about it, please contact Ra�l Garc�a Castro in the following email: rgarcia ( a ) fi . upm . es .

Organisers:
-----------
 - Raul Garcia Castro
 - Asuncion Gomez Perez