What's Wrong with OWL Benchmarks?

This paper is motivated by experiences in course of developing an ontology-based application within a real-world setting. When comparing these experiences with results of well-known benchmarks we found out that current benchmarks are not well suited to provide helpful hints for application developers who seek for a reasoning system matching typical real-world needs. This work aims at identifying requirements to make future benchmarks more useful for application developers.

Online Copy

Paper is available as PDF (155 KB)

BibTeX Entry

@InProceedings{, author = {Timo Weith{\"o}ner, Thorsten Liebig, Marko Luther, and Sebastian B{\"o}hm}, title = {{What's Wrong with OWL Benchmarks?}}, booktitle = {Proc.\ of the Second Int.\ Workshop on Scalable Semantic Web Knowledge Base Systems (SSWS 2006)}, pages = {101--114}, year = 2006, address = {Athens, GA, USA}, month = {November} }