Benchmarking Semantic Web Solutions

in Special Issue   Posted on June 15, 2019 

Information for the Special Issue

Submission Deadline: Sat 31 Aug 2019
Journal Impact Factor : 2.238
Journal Name : Journal of Web Semantics
Journal Publisher:
Website for the Special Issue:
Journal & Submission Website:

Special Issue Call for Papers:

The availability of benchmarks is often regarded as a prerequisite for sustainable developments in quantitative research. From a practical perspective, the cost and effort required for introducing Semantic Web and Linked Data technology is significant. A key step towards abolishing the barriers to the adoption and deployment of this technology is to provide open benchmarking reports that allow users to assess the fitness of existing solutions for their purposes. 

In this special issue, we hence welcome articles (1) proposing benchmarks and related platforms, and/or (2) performing a throughout evaluation of Semantic Web solutions. A focus of the special issue will be scalability and reproducibility. The target topics of the benchmark/evaluation include (but are not limited to):

1) Knowledge extraction ​

  • Named entity recognition
  • Disambiguation
  • Relation extraction
  • Open and closed knowledge extraction

2) Link discovery and prediction

  • Linking at scale
  • Linking for dedicated data types (e.g., geospatial data) 

3) Knowledge curation and fact checking 4) Ontology alignment

  • Alignment discovery
  • Alignment repair
  • Complex ontology alignment

5) Tabular data to knowledge graph matching

  • Cell to KG entity matching 
  • Column to KG semantic type
  • Relation discovery among table columns
  • KG population 

6) OWL reasoning

  • Classification
  • Entailment checking
  • Class satisfiability
  • Ontology satisfiability
  • Query answering

7) Knowledge graph completion

  • Semantic embeddings
  • Quality of embeddings

8) Ontology Based Data Access

  • Performance
  • Relational schema to ontology alignment

9) Visualization

10) Browsing

Submission guidelines

The Journal of Web Semantics solicits original scientific contributions of high quality. Following the overall mission of the journal, we emphasize the publication of papers that combine theories, methods and experiments from different subject areas in order to deliver innovative semantic methods and applications. The publication of large-scale experiments and their analysis is also encouraged to clearly illustrate scenarios and methods that introduce semantics into existing Web interfaces, contents and services. 

Submission of your manuscript is welcome provided that it, or any translation of it, has not been copyrighted or published and is not being submitted for publication elsewhere. Manuscripts should be prepared for publication in accordance with instructions given in the JWS guide for authors[1]. We expect the special issue papers to be between 15-25 pages. The submission and review process will be carried out using Elsevier\’s Web-based EES system. Upon acceptance of an article, the author(s) will be asked to transfer copyright of the article to the publisher. This transfer will ensure the widest possible dissemination of information. Elsevier\’s liberal preprint policy permits authors and their institutions to host preprints on their web sites. Preprints of the articles will be made freely accessible on the JWS preprint server. Final copies of accepted publications will appear in print and at Elsevier\’s archival online server. 


● Intention to submit: July 31, 2019, 23:59 PM Hawaii-Time

● Submission deadline: August 31st, 2019

● Notification (1st round): October 15th, 2019

● Revisions due: November 15th, 2019

● Notification (2nd round): December 20th, 2019

● Camera ready Paper Deadline: January 31, 2020


  • Axel Ngonga, Paderborn University (Germany) (
  • Cassia Trojahn dos Santos, Institut de Recherche en Informatique de Toulouse (France) (
  • Ernesto Jimenez-Ruiz, The Alan Turing Institute (UK) and University of Oslo 
    (Norway) ( – Main contact point
  • Valentina Tamma, University of Liverpool (UK) (

Closed Special Issues