Skip to content

This repository contains our Scholarly KGQA system code, for the Scholarly-QALD-23 challenge.

License

Notifications You must be signed in to change notification settings

huntila/scholarly-kgqa

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Scholarly KGQA using LLM

This repository contains our Scholarly KGQA system code, for the Scholarly-QALD-23 challenge.

Question Answering (QA) over scholarly Knowledge Graphs (KGs) is a challenging task, due to the complexity of the KGs and the variety of natural language questions that can be asked as well as the underlying ontologies. In this paper, we present a KGQA system that uses three components: (1) a question analyzer to identify similar questions from the training set, (2) a SPARQL generator to generate SPARQL queries for the test questions, and (3) an answer extractor to run the SPARQL queries against the underlying KG. Our system was evaluated on the SciQA dataset, a challenging benchmark for question answering over scholarly KGs. Our system achieved an F1 score of 99.0% on the SciQA test set which is comparable to the state of the art.

sciqa_model_final

The full paper can be found here.

About

This repository contains our Scholarly KGQA system code, for the Scholarly-QALD-23 challenge.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published