Skip to content

Latest commit

 

History

History
86 lines (62 loc) · 3.05 KB

README.md

File metadata and controls

86 lines (62 loc) · 3.05 KB
Raw

Kernel Graph Attention Network (KGAT)

There are source codes for Fine-grained Fact Verification with Kernel Graph Attention Network.

model

For more information about the FEVER 1.0 shared task can be found on this website.

😃 What's New

Fact Extraction and Verification with SCIFACT

The shared task introduces scientific claim verification for helping scientists, clinicians, and public to verify the credibility of such claims with scientific literature, especially for the claims related to COVID-19.
>> Reproduce Our Results >> About SCIFACT Dataset >> Our Paper

Requirement

  • Python 3.X
  • fever_score
  • Pytorch
  • pytorch_pretrained_bert
  • transformers

Data and Checkpoint

  • All data and BERT based chechpoints can be found at Ali Drive.
  • RoBERTa based models and chechpoints can be found at Ali Drive.

Retrieval Model

  • BERT based ranker.
  • Go to the retrieval_model folder for more information.

Pretrain Model

  • Pre-train BERT with claim-evidence pairs.
  • Go to the pretrain folder for more information.

KGAT Model

  • Our KGAT model.
  • Go to the kgat folder for more information.

Results

The results are all on Codalab leaderboard.

User Pre-train Model Label Accuracy FEVER Score
GEAR_single BERT (Base) 0.7160 0.6710
a.soleimani.b BERT (Large) 0.7186 0.6966
KGAT RoBERTa (Large) 0.7407 0.7038

KGAT performance with different pre-trained language model.

Pre-train Model Label Accuracy FEVER Score
BERT (Base) 0.7281 0.6940
BERT (Large) 0.7361 0.7024
RoBERTa (Large) 0.7407 0.7038
CorefBERT (RoBERT Large) 0.7596 0.7230

Citation

@inproceedings{liu2020kernel,
  title={Fine-grained Fact Verification with Kernel Graph Attention Network},
  author={Liu, Zhenghao and Xiong, Chenyan and Sun, Maosong and Liu, Zhiyuan},
  booktitle={Proceedings of ACL},
  year={2020}
}

@inproceedings{liu2020adapting,
    title = {Adapting Open Domain Fact Extraction and Verification to COVID-FACT through In-Domain Language Modeling},
    author = {Liu, Zhenghao and Xiong, Chenyan and Dai, Zhuyun and Sun, Si and Sun, Maosong and Liu, Zhiyuan},
    booktitle = {Findings of the Association for Computational Linguistics: EMNLP 2020},
   year={2020}
}

Contact

If you have questions, suggestions and bug reports, please email:

[email protected]