Skip to content
rzanoli edited this page May 9, 2014 · 69 revisions

This page reports the experiments did by users and the results they obtained. This allows other users to replicate those experiments under the same condition or avoid doing the experiments that have already been done.

Users that would like to share their results with the other EOP users can either upload their results into this page directly (a GitHub account is needed) or they can contact the EOP members by the provided mailing lists.

Experiments List:

EDA Data Lang Lexical Resources Results Exp
BIUTEE
RTE-3 EN WN,CV link
EDITS
RTE-3 DE 0.61250 link
RTE-3 DE WN 0.61375 link
RTE-3 EN 0.62375 link
RTE-3 EN WN 0.64375 link
RTE-3 IT 0.60625 link
RTE-3 IT WN 0.61625 link
TIE
RTE-3 DE DS,DBPos,TP,TPPos,TS 0.62875 link
RTE-3 DE GNPos,DBPos,TP,TPPos,TS 0.63125 link
RTE-3 DE GNPos,DS,DBPos,TP,TPPos,TS 0.63125 link
RTE-3 EN VO,TP,TPPos,TS 0.64000 link
RTE-3 EN WN,TP,TPPos,TS 0.65250 link
RTE-3 EN WN,VO,TP,TPPos,TS 0.64625 link

CV: CatVar
WN: WordNet
WP: Wikipedia
VO: VerbOcean
GNPos: GermaNet with POS tags
DS: DewakDistributional
DBPos: DerivBase with POS tags
TP: TreePatterns, i.e., set of dependency relations (head, label, mod) of parsed sentence
TPPos: TreePatterns with POS tags
TS: TreeSkeleton, i.e., sequence kernel representation of dependency tree of parsed sentence


BIUTEE EDA

**EXPERIMENT:** B1

Configuration ID: BIUTEE_WordNet_CatVar_EN

Data Set: RTE-3
Language: EN
Lexical Resources: WN, CV
Preprocessing:
Results(Accuracy): ----

Author name: Omer Levy
Affiliation: Bar-Ilan University
Contact:

Download the configuration file, model and results

EditDistance EDA

**EXPERIMENT:** E1

Configuration ID: EditDistanceEDA_DE

Data Set: RTE-3
Language: DE
Lexical Resources: none
Preprocessing: TreeTagger
Results(Accuracy): 0.61250

Author name: Roberto Zanoli
Affiliation: Fondazione Bruno Kessler (FBK)
Contact Information: zanoli [at] fbk.eu

Download the configuration file, model and results

**EXPERIMENT:** E2

Configuration ID: EditDistanceEDA_DE_WordNet

Data Set: RTE-3
Language: DE
Lexical Resources: WN
Preprocessing: TreeTagger
Results(Accuracy): 0.61375

Author name: Roberto Zanoli
Affiliation: Fondazione Bruno Kessler (FBK)
Contact Information: zanoli [at] fbk.eu

Download the configuration file, model and results

**EXPERIMENT:** E3

Configuration ID: EditDistanceEDA_EN

Data Set: RTE-3
Language: EN
Lexical Resources: none
Preprocessing: TreeTagger
Results(Accuracy): 0.62375

Author name: Roberto Zanoli
Affiliation: Fondazione Bruno Kessler (FBK)
Contact Information: zanoli [at] fbk.eu

Download the configuration file, model and results

**EXPERIMENT:** E4

Configuration ID: EditDistanceEDA_EN_WordNet

Data Set: RTE-3
Language: EN
Lexical Resources: WN
Preprocessing: TreeTagger
Results(Accuracy): 0.64375

Author name: Roberto Zanoli
Affiliation: Fondazione Bruno Kessler (FBK)
Contact Information: zanoli [at] fbk.eu

Download the configuration file, model and results

**EXPERIMENT:** E5

Configuration ID: EditDistanceEDA_IT

Data Set: RTE-3
Language: IT
Lexical Resources: none
Preprocessing: TextPro
Results(Accuracy): 0.60625

Author name: Roberto Zanoli
Affiliation: Fondazione Bruno Kessler (FBK)
Contact Information: zanoli [at] fbk.eu

Download the configuration file, model and results

**EXPERIMENT:** E6

Configuration ID: EditDistanceEDA_IT_WordNet

Data Set: RTE-3
Language: IT
Lexical Resources: WN
Preprocessing: TextPro
Results(Accuracy): 0.61625

Author name: Roberto Zanoli
Affiliation: Fondazione Bruno Kessler (FBK)
Contact Information: zanoli [at] fbk.eu

Download the configuration file, model and results

TIE EDA

**EXPERIMENT:** T1

Configuration ID: MaxEntClassificationEDA_Base+DS+DBPos+TP+TPPos+TS_DE

Data Set: RTE-3
Language: DE
Lexical Resources: DS,DBPos,TP,TPPos,TS
Preprocessing: MaltParserDE
Results(Accuracy): 0.62875

Author name: Günter Neumann
Affiliation: Deutsche Forschungszentrum für Künstliche Intelligenz GmbH (DFKI)
Contact Information: neumann [@] dfki.de

Download the configuration file, model and results

**EXPERIMENT:** T2

Configuration ID: MaxEntClassificationEDA_Base+GNPos+DBPos+TP+TPPos+TS_DE

Data Set: RTE-3
Language: DE
Lexical Resources: GNPos,DBPos,TP,TPPos,TS
Preprocessing: MaltParserDE
Results(Accuracy): 0.63125

Author name: Günter Neumann
Affiliation: Deutsche Forschungszentrum für Künstliche Intelligenz GmbH (DFKI)
Contact Information: neumann [@] dfki.de

Download the configuration file, model and results

**EXPERIMENT:** T3

Configuration ID: MaxEntClassificationEDA_Base+GNPos+DS+DBPos+TP+TPPos+TS_DE

Data Set: RTE-3
Language: DE
Lexical Resources: GNPos,DS,DBPos,TP,TPPos,TS
Preprocessing: MaltParserDE
Results(Accuracy): 0.63125

Author name: Günter Neumann
Affiliation: Deutsche Forschungszentrum für Künstliche Intelligenz GmbH (DFKI)
Contact Information: neumann [@] dfki.de

Download the configuration file, model and results

**EXPERIMENT:** T4

Configuration ID: MaxEntClassificationEDA_Base+VO+TP+TPPos+TS_EN

Data Set: RTE-3
Language: EN
Lexical Resources: VO,TP,TPPos,TS
Preprocessing: MaltParserEN
Results(Accuracy): 0.64000

Author name: Günter Neumann
Affiliation: Deutsche Forschungszentrum für Künstliche Intelligenz GmbH (DFKI)
Contact Information: neumann [@] dfki.de

Download the configuration file, model and results

**EXPERIMENT:** T5

Configuration ID: MaxEntClassificationEDA_Base+WN+TP+TPPos+TS_EN

Data Set: RTE-3
Language: EN
Lexical Resources: WN,TP,TPPos,TS
Preprocessing: MaltParserEN
Results(Accuracy): 0.65250

Author name: Günter Neumann
Affiliation: Deutsche Forschungszentrum für Künstliche Intelligenz GmbH (DFKI)
Contact Information: neumann [@] dfki.de

Download the configuration file, model and results

**EXPERIMENT:** T6

Configuration ID: MaxEntClassificationEDA_Base+WN+VO+TP+TPPos+TS_EN

Data Set: RTE-3
Language: EN
Lexical Resources: WN,VO,TP,TPPos,TS
Preprocessing: MaltParserEN
Results(Accuracy): 0.64625

Author name: Günter Neumann
Affiliation: Deutsche Forschungszentrum für Künstliche Intelligenz GmbH (DFKI)
Contact Information: neumann [@] dfki.de

Download the configuration file, model and results


Clone this wiki locally