Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

RePair 2.0 #53

Merged
merged 66 commits into from
Jul 18, 2024
Merged

RePair 2.0 #53

merged 66 commits into from
Jul 18, 2024

Conversation

DelaramRajaei
Copy link
Member

Changes:

  • Query refinement

    • Global refiners
    • Local refiners
      • Added t5 as a local refiner

  • Added other commands to the pipeline

    • Query refinement
    • Similarity
    • Rag
    • Rag-fusion

  • Update the code line

    • Removing duplicates
    • Cleaner outputs
    • Updating Agg command for rag

  • Added Analyze file to better analyze the results

@DelaramRajaei
Debugging
93a03c5 
Update some files and solve issues.
@DelaramRajaei
Add refinement
c24a584 
add query class
add files related to refinement
update param.py file
@DelaramRajaei
Query class
04f52a5 
- Add a class for query
- Write functions for reading query and create an object of the query
@DelaramRajaei
update param and main
1f13624 
- Separate the code settings from corpus names and files.
- Add expanders
@DelaramRajaei
Updating RePair
56fb084 
- Add refiners
- Add Query Class
@DelaramRajaei
Update code
3a24a17 
- change some variables in Query class
- Debug and make changes for datasets such as robusts04
@DelaramRajaei
Update dataloader
4481189 
Reading queries now accept larger datasets with multiple topics and qrels.
@DelaramRajaei
Update files
b04ea40 
- Changed the directory of Query (dal >>> cmn)
- Update the files of the refiners
@DelaramRajaei
Update the Query class directory
a2d6ddd
@DelaramRajaei
Update aol.py
656605c
@DelaramRajaei
Fixing the bug for relevancefeedback refiner
660cd56
@DelaramRajaei
Fixed refiners
4f58794 
RM3 - RelevanceFeedback - BertQ
@DelaramRajaei
RAG Fusion
ac84673
@DelaramRajaei
Update the main source
2bfaf0e 
The code now can be run for multiple rankers and metrics
@DelaramRajaei
Fix typo
093bef3
@DelaramRajaei
Update pipeline
defbde9
@DelaramRajaei
Update README.md
0d467e5
@DelaramRajaei
Add files via upload
8fa2639
@DelaramRajaei
Delete classdiagram.png
de9191c
@DelaramRajaei
Delete Backtranslation.pdf
120fa11
@DelaramRajaei
Add files via upload
0373991
@DelaramRajaei
Update README.md
0ed9451
@DelaramRajaei
Update README.md
3f2c749
@DelaramRajaei
Update README.md
9ac6b93
@DelaramRajaei
Update README.md
42662b3
@DelaramRajaei
Update README.md
16077ef
@DelaramRajaei
Update README.md
84087e3
@DelaramRajaei
Update README.md
10ff8bb
@DelaramRajaei
Add similarity function
b4b09ac
@DelaramRajaei
Merge branch 'main' of https://github.com/DelaramRajaei/RePair
7f257fc
@DelaramRajaei
Update README.md
5ea1e41
@DelaramRajaei
Add files via upload
dd3ad47
@DelaramRajaei
Update README.md
bcbf21a
@DelaramRajaei
Delete similarity.pdf
e138e32
@DelaramRajaei
Add files via upload
0b8b0be
@DelaramRajaei
Update README.md
631c352
@DelaramRajaei
Add files via upload
0f0429a
@DelaramRajaei
Update README.md
ccf130d
@DelaramRajaei
Update README.md
fc78555
@DelaramRajaei
t5 as a refiner
0a3d58d
@DelaramRajaei
Merge branch 'main' of https://github.com/DelaramRajaei/RePair
6afa7cf
@DelaramRajaei
Squashed commit of the following:
121a763 
commit 6afa7cf
Merge: 0a3d58d fc78555
Author: Delaram Rajaei <[email protected]>
Date:   Fri Mar 8 18:13:22 2024 -0500

    Merge branch 'main' of https://github.com/DelaramRajaei/RePair

commit 0a3d58d
Author: Delaram Rajaei <[email protected]>
Date:   Fri Mar 8 18:13:19 2024 -0500

    t5 as a refiner

commit fc78555
Author: Delaram Rajaei <[email protected]>
Date:   Sat Feb 24 17:25:47 2024 -0500

    Update README.md

commit ccf130d
Author: Delaram Rajaei <[email protected]>
Date:   Sat Feb 24 17:16:46 2024 -0500

    Update README.md

commit 0f0429a
Author: Delaram Rajaei <[email protected]>
Date:   Sat Feb 24 17:14:31 2024 -0500

    Add files via upload

commit 631c352
Author: Delaram Rajaei <[email protected]>
Date:   Sat Feb 24 17:13:29 2024 -0500

    Update README.md

commit 0b8b0be
Author: Delaram Rajaei <[email protected]>
Date:   Sat Feb 24 17:05:52 2024 -0500

    Add files via upload

commit e138e32
Author: Delaram Rajaei <[email protected]>
Date:   Sat Feb 24 17:05:40 2024 -0500

    Delete similarity.pdf

commit bcbf21a
Author: Delaram Rajaei <[email protected]>
Date:   Sat Feb 24 17:05:19 2024 -0500

    Update README.md

commit dd3ad47
Author: Delaram Rajaei <[email protected]>
Date:   Sat Feb 24 16:56:28 2024 -0500

    Add files via upload

commit 5ea1e41
Author: Delaram Rajaei <[email protected]>
Date:   Sat Feb 24 16:56:05 2024 -0500

    Update README.md

commit 232e8e2
Author: Delaram Rajaei <[email protected]>
Date:   Sat Feb 24 16:39:18 2024 -0500

    Update README.md

commit 86e4b9d
Author: Delaram Rajaei <[email protected]>
Date:   Sat Feb 24 16:38:47 2024 -0500

    Update README.md

commit 98df678
Author: Delaram Rajaei <[email protected]>
Date:   Thu Feb 22 16:58:34 2024 -0500

    Update param.py

commit 1c61d22
Author: Delaram Rajaei <[email protected]>
Date:   Thu Feb 22 16:58:07 2024 -0500

    Add t5 as a refiner

commit f382029
Author: Delaram Rajaei <[email protected]>
Date:   Thu Feb 22 16:56:28 2024 -0500

    Update rag fusion

commit 2fbd9b9
Author: Delaram Rajaei <[email protected]>
Date:   Thu Feb 22 14:42:59 2024 -0500

    Fix the bug of search

commit e99edb7
Author: Delaram Rajaei <[email protected]>
Date:   Wed Feb 14 16:19:29 2024 -0500

    Update ds

    Add RRF
    Update search function

commit 7f257fc
Merge: b4b09ac 10ff8bb
Author: Delaram Rajaei <[email protected]>
Date:   Wed Feb 14 16:12:07 2024 -0500

    Merge branch 'main' of https://github.com/DelaramRajaei/RePair

commit b4b09ac
Author: Delaram Rajaei <[email protected]>
Date:   Wed Feb 14 16:12:04 2024 -0500

    Add similarity function

commit 10ff8bb
Author: Delaram Rajaei <[email protected]>
Date:   Mon Feb 12 17:26:38 2024 -0500

    Update README.md

commit 84087e3
Author: Delaram Rajaei <[email protected]>
Date:   Mon Feb 12 17:07:52 2024 -0500

    Update README.md

commit 16077ef
Author: Delaram Rajaei <[email protected]>
Date:   Mon Feb 12 17:01:42 2024 -0500

    Update README.md

commit 42662b3
Author: Delaram Rajaei <[email protected]>
Date:   Mon Feb 12 16:37:53 2024 -0500

    Update README.md

commit 9ac6b93
Author: Delaram Rajaei <[email protected]>
Date:   Mon Feb 12 16:36:34 2024 -0500

    Update README.md

commit 3f2c749
Author: Delaram Rajaei <[email protected]>
Date:   Mon Feb 12 16:21:32 2024 -0500

    Update README.md

commit 0ed9451
Author: Delaram Rajaei <[email protected]>
Date:   Mon Feb 12 16:18:27 2024 -0500

    Update README.md

commit 0373991
Author: Delaram Rajaei <[email protected]>
Date:   Mon Feb 12 16:17:36 2024 -0500

    Add files via upload

commit 120fa11
Author: Delaram Rajaei <[email protected]>
Date:   Mon Feb 12 16:16:40 2024 -0500

    Delete Backtranslation.pdf

commit de9191c
Author: Delaram Rajaei <[email protected]>
Date:   Mon Feb 12 16:16:04 2024 -0500

    Delete classdiagram.png

commit 8fa2639
Author: Delaram Rajaei <[email protected]>
Date:   Mon Feb 12 16:14:49 2024 -0500

    Add files via upload

commit 0d467e5
Author: Delaram Rajaei <[email protected]>
Date:   Mon Feb 12 16:13:41 2024 -0500

    Update README.md

commit defbde9
Author: Delaram Rajaei <[email protected]>
Date:   Mon Feb 12 15:35:01 2024 -0500

    Update pipeline

commit 093bef3
Author: Delaram Rajaei <[email protected]>
Date:   Mon Jan 15 18:45:32 2024 -0500

    Fix typo

commit 2bfaf0e
Author: Delaram Rajaei <[email protected]>
Date:   Mon Jan 15 18:44:40 2024 -0500

    Update the main source

    The code now can be run for multiple rankers and metrics

commit ac84673
Author: Delaram Rajaei <[email protected]>
Date:   Mon Jan 15 15:07:37 2024 -0500

    RAG Fusion

commit 4f58794
Author: Delaram Rajaei <[email protected]>
Date:   Mon Jan 15 11:16:40 2024 -0500

    Fixed refiners

    RM3 - RelevanceFeedback - BertQ

commit 660cd56
Author: Delaram Rajaei <[email protected]>
Date:   Wed Dec 27 14:36:14 2023 -0500

    Fixing the bug for relevancefeedback refiner

commit 656605c
Author: Delaram Rajaei <[email protected]>
Date:   Fri Dec 22 13:20:22 2023 -0500

    Update aol.py

commit a2d6ddd
Author: Delaram Rajaei <[email protected]>
Date:   Fri Dec 22 13:20:14 2023 -0500

    Update the Query class directory

commit b04ea40
Author: Delaram Rajaei <[email protected]>
Date:   Fri Dec 22 13:19:41 2023 -0500

    Update files

    - Changed the directory of Query (dal >>> cmn)
    - Update the files of the refiners

commit 4481189
Author: Delaram Rajaei <[email protected]>
Date:   Wed Nov 29 18:21:29 2023 -0500

    Update dataloader

    Reading queries now accept larger datasets with multiple topics and qrels.

commit 3a24a17
Author: Delaram Rajaei <[email protected]>
Date:   Mon Nov 20 18:40:02 2023 -0500

    Update code

    - change some variables in Query class
    - Debug and make changes for datasets such as robusts04

commit 56fb084
Author: Delaram Rajaei <[email protected]>
Date:   Fri Nov 17 16:43:20 2023 -0500

    Updating RePair

    - Add refiners
    - Add Query Class

commit 1f13624
Author: Delaram Rajaei <[email protected]>
Date:   Thu Nov 2 19:14:05 2023 -0400

    update param and main

    - Separate the code settings from corpus names and files.
    - Add expanders

commit 04f52a5
Author: Delaram Rajaei <[email protected]>
Date:   Thu Nov 2 19:10:56 2023 -0400

    Query class

    - Add a class for query
    - Write functions for reading query and create an object of the query

commit c24a584
Author: Delaram Rajaei <[email protected]>
Date:   Wed Nov 1 18:30:05 2023 -0400

    Add refinement

    add query class
    add files related to refinement
    update param.py file

commit 93a03c5
Author: Delaram Rajaei <[email protected]>
Date:   Fri Oct 27 16:27:35 2023 -0400

    Debugging

    Update some files and solve issues.
@DelaramRajaei
Updates on RePair (#52)
ac081fb 
* Debugging

Update some files and solve issues.

* Add refinement

add query class
add files related to refinement
update param.py file

* Query class

- Add a class for query
- Write functions for reading query and create an object of the query

* update param and main

- Separate the code settings from corpus names and files.
- Add expanders

* Updating RePair

- Add refiners
- Add Query Class

* Update code

- change some variables in Query class
- Debug and make changes for datasets such as robusts04

* Update dataloader

Reading queries now accept larger datasets with multiple topics and qrels.

* Update files

- Changed the directory of Query (dal >>> cmn)
- Update the files of the refiners

* Update the Query class directory

* Update aol.py

* Fixing the bug for relevancefeedback refiner

* Fixed refiners

RM3 - RelevanceFeedback - BertQ

* RAG Fusion

* Update the main source

The code now can be run for multiple rankers and metrics

* Fix typo

* Update pipeline

* Update README.md

* Add files via upload

* Delete classdiagram.png

* Delete Backtranslation.pdf

* Add files via upload

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Add similarity function

* Update ds

Add RRF
Update search function

* Fix the bug of search

* Update rag fusion

* Add t5 as a refiner

* Update param.py

* Update README.md

* Update README.md

* Update README.md

* Add files via upload

* Update README.md

* Delete similarity.pdf

* Add files via upload

* Update README.md

* Add files via upload

* Update README.md

* Update README.md

* t5 as a refiner
@DelaramRajaei
Merge branch 'NQLB' into pr/52
f8d7a36
@DelaramRajaei
add analyze.py
0d506e0 
Contain different functions to analyze the results.
@DelaramRajaei
update aggregate
9420c4c 
add lines to aggregate the rag-fusion results with other refiners
@DelaramRajaei
Add google translator
fe3d081
@DelaramRajaei
add multiple translators
0c0271b
@DelaramRajaei
update requirements
046cc19
@DelaramRajaei
update names
d596ea9
@DelaramRajaei
Update code
e49ed09
@DelaramRajaei
Update pipline
4f6d5c8
@DelaramRajaei
Update ds
ae9c058 
- pairing queries in trec datasets
- writing queries in a file
- updating agg function for rag, build, add
@DelaramRajaei
add pairing function
de4273d
@DelaramRajaei
Update the project
e930ed4
@DelaramRajaei
Delete misc/flow.png
719f78c
@DelaramRajaei
Add files via upload
2013792
@DelaramRajaei
Update README.md
bdf2caf
@DelaramRajaei
Update README.md
7071756
@hosseinfani hosseinfani merged commit 3659633 into main Jul 18, 2024
1 check failed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@DelaramRajaei @hosseinfani