Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DATA PERPROCESS #15

Open
zwang0621 opened this issue Feb 4, 2025 · 1 comment
Open

DATA PERPROCESS #15

zwang0621 opened this issue Feb 4, 2025 · 1 comment

Comments

@zwang0621
Copy link

Thank you for your work. I have a small question to ask regarding the generate_profile.py file in the generation subdirectory. Currently, it can only generate responses (i.e., summarizations and reasonings) for a single random prompt. If I have a dataset with tens of thousands of entries, how can I implement batch generation of responses and write them into a new file? Additionally, do the item_prf.pkl and user_prf.pkl files in your dataset include all these summarizations and reasonings?

@Re-bin
Copy link
Collaborator

Re-bin commented Feb 12, 2025

Hi 👋!

Thanks for your interest in RLMRec! I think you can utilize the batch API provided by OpenAI or multi-thread programming for profile generation to accelerate the process.

Additionally, the provided item_prf.pkl and user_prf.pkl files contain all the summarizations and reasoning for users/items in our provided datasets.

Best regards,
Xubin

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants