Relevance Scoring Prompt Refinement

[0x4007]

Use this as an example to adjust the prompt to catch gentlemenlegen comments and make them score low, because they are not relevant to the task at hand but still earned a high score.

Relevance scoring could have done so much better here for you @gentlementlegen

Perhaps this conversation should be saved as a unit test of sorts so that we can improve the relevance scoring prompt

Originally posted by @0x4007 in ubiquity-os-marketplace/text-vector-embeddings#56 (comment)

[ubiquity-os-beta]

Note

The following contributors may be suitable for this task:

sshivaditya2019

78% Match ubiquity-os-marketplace/text-conversation-rewards#97

jaykayudo

78% Match ubiquity-os-marketplace/text-conversation-rewards#147

EresDev

78% Match ubiquity-os-marketplace/text-conversation-rewards#45

[ubiquity-os-beta]

Note

The following contributors may be suitable for this task:

sshivaditya2019

78% Match ubiquity-os-marketplace/text-conversation-rewards#97

jaykayudo

78% Match ubiquity-os-marketplace/text-conversation-rewards#147

EresDev

78% Match ubiquity-os-marketplace/text-conversation-rewards#45

[0x4007]

@sshivaditya also here with the double recommendation comment.

[sura1-0-1]

/help

[ubiquity-os-beta]

Available Commands

Command	Description	Example
/help	List all available commands.	/help
/allow	Allows the user to modify the given label type.	/allow @user1 label
/ask	Ask any question about the repository, issue or pull request	/ask
/query	Returns the user's wallet, access, and multiplier information.	/query @UbiquityOS
/start	Assign yourself and/or others to the issue/task.	/start
/stop	Unassign yourself from the issue/task.	/stop
/wallet	Register your wallet address for payments. Use '/wallet unset' to unlink your wallet.	/wallet ubq.eth

[sura1-0-1]

/wallet 0x6C4E0B11704228B338A383380b6415453A30278f

[ubiquity-os-beta]

+ Successfully set wallet

[sura1-0-1]

/start

[ubiquity-os-beta]

Deadline	Fri, Dec 20, 6:30 PM UTC
Beneficiary	0x6C4E0B11704228B338A383380b6415453A30278f

Tip

• Use /wallet 0x0000...0000 if you want to update your registered payment wallet address.
• Be sure to open a draft pull request as soon as possible to communicate updates on your progress.
• Be sure to provide timely updates to us when requested, or you will be automatically unassigned from the task.

[sura1-0-1]

@0x4007 Should the prompt specifically target comments from gentlementlegen or any other specific users ?

[0x4007]

No definitely not

[sura1-0-1]

No definitely not

Alright, I have created a PR. Can you review the updated prompt?

[ubiquity-os-beta]

Passed the disqualification threshold and no activity is detected, removing assignees: @sura1-0-1.