run bullmq test in github actions

[adiholden]

No description provided.

[chakaz]

I was able to fix our bullmq-tests.yml such that installation of dependencies, build and running the tests work (the tests don't pass though):

main...chakaz/regtests-bullmq

Locally all tests pass, and I know that the BullMQ team also runs their releases against Dragonfly. However when running the tests in GitHub I get some failures. In Debug ~25, and in release ~5. I suspect this is mostly due to timeouts and very slow / busy runner machine.

Is there a way to use our dedicated machine for running this test? I'm not familiar with that area :|

[adiholden]

@chakaz can you create a PR I want to check running locally the workflow and see if this reproduces this fails

[chakaz]

@adiholden #4275

[chakaz]

Here's a full brain-dump of my current state of things:

• I created a fork of bullmq with all required changes for the tests to pass: https://github.com/dragonflydb/bullmq
• We have a github workflow for running bullmq tests (bullmq-tests), currently it's not scheduled automatically
• I created a branch (chakaz/regtests-bullmq) with the required workflow .yml changes needed to get it to pass
• There are, potentially, 2 things we can improve in the workflow (both are also in comments in the workflow):
• 1. Build Dragonfly from main head instead of using the weekly container build
• 2. Use BullMQ's latest version instead of our custom fork

[chakaz]

Once #4565 is merged, we should be able to set up a scheduled run of the github workflow