fix: Split payload content by smaller batches for embedding

[whiterabbit1983]

Important

embed_docs in embed_docs.py now processes payloads in smaller batches asynchronously using batched and asyncio, with a new test case added.

• Behavior:
  • embed_docs in embed_docs.py now processes payload content in smaller batches using batched from itertools.
  • Introduces max_batch_size parameter to control batch size, defaulting to 100.
  • Uses asyncio.wait for asynchronous embedding of batches.
• Functions:
  • Adds embed_batch inner function to process each batch of indices and snippets.
  • Modifies embed_docs to use embed_batch for batch processing.
• Imports:
  • Adds asyncio and batched imports to support new batching logic.
• Tests:
  • Adds test case in test_activities.py to verify embed_docs with batching logic using unittest.mock.patch.

^{This description was created by for 30b26be. It will automatically update as commits are pushed.}

[ellipsis-dev]

❌ Changes requested. Reviewed everything up to 54bb2e8 in 33 seconds

More details

• Looked at 70 lines of code in 1 files
• Skipped 0 files when reviewing.
• Skipped posting 0 drafted comments based on config settings.

Workflow ID: wflow_FIAa0RNmiZNq7CCF

---

Want Ellipsis to fix these issues? Tag @ellipsis-dev in a comment. You can customize Ellipsis with 👍 / 👎 feedback, review rules, user-specific overrides, quiet mode, and more.

[ellipsis-dev]

❌ Changes requested. Incremental review on ec62ad4 in 21 seconds

More details

• Looked at 116 lines of code in 2 files
• Skipped 0 files when reviewing.
• Skipped posting 0 drafted comments based on config settings.

Workflow ID: wflow_I3kx3ykCwpJQk4Y6

---

Want Ellipsis to fix these issues? Tag @ellipsis-dev in a comment. You can customize Ellipsis with 👍 / 👎 feedback, review rules, user-specific overrides, quiet mode, and more.

[ellipsis-dev]

❌ Changes requested. Incremental review on 7505347 in 24 seconds

More details

• Looked at 116 lines of code in 2 files
• Skipped 0 files when reviewing.
• Skipped posting 0 drafted comments based on config settings.

Workflow ID: wflow_UqXhNfmt1sPs48pp

---

Want Ellipsis to fix these issues? Tag @ellipsis-dev in a comment. You can customize Ellipsis with 👍 / 👎 feedback, review rules, user-specific overrides, quiet mode, and more.

[ellipsis-dev]

❌ Changes requested. Incremental review on 0476f38 in 25 seconds

More details

• Looked at 77 lines of code in 1 files
• Skipped 0 files when reviewing.
• Skipped posting 0 drafted comments based on config settings.

Workflow ID: wflow_WbBquX6idAR3tRpX

---

Want Ellipsis to fix these issues? Tag @ellipsis-dev in a comment. You can customize Ellipsis with 👍 / 👎 feedback, review rules, user-specific overrides, quiet mode, and more.

[ellipsis-dev]

❌ Changes requested. Incremental review on cb9eb91 in 45 seconds

More details

• Looked at 60 lines of code in 1 files
• Skipped 0 files when reviewing.
• Skipped posting 2 drafted comments based on config settings.

1. agents-api/agents_api/activities/embed_docs.py:19

• Draft comment:
  The indices variable is created but not used in embed_snippets_query. Ensure that this is intentional and that indices are not needed.
• Reason this comment was not posted:
  Comment did not seem useful.

2. agents-api/agents_api/activities/embed_docs.py:49

• Draft comment:
  The max_batch_size parameter in mock_embed_docs is unused and can be removed for clarity.
• Reason this comment was not posted:
  Confidence changes required: 50%
  The mock_embed_docs function has a max_batch_size parameter that is not used. This is unnecessary and should be removed for clarity.

Workflow ID: wflow_qzPp0Wty8HHM5R3Q

---

Want Ellipsis to fix these issues? Tag @ellipsis-dev in a comment. You can customize Ellipsis with 👍 / 👎 feedback, review rules, user-specific overrides, quiet mode, and more.

[ellipsis-dev]

❌ Changes requested. Incremental review on 30b26be in 24 seconds

More details

• Looked at 60 lines of code in 1 files
• Skipped 0 files when reviewing.
• Skipped posting 0 drafted comments based on config settings.

Workflow ID: wflow_j5MnZy7166y1WaFm

---

Want Ellipsis to fix these issues? Tag @ellipsis-dev in a comment. You can customize Ellipsis with 👍 / 👎 feedback, review rules, user-specific overrides, quiet mode, and more.

[creatorrr]

lgtm. just double check the tests and typechecks (maybe add a mock embedding test with 1000 entries or something)