Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Mistral Pixtral multimodal support #1260

Open
wants to merge 13 commits into
base: main
Choose a base branch
from

Conversation

devin-ai-integration[bot]
Copy link
Contributor

Closes #1231

Adds support for Mistral's Pixtral model in instructor's multimodal system.

Changes:

  • Added MISTRAL_JSON mode
  • Implemented image handling for Mistral's API format
  • Added validation for Mistral's image requirements
  • Added tests for Mistral multimodal support
  • Updated documentation with Mistral example
  • Fixed documentation links and added missing sections

Link to Devin run: https://app.devin.ai/sessions/cebace15327246c1b1e8058824d73621

devin-ai-integration bot and others added 2 commits December 15, 2024 19:35
…ests

- Add Mistral multimodal client implementation
- Add image validation for Mistral requirements
- Add comprehensive test suite for Mistral multimodal
- Update README with Mistral Pixtral examples
- Add test configuration for Mistral API

Co-Authored-By: [email protected] <[email protected]>
Copy link

cloudflare-workers-and-pages bot commented Dec 15, 2024

Deploying instructor-py with  Cloudflare Pages  Cloudflare Pages

Latest commit: c4fd5e6
Status: ✅  Deploy successful!
Preview URL: https://401a47dd.instructor-py.pages.dev
Branch Preview URL: https://devin-1734290447-add-mistral.instructor-py.pages.dev

View logs

Copy link
Contributor Author

🤖 Devin AI Engineer

I'll be helping with this pull request! Here's what you should know:

✅ I will automatically:

  • Address comments on this PR
  • Look at CI failures and help fix them

⚙️ Control Options:

  • Disable automatic comment and CI monitoring

Add "(aside)" to your comment to have me ignore it.

@github-actions github-actions bot added documentation Improvements or additions to documentation enhancement New feature or request size:L This PR changes 100-499 lines, ignoring generated files. labels Dec 15, 2024
devin-ai-integration bot and others added 10 commits December 15, 2024 20:36
- Keep Union[] syntax instead of | for type hints to maintain Python 3.9 compatibility
- Add back required Mode import for image format conversion
- Fix duplicate source field in audio class

Co-Authored-By: [email protected] <[email protected]>
@devin-ai-integration devin-ai-integration bot force-pushed the devin/1734290447-add-mistral-pixtral-support branch from a9f2621 to 48a17fd Compare December 16, 2024 02:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation enhancement New feature or request size:L This PR changes 100-499 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Mistral Ai Image
0 participants