Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Generate Structured JSON Output with Gemini API to feed into imagen #453

Open
Yousif-GO opened this issue Feb 11, 2025 · 7 comments
Open
Assignees
Labels
component:quickstarts Issues/PR referencing quickstarts folder status:triaged Issue/PR triaged to the corresponding sub-team type:feature request New feature request/enhancement

Comments

@Yousif-GO
Copy link

Description of the feature request:

Showcase how to use structured output to prompt Imagen into consistent character and scene generation. By leveraging Gemini's ability to generate structured JSON output, users can feed standardized data into Imagen—enabling automated, reliable, and predictable image and scene generation.

What problem are you trying to solve with this feature?

Consistent scene generation is essential for:

  • Story telling: Ensuring narrative consistency throughout the generated content.
  • Character development: Producing uniform character portrayals across scenes.
  • Scene generation: Creating cohesive visuals that align with the narrative structure.
  • Movie generation: Seamlessly linking individual scenes into a full-length video.

Most demos for Imagen rely on using single, lengthy prompts. Using Gemini’s structured outputs will not only demonstrate the strength of the Gemini API but also expand Imagen's use cases—providing more robust ways to utilize and integrate it in creative workflows.

Any other information you'd like to share?

I have created a demo for this feature here and have submitted a pull request with the new feature with

1739225609_output_video.mp4

video generation for demonstration.

@Yousif-GO
Copy link
Author

This is inappropriate , I am closing this issue as I don't have access to remove such spam

@markmcd markmcd reopened this Feb 17, 2025
@gmKeshari gmKeshari added type:feature request New feature request/enhancement status:triaged Issue/PR triaged to the corresponding sub-team component:quickstarts Issues/PR referencing quickstarts folder labels Feb 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component:quickstarts Issues/PR referencing quickstarts folder status:triaged Issue/PR triaged to the corresponding sub-team type:feature request New feature request/enhancement
Projects
None yet
Development

No branches or pull requests

5 participants
@markmcd @Giom-V @Yousif-GO @gmKeshari and others