Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dataproc job - mandatory projectId field #257

Open
Ben8t opened this issue Jun 7, 2023 · 0 comments
Open

Dataproc job - mandatory projectId field #257

Ben8t opened this issue Jun 7, 2023 · 0 comments
Labels
area/plugin Plugin-related issue or feature request bug Something isn't working good first issue Great issue for new contributors

Comments

@Ben8t
Copy link
Member

Ben8t commented Jun 7, 2023

Expected Behavior

No response

Actual Behaviour

projectId is mandatory but not validated for the moment (so if the user don't provide the projectId it will end up with error)

image

id: spark_job
namespace: demo

tasks:

  - id: spark2
    type: io.kestra.plugin.gcp.dataproc.batches.PySparkSubmit
    fileUris: 
      - 'gs://bpimpaud-demo/spark/files'
    jarFileUris: 
      - 'gs://bpimpaud-demo/spark/jar'
    mainPythonFileUri: 'gs://bpimpaud-demo/spark/main.py'
    region: EU
    archiveUris: 
      - 'gs://bpimpaud-demo/spark/archive'
    name: test-pyspark
    args:
      - 'hello'

Steps To Reproduce

No response

Environment Information

  • Kestra Version:
  • Plugin version:
  • Operating System (OS / Docker / Kubernetes):
  • Java Version (If not docker):

Example flow

No response

@Ben8t Ben8t added bug Something isn't working area/plugin Plugin-related issue or feature request labels Jun 7, 2023
@Ben8t Ben8t added this to All issues Jun 7, 2023
@github-project-automation github-project-automation bot moved this to Backlog in All issues Jun 7, 2023
@anna-geller anna-geller moved this from Backlog to Ready in All issues Sep 7, 2023
@loicmathieu loicmathieu self-assigned this Sep 28, 2023
@loicmathieu loicmathieu moved this from Ready to In Progress in All issues Sep 28, 2023
@anna-geller anna-geller removed this from All issues Oct 30, 2023
@anna-geller anna-geller added this to the v0.18.0 milestone Dec 5, 2023
@loicmathieu loicmathieu removed their assignment May 23, 2024
@github-project-automation github-project-automation bot moved this to Backlog in Issues Jun 10, 2024
@anna-geller anna-geller removed this from the v0.18.0 milestone Aug 15, 2024
@tchiotludo tchiotludo added good first issue Great issue for new contributors and removed kind/good-first-issue labels Oct 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/plugin Plugin-related issue or feature request bug Something isn't working good first issue Great issue for new contributors
Projects
Status: Backlog
Status: Planned
Development

No branches or pull requests

4 participants