Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unable to materialize iris_r asset on Ubuntu #1

Open
philiporlando opened this issue Feb 7, 2024 · 0 comments
Open

Unable to materialize iris_r asset on Ubuntu #1

philiporlando opened this issue Feb 7, 2024 · 0 comments
Assignees
Labels
bug Something isn't working

Comments

@philiporlando
Copy link
Owner

philiporlando commented Feb 7, 2024

This project was largely developed on my work machine, which is running Windows 10. Unfortunately, I'm seeing the below error when trying to materialize the iris_r asset from my personal machine, which is running Ubuntu 22.04:

dagster._core.errors.DagsterPipesExecutionError: External execution process failed with code 1

  File "/home/porlando/.cache/pypoetry/virtualenvs/dagster-and-r-kS5e8P_l-py3.10/lib/python3.10/site-packages/dagster/_core/execution/plan/execute_plan.py", line 286, in dagster_event_sequence_for_step
    for step_event in check.generator(step_events):
  File "/home/porlando/.cache/pypoetry/virtualenvs/dagster-and-r-kS5e8P_l-py3.10/lib/python3.10/site-packages/dagster/_core/execution/plan/execute_step.py", line 478, in core_dagster_event_sequence_for_step
    for user_event in _step_output_error_checked_user_event_sequence(
  File "/home/porlando/.cache/pypoetry/virtualenvs/dagster-and-r-kS5e8P_l-py3.10/lib/python3.10/site-packages/dagster/_core/execution/plan/execute_step.py", line 160, in _step_output_error_checked_user_event_sequence
    for user_event in user_event_sequence:
  File "/home/porlando/.cache/pypoetry/virtualenvs/dagster-and-r-kS5e8P_l-py3.10/lib/python3.10/site-packages/dagster/_core/execution/plan/execute_step.py", line 95, in _process_asset_results_to_events
    for user_event in user_event_sequence:
  File "/home/porlando/.cache/pypoetry/virtualenvs/dagster-and-r-kS5e8P_l-py3.10/lib/python3.10/site-packages/dagster/_core/execution/plan/compute.py", line 212, in execute_core_compute
    for step_output in _yield_compute_results(step_context, inputs, compute_fn, compute_context):
  File "/home/porlando/.cache/pypoetry/virtualenvs/dagster-and-r-kS5e8P_l-py3.10/lib/python3.10/site-packages/dagster/_core/execution/plan/compute.py", line 181, in _yield_compute_results
    for event in iterate_with_context(
  File "/home/porlando/.cache/pypoetry/virtualenvs/dagster-and-r-kS5e8P_l-py3.10/lib/python3.10/site-packages/dagster/_utils/__init__.py", line 465, in iterate_with_context
    next_output = next(iterator)
  File "/home/porlando/.cache/pypoetry/virtualenvs/dagster-and-r-kS5e8P_l-py3.10/lib/python3.10/site-packages/dagster/_core/execution/plan/compute_generator.py", line 131, in _coerce_op_compute_fn_to_iterator
    result = invoke_compute_fn(
  File "/home/porlando/.cache/pypoetry/virtualenvs/dagster-and-r-kS5e8P_l-py3.10/lib/python3.10/site-packages/dagster/_core/execution/plan/compute_generator.py", line 125, in invoke_compute_fn
    return fn(context, **args_to_pass) if context_arg_provided else fn(**args_to_pass)
  File "/home/porlando/Projects/dagster-and-r/dagster_and_r/assets.py", line 43, in iris_r
    return pipes_subprocess_client.run(
  File "/home/porlando/.cache/pypoetry/virtualenvs/dagster-and-r-kS5e8P_l-py3.10/lib/python3.10/site-packages/dagster/_core/pipes/subprocess.py", line 125, in run
    raise DagsterPipesExecutionError(

This error occurs somewhere near the context$report_asset_materialization() call within iris.R. I'm still seeing some of the other context being passed between R and Dagster prior to this error:

iris_r_error

More troubleshooting is needed before I can say more.

@philiporlando philiporlando added the bug Something isn't working label Feb 7, 2024
@philiporlando philiporlando self-assigned this Feb 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant