Skip to content

Commit

Permalink
docs: add structured_dataset_workflow_with_nested_type
Browse files Browse the repository at this point in the history
Signed-off-by: Austin Liu <[email protected]>
  • Loading branch information
austin362667 committed Jun 7, 2024
1 parent 25c3596 commit 474a554
Showing 1 changed file with 10 additions and 0 deletions.
10 changes: 10 additions & 0 deletions docs/user_guide/data_types_and_io/structureddataset.md
Original file line number Diff line number Diff line change
Expand Up @@ -265,3 +265,13 @@ Nested field StructuredDataset should be run when flytekit version > 1.11.0.
```

[flytesnacks]: https://github.com/flyteorg/flytesnacks/tree/master/examples/data_types_and_io/

### The nested typed columns

Most storage formats have support for nested field structures today (Avro, parquet, bq) and so is StructuredDatasets.


```{rli} https://raw.githubusercontent.com/flyteorg/flytesnacks/master/examples/data_types_and_io/data_types_and_io/structured_dataset.py
:caption: data_types_and_io/structured_dataset.py
:lines: 158-293
```

0 comments on commit 474a554

Please sign in to comment.