Skip to content

Commit

Permalink
Set sulpub pmid column to string
Browse files Browse the repository at this point in the history
  • Loading branch information
lwrubel committed Jul 18, 2024
1 parent a27a5a5 commit 5259179
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion rialto_airflow/harvest/merge_pubs.py
Original file line number Diff line number Diff line change
Expand Up @@ -88,7 +88,7 @@ def sulpub_df(sul_pub):
"""
Create a sulpub LazyFrame and rename columns
"""
df = pl.scan_csv(sul_pub, schema_overrides={"year": pl.String})
df = pl.scan_csv(sul_pub, schema_overrides={"year": pl.String, "pmid": pl.String})
df = df.drop_nulls("doi")
df = df.with_columns(
pl.col("doi").map_elements(normalize_doi, return_dtype=pl.String)
Expand Down

0 comments on commit 5259179

Please sign in to comment.