Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Develop #23

Open
wants to merge 10 commits into
base: main
Choose a base branch
from
Open

Develop #23

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
fb5cd09
Update my_funcs.py
dey-abhishek Sep 6, 2021
91943bb
Update my_funcs.py
dey-abhishek Sep 6, 2021
7e956a7
Commiting the changes
Oct 13, 2021
ceb20f5
This is a commit for demo purposes
Oct 17, 2021
8c5a939
Merge pull request #2 from dey-abhishek/demo_branch
dey-abhishek Oct 17, 2021
88bc575
Commit
Oct 17, 2021
f630fbd
Minor changes
Oct 18, 2021
8b8c366
Minor Comment for Demo
Oct 19, 2021
63631ed
Merge branch 'main' into Develop
dey-abhishek Oct 19, 2021
7732945
Comment
Oct 19, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions my_lib/my_funcs.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,3 +1,5 @@
# Databricks notebook source

def convertFtoC(unitCol, tempCol):
from pyspark.sql.functions import when, col
return when(col(unitCol) == "F", (col(tempCol) - 32) * (5/9)).otherwise(col(tempCol)).alias("temp_celcius")
Expand Down
16 changes: 5 additions & 11 deletions temperatures.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,15 +1,4 @@
# Databricks notebook source
# MAGIC %md
# MAGIC **NOTE**: the following cell _**should**_ fail.
# MAGIC
# MAGIC Relative imports of Python libraries are currently not supported. ([Custom libraries can be uploaded to the workspace or installed from PyPi](https://docs.databricks.com/libraries/workspace-libraries.html).)

# COMMAND ----------

from my_lib.my_funcs import *

# COMMAND ----------

# MAGIC %md
# MAGIC Using `%run` allows you to execute a Databricks notebook in the current SparkSession, bringing any imported modules, declared variables, or defined functions into the current scope.
# MAGIC
Expand Down Expand Up @@ -52,3 +41,8 @@
# COMMAND ----------

display(df.select(convertFtoC("unit", "temp")))

# COMMAND ----------

# This is a CICD Demo notebook for the getting workloads into production