Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merge main02 #13

Open
wants to merge 78 commits into
base: snowflake-source-scala-update
Choose a base branch
from
Open
Changes from 1 commit
Commits
Show all changes
78 commits
Select commit Hold shift + click to select a range
88a0348
Update outdated docs (WASB_ to BLOB_) (#850)
loomlike Nov 11, 2022
0c2d936
Update registry nightly deploy CICD (#853)
blrchen Nov 12, 2022
e2ee979
Windoze/purview registry error log (#851)
windoze Nov 12, 2022
8511289
Fix duplicate action id in registry CICD (#854)
blrchen Nov 14, 2022
5903842
Improve Feathr Client initialisation logs (#856)
blrchen Nov 14, 2022
4e60297
Enhance error messages of synapse jobs (#855)
enya-yx Nov 14, 2022
14f0f12
Fix avro files read failure under timePartitionPattern paths (#808)
enya-yx Nov 14, 2022
1028357
Bump version to 0.9.0-rc3 (#860)
blrchen Nov 16, 2022
99eac59
Enhance sample notebook (#848)
enya-yx Nov 16, 2022
c5cc1f8
Bump loader-utils from 2.0.3 to 2.0.4 in /ui (#861)
dependabot[bot] Nov 17, 2022
ae05fbf
Fix unexpected 500 error from PurView registry. (#863)
windoze Nov 17, 2022
44716c1
Include noop-1.0.jar into the wheel (#859)
windoze Nov 17, 2022
9f2ab71
PurView returns wrong status code on error (#864)
windoze Nov 17, 2022
a4dc54f
Expose Registry status code through RBAC layer (#866)
Yuqing-cat Nov 18, 2022
7ebf604
Fix purview registry docker build break (#868)
blrchen Nov 18, 2022
8237b10
Fix PV registry bug (#871)
windoze Nov 18, 2022
3c426ff
Bump version to 0.9.0 (#867)
blrchen Nov 18, 2022
5d565a9
Clean up some links that's referring to LinkedIn (#872)
xiaoyongzhu Nov 18, 2022
32d9333
Insert test coverage check for python client into github pipeline (#862)
enya-yx Nov 21, 2022
69e6cc6
Create docs on how to update Feathr client and registry, and how to p…
xiaoyongzhu Nov 22, 2022
ca09fe3
Add a custom pytest marker config to pyproject.toml (#786)
loomlike Nov 22, 2022
26c14b4
fix broken link (#874)
xiaoyongzhu Nov 22, 2022
c21d89d
Separate out snowflake source (#836)
aabbasi-hbo Nov 23, 2022
799fac0
Decouple build feature code (#838)
xiaoyongzhu Nov 23, 2022
15550ca
Refining example, add utilities, and fix xdist test error (#794)
loomlike Nov 23, 2022
654d56e
Add 'format' arg to get_result_df (#885)
loomlike Nov 29, 2022
758f249
Add a new compute model to Feathr (#820)
rakeshkashyap123 Nov 30, 2022
87bc3cf
Add job_tag to materialization job submission. Change get_result_df's…
loomlike Dec 1, 2022
1784e9a
Bump minimatch and recursive-readdir in /ui (#889)
dependabot[bot] Dec 1, 2022
5e8803a
Add docs for checking/improving test coverage (#884)
enya-yx Dec 1, 2022
73d2815
Expose deletion API for projects/features (#852)
aabbasi-hbo Dec 1, 2022
4efb683
Add KeyError for Key and Feature Type (#877)
Yuqing-cat Dec 2, 2022
f8a7e76
add sql credential pass through doc (#883)
Yuqing-cat Dec 2, 2022
adab8d8
update registry test, modify log (#892)
Yuqing-cat Dec 2, 2022
1ccbcdf
Fix empty job tag (#895)
loomlike Dec 2, 2022
d42d0ab
Add feature embedding example (#881)
loomlike Dec 2, 2022
5018d7b
Bump decode-uri-component from 0.2.0 to 0.2.2 in /ui (#896)
dependabot[bot] Dec 2, 2022
3c48645
Add 'postfixPath' to support time pattern in the middle of paths (#858)
enya-yx Dec 2, 2022
90a6b6d
Fix test cases caused by invalid key type (#897)
enya-yx Dec 3, 2022
e9495d4
Add a new method for standard DotProduct for users seeking non-normal…
shashankiiit Dec 5, 2022
77571fd
Fix broken CI tests and test release code (#894)
rakeshkashyap123 Dec 7, 2022
786301f
Fix test failure (#904)
jaymo001 Dec 7, 2022
2852a5c
UI add feature the deletion for projects/features/dataSource (#909)
Fendoe Dec 9, 2022
9a98253
Fixing Bugs reported during oncall (#908)
jainr Dec 9, 2022
bafff04
Ignore 'registry_utils' in test coverage (#907)
enya-yx Dec 9, 2022
e587042
Update azure_resource_provision.json (#912)
xiaoyongzhu Dec 9, 2022
cd4de09
Exclude pegasus jars and release version (#913)
rakeshkashyap123 Dec 9, 2022
e25012a
Exclude pegasus data files (#916)
rakeshkashyap123 Dec 12, 2022
8c8f667
Fix auto-tz casting bug (#905)
bozhonghu Dec 15, 2022
8c8dfde
Support printing features and returning keys when getting features fr…
enya-yx Dec 16, 2022
66480d7
Adding Continous Integration == ON flag in app settings (#927)
jainr Dec 16, 2022
e53ce96
Add use_env_var flag to client (#923)
loomlike Dec 22, 2022
3b40fed
Format docs and add tech talks (#931)
xiaoyongzhu Dec 24, 2022
cd2d6fa
Add is_synapse() (#929)
loomlike Dec 27, 2022
4cd24f1
publish fat jar in maven update action (#935)
Yuqing-cat Jan 3, 2023
4b721a3
#926 (#928)
Yuqing-cat Jan 4, 2023
2bdb94f
Support get online features by composite keys (#919)
enya-yx Jan 4, 2023
9b04bda
React best practice implementations in ui code (#938)
blrchen Jan 4, 2023
b6c1f0e
fix numpy version conflict w/ pyspark (#940)
loomlike Jan 4, 2023
af0e66e
Add presentation for Feathr community talk (#941)
xiaoyongzhu Jan 5, 2023
9c338bc
Add FIRST aggregation for look up feature (#917)
jaymo001 Jan 5, 2023
f0e1079
Disable auth if Feathr is deployed with RBAC set to off (#925)
Fendoe Jan 5, 2023
01ea96d
Update sample notebooks (fraud detection and recommendation examples)…
loomlike Jan 6, 2023
308321d
Windoze/spark sql source (#839)
windoze Jan 6, 2023
e1895bb
Updates on docs (#950)
blrchen Jan 10, 2023
2db1aad
Lock python deps version for registry projects (#946)
blrchen Jan 10, 2023
c967f6d
Add pytest cases and check test coverage for sql-registry and purview…
enya-yx Jan 10, 2023
be81c3f
Fix delete entity function bug for #852 (#952)
Yuqing-cat Jan 10, 2023
bf01f24
Remove hadoop dependency (#949)
rakeshkashyap123 Jan 10, 2023
0873c6f
Create new feature form (#936)
Fendoe Jan 11, 2023
7a86d4d
set purview name environment variable in workflow (#956)
enya-yx Jan 11, 2023
a923a9d
Bug fix - Fraud detection sample notebook chart error. (#948)
loomlike Jan 11, 2023
3a76b1c
update registry start shell (#954)
Yuqing-cat Jan 12, 2023
049ab9a
Improve error message for checking feature keys (#959)
enya-yx Jan 12, 2023
8c74f94
merge changes
aabbasi-hbo Jan 13, 2023
f33cc7c
changes
aabbasi-hbo Jan 18, 2023
b23428e
update imports
aabbasi-hbo Jan 18, 2023
bdda635
remove double
aabbasi-hbo Jan 19, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
remove double
  • Loading branch information
aabbasi-hbo committed Jan 19, 2023
commit bdda635954ed97f7f20505e140281f09fa1152d8
Original file line number Diff line number Diff line change
@@ -284,7 +284,6 @@ object FeatureJoinJob {
"sql-config" -> OptionParam("sqlc", "Authentication config for Azure SQL Database (jdbc)", "SQL_CONFIG", ""),
"snowflake-config" -> OptionParam("sfc", "Authentication config for Snowflake Database (jdbc)", "SNOWFLAKE_CONFIG", ""),
"use-fcm" -> OptionParam("ufcm", "If set to true, use FCM client, else use Feathr Client", "USE_FCM", "false"),
"snowflake-config" -> OptionParam("sfc", "Authentication config for Snowflake Database (jdbc)", "SNOWFLAKE_CONFIG", ""),
"system-properties" -> OptionParam("sps", "Additional System Properties", "SYSTEM_PROPERTIES_CONFIG", "")
)

12 changes: 0 additions & 12 deletions registry/access_control/api.py
Original file line number Diff line number Diff line change
@@ -25,13 +25,6 @@ async def get_project(project: str, response: Response, access: UserAccess = Dep
headers=get_api_header(access.user_name)))
return res


@router.get("/dependent/{entity}", name="Get downstream/dependent entitites for a given entity [Read Access Required]")
def get_dependent_entities(entity: str, access: UserAccess = Depends(project_read_access)):
response = requests.get(url=f"{registry_url}/dependent/{entity}",
headers=get_api_header(access.user_name)).content.decode('utf-8')
return json.loads(response)

@router.get("/dependent/{entity}", name="Get downstream/dependent entitites for a given entity [Read Access Required]")
def get_dependent_entities(entity: str, access: UserAccess = Depends(project_read_access)):
response = requests.get(url=f"{registry_url}/dependent/{entity}",
@@ -76,11 +69,6 @@ def delete_entity(entity: str, response: Response, access: UserAccess = Depends(
url=f"{registry_url}/entity/{entity}", headers=get_api_header(access.user_name)))
return res

@router.delete("/entity/{entity}", name="Deletes a single entity by qualified name [Write Access Required]")
def delete_entity(entity: str, access: UserAccess = Depends(project_write_access)) -> str:
requests.delete(url=f"{registry_url}/entity/{feature}",
headers=get_api_header(access.user_name)).content.decode('utf-8')

@router.get("/features/{feature}/lineage", name="Get Feature Lineage [Read Access Required]")
def get_feature_lineage(feature: str, response: Response, requestor: User = Depends(get_user)) -> dict:
response.status_code, res = check(requests.get(url=f"{registry_url}/features/{feature}/lineage",