Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Monorepo] - Step 1 - Import golang repos #3881

Closed
wants to merge 1,948 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1948 commits
Select commit Hold shift + click to select a range
acbf818
Adding configurable audience property for flyte clients (#485)
pmahindrakar-oss Nov 10, 2022
e85a258
Scoop update for datacatalog version v1.0.12
goreleaserbot Nov 10, 2022
c665e36
Scoop update for datacatalog version v1.0.13
goreleaserbot Nov 10, 2022
98b576a
Scoop update for datacatalog version v1.0.14
goreleaserbot Nov 10, 2022
3da7807
Scoop update for datacatalog version v1.0.15
goreleaserbot Nov 10, 2022
7ef37bb
Scoop update for datacatalog version v1.0.16
goreleaserbot Nov 10, 2022
705372b
Scoop update for datacatalog version v1.0.17
goreleaserbot Nov 10, 2022
dc78779
Scoop update for datacatalog version v1.0.18
goreleaserbot Nov 10, 2022
ebb888a
Scoop update for datacatalog version v1.0.19
goreleaserbot Nov 10, 2022
4386152
Scoop update for datacatalog version v1.0.20
goreleaserbot Nov 10, 2022
657b487
Scoop update for datacatalog version v1.0.21
goreleaserbot Nov 10, 2022
3f8a902
Scoop update for datacatalog version v1.0.22
goreleaserbot Nov 10, 2022
3cab9d2
Scoop update for datacatalog version v1.0.23
goreleaserbot Nov 10, 2022
13d3392
Scoop update for datacatalog version v1.0.24
goreleaserbot Nov 10, 2022
2dd058f
Scoop update for datacatalog version v1.0.25
goreleaserbot Nov 10, 2022
5e4919d
Scoop update for datacatalog version v1.0.26
goreleaserbot Nov 10, 2022
93c6f1c
Scoop update for datacatalog version v1.0.27
goreleaserbot Nov 10, 2022
e778037
Scoop update for datacatalog version v1.0.28
goreleaserbot Nov 10, 2022
f2e8698
Scoop update for datacatalog version v1.0.29
goreleaserbot Nov 10, 2022
1ccef8f
Scoop update for datacatalog version v1.0.30
goreleaserbot Nov 10, 2022
0da13f4
Scoop update for datacatalog version v1.0.31
goreleaserbot Nov 10, 2022
cb29556
Scoop update for datacatalog version v1.0.32
goreleaserbot Nov 10, 2022
242855c
Scoop update for datacatalog version v1.0.33
goreleaserbot Nov 10, 2022
0add563
Scoop update for datacatalog version v1.0.34
goreleaserbot Nov 10, 2022
049b289
Scoop update for datacatalog version v1.0.35
goreleaserbot Nov 10, 2022
ab23187
Ignore codecov upload failures (#144)
hamersaw Nov 14, 2022
4cc2381
Skipping of cached task outputs via execution config (#482)
Nov 14, 2022
6754c37
Scoop update for datacatalog version v1.0.36
goreleaserbot Nov 15, 2022
b63cb36
Scoop update for datacatalog version v1.0.37
goreleaserbot Nov 15, 2022
b355f97
Remove scoop stanza from .goreleaser.yaml (#85)
eapolinario Nov 15, 2022
8a0429f
Scoop update for datacatalog version v1.0.38
goreleaserbot Nov 15, 2022
0e1cc8b
Remove shard prefix from upload location (#489)
manuelrombach Nov 15, 2022
aa06e38
Ignore codecov upload failures (#295)
hamersaw Nov 16, 2022
85c512e
Fix error message when output file is too large to read (#296)
EngHabu Nov 17, 2022
1c6a0f0
Implement CreateDownloadLink (#492)
EngHabu Nov 17, 2022
36c4371
updating end2end tests from boilerplate (#497)
hamersaw Nov 28, 2022
c6bb636
updating end2end tests from boilerplate (#504)
hamersaw Nov 28, 2022
9c9918b
Bump flyteplugins to v1.0.20 (#503)
live-wire Nov 28, 2022
8f27daa
Use checksums to track applied state of cluster resource templates (#…
andrewwdye Nov 29, 2022
b0f20e8
Added test for bad config for task logs (#298)
pmahindrakar-oss Nov 30, 2022
6de8831
check deck uri exists before checking for datastore existance (#506)
hamersaw Nov 30, 2022
d5295d2
The status of the AWS batch job should become failed once the retry l…
pingsutw Dec 1, 2022
4114572
Add support for GateNode with signal and sleep condition (#436)
hamersaw Dec 1, 2022
80d1624
adding signal to context (#137)
hamersaw Dec 2, 2022
46439c6
Fixed ExecutionInfo/TaskNodeInfo not being assigned properly for dyna…
Dec 5, 2022
b5ddbeb
Updated default subqueue base delay to 0 (#497)
hamersaw Dec 8, 2022
5df4f41
Add httpProxyURL support in OAuth2 (#500)
goyalankit Dec 8, 2022
77157ff
Add launch entity type to execution model (#501)
katrogan Dec 10, 2022
fce143d
Fix typo in launch entity rollback (#502)
katrogan Dec 12, 2022
cb85125
Fixed nil panic on gate node sleep check (#507)
hamersaw Dec 13, 2022
a1804d5
Implement signal service for human-in-the-loop workflow orchestration…
hamersaw Dec 13, 2022
905e7ee
Adding CheckAndFetchInputsForExecution on single task executions (#495)
hamersaw Dec 13, 2022
6037335
Update kafka config (#499)
pingsutw Dec 14, 2022
5300f92
Expose kubeclient configuration (#491)
hamersaw Dec 15, 2022
428b7a4
Apply default pod template to PytorchJob pods (#297)
fg91 Dec 16, 2022
ab3ee8a
Add support Databricks plugin (#299)
pingsutw Dec 19, 2022
34c4e43
Add support Databricks plugin (#510)
pingsutw Dec 19, 2022
ee8de0f
Move secrets from cmd to auth (#505)
wild-endeavor Dec 20, 2022
2859755
Update toleration and annotations in ray pod spec (#302)
pingsutw Dec 22, 2022
8efeda7
PodSpec NodeSelectors overwrite the default k8s plugin settings (#303)
hamersaw Dec 27, 2022
e7b2b94
Fix issue where k8s plugin default labels override those set on pod (…
hamersaw Dec 27, 2022
ec5528d
Add SignalService http handler (#506)
wild-endeavor Dec 28, 2022
d2215ed
Doc hub proposal (#452)
pingsutw Dec 28, 2022
08bdbd0
Fix gate node approve condition node interface binding validation (#…
hamersaw Jan 3, 2023
9eeb694
Add podUID as a template input in tasklog plugin (#304)
goyalankit Jan 4, 2023
1feca6d
Update flyteplugin version to v1.0.27 (#513)
goyalankit Jan 5, 2023
36c0b41
Add dask plugin #patch (#275)
bstadlbauer Jan 5, 2023
d2098fc
Add dask plugin (#508)
bstadlbauer Jan 7, 2023
faa86db
Publish multi-architecture image (#88)
jeevb Jan 9, 2023
0b5007b
Publish multi-architecture image (#514)
jeevb Jan 9, 2023
cb1224b
Publish multi-architecture image (#510)
jeevb Jan 9, 2023
d6bc85d
Add user name to UserInfoResponse header (#507)
katrogan Jan 10, 2023
8cbb05a
Add TensorFlow to loader.go (#515)
pingsutw Jan 10, 2023
109224c
added raw-container to registered task types (#305)
flixr Jan 10, 2023
1ccd59c
Forward all claims in userinfo response (#511)
katrogan Jan 10, 2023
ce57dbf
use different perm (#517)
wild-endeavor Jan 11, 2023
b8d3ea9
fix comments (#309)
ByronHsu Jan 19, 2023
2014630
Update flyteidl version (#490)
flyte-bot Jan 19, 2023
4634a81
Add env FLYTE_FAIL_ON_ERROR to aws batch job (#306)
pingsutw Jan 23, 2023
24d8aba
enabling connection pooling (#89)
hamersaw Jan 25, 2023
471a262
Discard fields when replica number equals zero to avoid api client er…
ByronHsu Feb 1, 2023
c4abd4f
Adding support for per-task PodTemplate configuration (#308)
hamersaw Feb 6, 2023
82d114b
bumping go version to 1.19 (#150)
hamersaw Feb 7, 2023
b526b0c
Bump go version to 1.19 (#90)
hamersaw Feb 7, 2023
07bc0a9
Bumping go version to 1.19 (#316)
hamersaw Feb 7, 2023
92cd1b7
Updating PodTemplateStore API (#516)
hamersaw Feb 7, 2023
a89b359
Bumping go version to 1.19 (#518)
hamersaw Feb 7, 2023
e79acfb
sending correct external resources for k8s-array plugin (#300)
hamersaw Feb 8, 2023
95a4791
Inline input data for execution events (#521)
katrogan Feb 9, 2023
97772fd
Bumping go version to 1.19 (#45)
hamersaw Feb 9, 2023
5e75228
Only create copilot sidecars if interface requires (#314)
hamersaw Feb 9, 2023
2e156a3
Inline input data for execution events (#516)
katrogan Feb 9, 2023
0dbe3c2
Add git branch to version package (#151)
iaroslav-ciupin Feb 11, 2023
5981c35
Rename dask port from to (#315)
bstadlbauer Feb 13, 2023
32c8dbd
Use ResourceManager to aid in validating task resources (#517)
hamersaw Feb 14, 2023
8596a56
Truncate execution error message in list execution calls (#523)
katrogan Feb 16, 2023
fb003b7
Only merge system defaults when querying workflow execution config fo…
wild-endeavor Feb 16, 2023
812ebc4
bump golang.org/x/net from 0.5.0 to 0.7.0 (#526)
dependabot[bot] Feb 18, 2023
752f55e
Update flyteplugins to 1.0.37 (#527)
bstadlbauer Feb 22, 2023
03a6672
fix recovery of already recovered workflow (#530)
flixr Feb 25, 2023
efe5b0c
Remove duplicate logic of resolveSecurityCtx in execution_manager (#531)
ByronHsu Feb 28, 2023
1329476
Return nil if ResourceMeta is nil when deleting the node (#310)
pingsutw Mar 1, 2023
5c7a31d
Copy dynamicJobSpec from partially completed DynamicTask on recovery …
hamersaw Mar 4, 2023
9508833
Improve error message (#532)
pingsutw Mar 4, 2023
114645a
If primaryContainerName=="primary", container content will be duplica…
ByronHsu Mar 6, 2023
be833e2
Remove chief!=0 or ps!=0 assertion in tensorflow (#327)
ByronHsu Mar 6, 2023
3c3ec33
bumping flyteplugins (#537)
hamersaw Mar 6, 2023
326ca45
Truncate execution error message only when size exceeds limit (#533)
pingsutw Mar 6, 2023
328a41c
Extend pod webhook self-signed certs expiration date to 99 years in t…
eapolinario Mar 6, 2023
48c37de
Structured Dataset with generic format should be castable to Flyte Sc…
pingsutw Mar 8, 2023
188b982
Don't truncate error messages when listing task executions (#536)
katrogan Mar 9, 2023
2d39422
Add Dan Rammer and Eduardo to codeowners (#539)
eapolinario Mar 10, 2023
f6d949a
Tracking DynamicJobSpecUri for DynamicWorkflows (#513)
hamersaw Mar 10, 2023
2218971
Bump github.com/emicklei/go-restful (#520)
dependabot[bot] Mar 13, 2023
b96881a
Validate user-provided entity versions are url safe (#537)
katrogan Mar 13, 2023
f0db511
Supporting DataLoadingConfig on K8sPod type (#325)
hamersaw Mar 13, 2023
8cf8b4a
Upgrade flytepropeller (#541)
katrogan Mar 17, 2023
0a681cd
feat: add support for inter-cluster communication for Ray plugin (#321)
aybidi Mar 20, 2023
25c0a10
replaced github.com/satori/go.uuid with github.com/gofrs/uuid (#101)
hamersaw Mar 20, 2023
dea5b2a
bumping fosite version (#538)
hamersaw Mar 21, 2023
b4cde1f
bumping flyteplugins to 1.0.42 to pick up external cluster configurat…
hamersaw Mar 21, 2023
83e8694
Tracking reasons time-series (#540)
hamersaw Mar 22, 2023
680cac3
Add no-op migrations (#542)
wild-endeavor Mar 22, 2023
60d345d
Fixing pod plugin event reporting timestamps (#307)
hamersaw Mar 23, 2023
e462412
Add reported_at timestamps to events (#529)
hamersaw Mar 24, 2023
b1e5482
Including all upstream node deps on BranchNode subnode execution (#543)
hamersaw Mar 24, 2023
cca9e17
Add endpoint exposing runtime metrics (#524)
hamersaw Mar 27, 2023
18a594e
persisting k8s plugin phase, version, and reason (#331)
hamersaw Mar 27, 2023
eb695b1
Populate TaskNodeMetadata on CreateNodeExecutionModel to correctly di…
hamersaw Mar 29, 2023
01218d2
persisting k8s plugin state between evaluations (#540)
hamersaw Mar 30, 2023
f88f165
Add support for GCP secret manager (#547)
jeevb Mar 31, 2023
38e8a07
mocking plugin state reader in maptask (#338)
hamersaw Mar 31, 2023
6af4de2
bumped flyteplugins (#549)
hamersaw Mar 31, 2023
e84d27a
Validate multiple input values in map task (#334)
hamersaw Apr 4, 2023
12f9ff5
Lazily initialize kubernetes client only when using kube api watcher …
jeevb Apr 6, 2023
a3f7334
Inject container resource during BuildRawContainer (#335)
ByronHsu Apr 7, 2023
986f014
moved controller runtime start out of webhook Run function (#546)
hamersaw Apr 7, 2023
4f02c2c
deprecated TransitionTypeBarrier (#336)
hamersaw Apr 7, 2023
7abdcd7
returning 'Undefined' when recovering a SKIPPED node so that the node…
hamersaw Apr 7, 2023
3b737b5
Add a new requestID to Log fields (#157)
EngHabu Apr 8, 2023
ef164c5
Remove resource injection on the node for container task (#544)
ByronHsu Apr 11, 2023
9ebdb93
Infer GOOS and GOARCH from environment (#103)
jeevb Apr 12, 2023
2be01e2
Infer GOOS and GOARCH from environment (#552)
jeevb Apr 12, 2023
b9d1f62
fix makefile to read variables from environment and overrides (#554)
jeevb Apr 12, 2023
0638a9e
fix makefile to read variables from environment and overrides (#104)
jeevb Apr 12, 2023
97a6aa4
Infer GOOS and GOARCH from environment (#550)
jeevb Apr 12, 2023
a913fde
Enable multiarch build and infer GOOS and GOARCH from environment (#57)
jeevb Apr 12, 2023
0c982ea
Remove BarrierTick (#545)
hamersaw Apr 14, 2023
435436b
Set PrimaryContainerKey annotation by default (#337)
hamersaw Apr 14, 2023
1026231
Enrich TerminateExecution error to tell propeller the execution alrea…
EngHabu Apr 16, 2023
6cb7322
Check for TerminateExecution error and eat Precondition status (#553)
EngHabu Apr 16, 2023
f5f4182
Override primary container name instead of flyte generated name (#340)
ByronHsu Apr 17, 2023
e4ca252
Setting primaryContainerName by default on Pod plugin (#555)
hamersaw Apr 17, 2023
46796b6
Pass `worker_spec_command` to mpi plugin to support horovod (#341)
ByronHsu Apr 19, 2023
972c0d6
Implement ability to specify additional/override annotations when usi…
Apr 19, 2023
dd49c9d
Maintaining Interruptible and OverwriteCache for reference launchplan…
hamersaw Apr 20, 2023
84030bd
adding cleanupOnFailure to PhaseInfo (#333)
hamersaw Apr 20, 2023
1f39163
External Plugin Service (grpc) (#330)
pingsutw Apr 21, 2023
acc831a
Feat: Configure elastic training in pytorch plugin (#343)
fg91 Apr 24, 2023
63e1e45
Add non-interruptible node selector requirement to spark driver if se…
jeevb Apr 25, 2023
0025cbe
Added support for aborting task nodes reported as failures (#541)
hamersaw Apr 28, 2023
1e0faab
Adding support for environment variables set on execution (#344)
hamersaw May 3, 2023
5b50d88
Added support for EnvironmentVariables on ExecutionConfig (#558)
hamersaw May 3, 2023
f4cadb0
Fast fail if task resource requests exceed k8s resource limits (#488)
hamersaw May 5, 2023
950ad15
Address resolution (#546)
wild-endeavor May 5, 2023
00915ec
Add migration to turn `parent_id` column into `bigint` only if necess…
eapolinario May 8, 2023
507ad44
Added start time for supporting restarts for fixed rate schedules (#476)
pmahindrakar-oss May 8, 2023
76a80ec
Add nil check in databricks plugin (#332)
pingsutw May 8, 2023
9a2bbba
Change kubeflow plugins to allow settings specs for different replica…
yubofredwang May 9, 2023
9a4ea00
Use group attribute for KV version and add DB engine support (#539)
bimtauer May 11, 2023
7f622dd
Retract v1.1.94 from go.mod (#562)
wild-endeavor May 11, 2023
2fdd399
Add environment variables to execution spec (#556)
pingsutw May 12, 2023
610451d
Inject user identifier to ExecutionSpec (#549)
ByronHsu May 15, 2023
fc3db04
Fix flaky test (#563)
eapolinario May 16, 2023
f97ff74
Add grpc plugin to loader.go (#562)
pingsutw May 16, 2023
a853dac
Add oauth http proxy for external server & Extract email from azure c…
ByronHsu May 16, 2023
062641f
Remove single task execution default timeout (#564)
hamersaw May 17, 2023
313ac29
revert conditional set and add tests (#566)
wild-endeavor May 18, 2023
33ca38c
Use correct k8 client (#563)
sonjaer May 18, 2023
2afc441
Enable pod template and Use copy to construct head/worker in ray plug…
ByronHsu May 19, 2023
0e6b62a
Run tests and lint in parallel (#350)
pingsutw May 19, 2023
ed4d771
Save execution namespace in system metadata (#568)
katrogan May 22, 2023
7915ae8
Update startedAt timestamp only if not set (#567)
pmahindrakar-oss May 22, 2023
15d5c7b
Tiny url improvements (#565)
wild-endeavor May 23, 2023
7bb490f
updating dask plugin to use container resources with overrides (#351)
hamersaw May 24, 2023
e1f6d76
bumped flyteplugins (#566)
hamersaw May 24, 2023
8a2f8ca
only initializing maptask if there is no failure (#352)
hamersaw May 24, 2023
c499a48
Improve demystifying GKE spot node preemtion #patch (#354)
bstadlbauer May 26, 2023
85ae7d6
Bump flyteplugins to v1.0.63 (#568)
bstadlbauer May 27, 2023
3379031
Fix utf-8 encoding issues with trimmed error messages (#569)
katrogan May 30, 2023
949f5a2
Add logs and stats to sync loop (#573)
EngHabu Jun 5, 2023
06866ee
Lazy load gRPC plugin (#353)
pingsutw Jun 5, 2023
c61fa47
Not stripping structure from literal types (#571)
hamersaw Jun 7, 2023
2086bb9
Register gRPC plugin after reading configmap (#564)
pingsutw Jun 7, 2023
de1d1d3
Don't add master replica log link when doing elastic pytorch training…
fg91 Jun 7, 2023
aa1ed67
[Bigquery] Add support for impersonation of GSA bound to task's KSA (…
jeevb Jun 8, 2023
2a7a6f9
Fix initial dask job state (#357)
bstadlbauer Jun 8, 2023
05e837b
Update flyteplugins to v1.0.67 (#575)
bstadlbauer Jun 9, 2023
eadf07b
Correctly validating error code on aborting terminal launchplans (#574)
hamersaw Jun 12, 2023
89dfd5b
Use GetExecutionData instead (#573)
EngHabu Jun 13, 2023
53e63bc
Feat: Add pod start and finish time in RFC3339 time format to logging…
fg91 Jun 13, 2023
318fa6b
fix v1 pytorch job plugin with elastic policy (#359)
yubofredwang Jun 14, 2023
dfdf6f9
Allow using pod start time in kubeflow plugin log links (#362)
fg91 Jun 15, 2023
9b22c0e
Add a user-specifiable root to upload link request (#577)
wild-endeavor Jun 22, 2023
f44d7fe
Bump propeller version (#580)
pingsutw Jun 26, 2023
7b104d3
propagating environment variables through launchplans (#576)
hamersaw Jun 26, 2023
1d0f3e9
Pass location to the BigQuery request (#365)
pingsutw Jun 27, 2023
5a5ad82
Fix map task cache misses (#363)
bstadlbauer Jun 27, 2023
2c393c0
Switch to official dask operator (#366)
bstadlbauer Jun 27, 2023
df62599
Fix duplicate env vars in container (#358)
hamersaw Jun 28, 2023
dfa2c4c
upgrade dockerfile go to 1.19 (#108)
hamersaw Jun 28, 2023
e93f5bd
upgrading dockefile to go 1.19 (#60)
hamersaw Jun 28, 2023
78b3e14
upgrade go 1.19 in Dockerfile (#581)
hamersaw Jun 28, 2023
efb69c3
upgrade dockerfile go to 1.19 (#580)
hamersaw Jun 28, 2023
f7b37aa
Set scheduler restart policy to `Always` (#367)
bstadlbauer Jun 29, 2023
d181df7
Bump flyteplugins version (#581)
pingsutw Jun 30, 2023
1541ae5
Support for cross-project secrets for GCP (#582)
jeevb Jun 30, 2023
357bf09
Update `flyteplugins` (#578)
bstadlbauer Jul 5, 2023
206013a
Fix usage of archive replacements (#586)
eapolinario Jul 5, 2023
53282fe
remove welcome bot from boilerplate (#460)
samhita-alla Jul 6, 2023
0cfb0a0
Added IsFailurePermanent flag on DynamicTaskStatus (#567)
hamersaw Jul 6, 2023
05981db
Fix archive.replacements in goreleaser (#586)
eapolinario Jul 7, 2023
53f62a7
Update .goreleaser.yml (#158)
eapolinario Jul 7, 2023
10f7420
Update .goreleaser.yml (#61)
eapolinario Jul 7, 2023
5e2512a
Fix archive.replacements in goreleaser (#109)
eapolinario Jul 7, 2023
3d2525a
Add ImagePullBackoffGracePeriod configuration (#370)
hamersaw Jul 7, 2023
7c5cc9b
updating flyteplugins (#587)
hamersaw Jul 7, 2023
3322b07
Extend length of docs section to 120 characters (#159)
eapolinario Jul 7, 2023
5b68c2f
Bump flytestdlib (#588)
eapolinario Jul 7, 2023
907929b
Stow head etag (#160)
EngHabu Jul 11, 2023
8f41e67
Alter ID sequence to bigint (#578)
honnix Jul 12, 2023
b93457f
Remove content md5 requirement (#587)
wild-endeavor Jul 13, 2023
fb359bc
Propagate request id on incoming and outgoing requests (#582)
EngHabu Jul 13, 2023
248e947
Update boilerplate version (#589)
flyte-bot Jul 14, 2023
7ddd993
Add support for using task execution ID fields in log URI templates (…
jeevb Jul 15, 2023
6923ab8
Update boilerplate version (#77)
flyte-bot Jul 15, 2023
4322012
Update boilerplate version (#591)
flyte-bot Jul 15, 2023
5a38c21
Update boilerplate version (#42)
flyte-bot Jul 15, 2023
e2eb4e5
Fix generate check in CI (#377)
jeevb Jul 15, 2023
4e5ff42
Remove welcomebot from boilerplate (#375)
eapolinario Jul 17, 2023
e088ca6
Remove welcomebot from boilerplate (#161)
eapolinario Jul 17, 2023
13ef7d6
Carry over hash value for all literal types in remote caching (#378)
nicholasjng Jul 18, 2023
3405f89
Send task execution metadata to out-core plugin (#369)
honnix Jul 20, 2023
ec30f0d
Add 'flyteadmin/' from commit '248e947de3c85d5a7f3320211bce1763106a211c'
eapolinario Jul 24, 2023
5ce1b0f
Add 'flytepropeller/' from commit '4322012ef07dff4de457473a7b5fb4cd6b…
eapolinario Jul 24, 2023
f952072
Add 'flytestdlib/' from commit 'e088ca6c9b3a460f9c9a07b3b8fae2b6999ca…
eapolinario Jul 24, 2023
4e28e72
Add 'flyteplugins/' from commit '3405f890a0673cf3bd857e1089e363bf6488…
eapolinario Jul 24, 2023
6405e0f
Add 'flytecopilot/' from commit '5a38c21c2158e5a73563a836815a41cf8184…
eapolinario Jul 24, 2023
0d64369
Add 'datacatalog/' from commit '6923ab848eeb7f1ef2daf312921ff0ca2ee1f…
eapolinario Jul 24, 2023
90b17ce
Add relative imports
eapolinario Jul 24, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
15 changes: 15 additions & 0 deletions datacatalog/.github/config.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,15 @@
# Comment to be posted on PRs from first-time contributors in your repository
newPRWelcomeComment: >
Thank you for opening this pull request! 🙌

These tips will help get your PR across the finish line:
- Most of the repos have a PR template; if not, fill it out to the best of your knowledge.
- Sign off your commits (Reference: [DCO Guide](https://github.com/src-d/guide/blob/master/developer-community/fix-DCO.md)).

# Comment to be posted to on pull requests merged by a first time user
firstPRMergeComment: >
Congrats on merging your first pull request! 🎉

# Comment to be posted on first-time issues
newIssueWelcomeComment: >
Thank you for opening your first issue here! 🛠
66 changes: 66 additions & 0 deletions datacatalog/.github/workflows/checks.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,66 @@
name: Datacatalog Checks

on:
workflow_dispatch:
pull_request:
branches:
- master
push:
branches:
- master

jobs:
lint:
name: Lint
uses: flyteorg/flytetools/.github/workflows/lint.yml@master
with:
go-version: "1.19"

tests:
name: Unit Tests
uses: flyteorg/flytetools/.github/workflows/tests.yml@master
with:
go-version: "1.19"
secrets:
FLYTE_BOT_PAT: ${{ secrets.FLYTE_BOT_PAT }}

docker_build:
name: Docker Build Images
uses: flyteorg/flytetools/.github/workflows/docker_build.yml@master

generate:
name: Check Go Gennerate
uses: flyteorg/flytetools/.github/workflows/go_generate.yml@master
with:
go-version: "1.19"

bump_version:
name: Bump Version
if: ${{ github.event_name != 'pull_request' }}
needs: [ docker_build, lint, tests, generate ] # Only to ensure it can successfully build
uses: flyteorg/flytetools/.github/workflows/bump_version.yml@master
secrets:
FLYTE_BOT_PAT: ${{ secrets.FLYTE_BOT_PAT }}

goreleaser:
name: Goreleaser
needs: [ bump_version ] # Only to ensure it can successfully build
uses: flyteorg/flytetools/.github/workflows/goreleaser.yml@master
secrets:
FLYTE_BOT_PAT: ${{ secrets.FLYTE_BOT_PAT }}
with:
go-version: "1.19"

push_docker_image:
name: Build & Push Datacatalog Image
needs: [ bump_version ]
uses: flyteorg/flytetools/.github/workflows/publish.yml@master
with:
version: ${{ needs.bump_version.outputs.version }}
dockerfile: Dockerfile
push: true
repository: ${{ github.repository }}
secrets:
FLYTE_BOT_PAT: ${{ secrets.FLYTE_BOT_PAT }}
FLYTE_BOT_USERNAME: ${{ secrets.FLYTE_BOT_USERNAME }}

21 changes: 21 additions & 0 deletions datacatalog/.github/workflows/upgrade_automation.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
name: Upgrade Automation
on:
workflow_dispatch:
inputs:
component:
description: "Name of Flyte component"
required: true
default: "boilerplate"
type: choice
options:
- boilerplate
- flyteidl
jobs:
trigger-upgrade:
name: ${{ github.event.inputs.component }} Upgrade
uses: flyteorg/flytetools/.github/workflows/flyte_automation.yml@master
with:
component: ${{ github.event.inputs.component }}
go-version: "1.19"
secrets:
FLYTE_BOT_PAT: ${{ secrets.FLYTE_BOT_PAT }}
5 changes: 5 additions & 0 deletions datacatalog/.gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
.idea/
vendor/
vendor-new/
.DS_Store
bin/
30 changes: 30 additions & 0 deletions datacatalog/.golangci.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,30 @@
# WARNING: THIS FILE IS MANAGED IN THE 'BOILERPLATE' REPO AND COPIED TO OTHER REPOSITORIES.
# ONLY EDIT THIS FILE FROM WITHIN THE 'FLYTEORG/BOILERPLATE' REPOSITORY:
#
# TO OPT OUT OF UPDATES, SEE https://github.com/flyteorg/boilerplate/blob/master/Readme.rst

run:
skip-dirs:
- pkg/client

linters:
disable-all: true
enable:
- deadcode
- errcheck
- gas
- goconst
- goimports
- golint
- gosimple
- govet
- ineffassign
- misspell
- nakedret
- staticcheck
- structcheck
- typecheck
- unconvert
- unparam
- unused
- varcheck
35 changes: 35 additions & 0 deletions datacatalog/.goreleaser.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,35 @@
project_name: datacatalog
before:
hooks:
- go mod download
builds:
- id: datacatalog
env:
- CGO_ENABLED=0
main: ./cmd/main.go
binary: datacatalog
goos:
- linux
- windows
- darwin
archives:
- id: datacatalog-archive
name_template: |-
datacatalog_{{ .Tag }}_{{ .Os }}_
{{- if eq .Arch "amd64" }}x86_64
{{- else if eq .Arch "386" }}i386
{{- else }}{{ .Arch }}{{ end }}
builds:
- datacatalog
format_overrides:
- goos: windows
format: zip

checksum:
name_template: 'checksums.txt'
changelog:
sort: asc
filters:
exclude:
- '^docs:'
- '^test:'
3 changes: 3 additions & 0 deletions datacatalog/CODEOWNERS
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# These are the assigned owners of the datacatalog repo.
# When a PR is opened they will be notified.
* @kumare3 @wild-endeavor
2 changes: 2 additions & 0 deletions datacatalog/CODE_OF_CONDUCT.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
This project is governed by LF AI Foundation's [code of conduct](https://lfprojects.org/policies/code-of-conduct/).
All contributors and participants agree to abide by its terms.
53 changes: 53 additions & 0 deletions datacatalog/Dockerfile
Original file line number Diff line number Diff line change
@@ -0,0 +1,53 @@
# WARNING: THIS FILE IS MANAGED IN THE 'BOILERPLATE' REPO AND COPIED TO OTHER REPOSITORIES.
# ONLY EDIT THIS FILE FROM WITHIN THE 'FLYTEORG/BOILERPLATE' REPOSITORY:
#
# TO OPT OUT OF UPDATES, SEE https://github.com/flyteorg/boilerplate/blob/master/Readme.rst

FROM --platform=${BUILDPLATFORM} golang:1.19-alpine3.16 as builder

ARG TARGETARCH
ENV GOARCH "${TARGETARCH}"
ENV GOOS linux

RUN apk add git openssh-client make curl

# Create the artifacts directory
RUN mkdir /artifacts

# Pull GRPC health probe binary for liveness and readiness checks
RUN GRPC_HEALTH_PROBE_VERSION=v0.4.11 && \
wget -qO/artifacts/grpc_health_probe https://github.com/grpc-ecosystem/grpc-health-probe/releases/download/${GRPC_HEALTH_PROBE_VERSION}/grpc_health_probe-linux-amd64 && \
chmod +x /artifacts/grpc_health_probe && \
echo 'ded15e598d887ccc47bf2321371950bbf930f5e4856b9f75712ce4b2b5120480 /artifacts/grpc_health_probe' > .grpc_checksum && \
sha256sum -c .grpc_checksum

# COPY only the go mod files for efficient caching
COPY go.mod go.sum /go/src/github.com/flyteorg/datacatalog/
WORKDIR /go/src/github.com/flyteorg/datacatalog

# Pull dependencies
RUN go mod download

# COPY the rest of the source code
COPY . /go/src/github.com/flyteorg/datacatalog/

# This 'linux_compile' target should compile binaries to the /artifacts directory
# The main entrypoint should be compiled to /artifacts/datacatalog
RUN make linux_compile

# update the PATH to include the /artifacts directory
ENV PATH="/artifacts:${PATH}"

# This will eventually move to centurylink/ca-certs:latest for minimum possible image size
FROM alpine:3.16
LABEL org.opencontainers.image.source=https://github.com/flyteorg/datacatalog

COPY --from=builder /artifacts /bin

# Ensure the latest CA certs are present to authenticate SSL connections.
RUN apk --update add ca-certificates

RUN addgroup -S flyte && adduser -S flyte -G flyte
USER flyte

CMD ["datacatalog"]
Loading