Skip to content

Releases: fluid-cloudnative/fluid

v1.0.3

30 Oct 13:33
2c1809a
Compare
Choose a tag to compare

New Features

  1. Dynamic mount now supports exposing mount status updates to users.
  2. Supports configuring current data flow operations based on the affinity of previous data operations to optimize processing efficiency.
  3. Enables data plane monitoring of JindoRuntime using Prometheus.
  4. Allows configuration of imagePullSecret in Runtime level.

Bug Fixes.

  1. Fixed an issue where configuring affinity/nodeSelector/schedulerName/imagePullSecrets parameters in CronDataload caused preloading failures.
  2. Resolved an issue where upgrading the Fluid version caused data operation failures due to datasets with the same name.

What's Changed

  • build(deps): bump github/codeql-action from 3.26.2 to 3.26.5 by @dependabot in #4296
  • Chore: Fixed docker build command in Makefile by @omerap12 in #4299
  • build(deps): bump github.com/prometheus/client_golang from 1.20.1 to 1.20.2 by @dependabot in #4295
  • add fuse properties with default xengine by @frankleaf in #4302
  • Build docker images for releasing v1.0.2 by @cheyang in #4303
  • build(deps): bump github.com/onsi/gomega from 1.34.1 to 1.34.2 by @dependabot in #4300
  • Prepare for v1.0.3 by @cheyang in #4304
  • Docker build for fixing fuse properties of jindocache by @cheyang in #4307
  • build(deps): bump github/codeql-action from 3.26.5 to 3.26.6 by @dependabot in #4305
  • build(deps): bump google.golang.org/grpc from 1.65.0 to 1.66.0 by @dependabot in #4301
  • build(deps): bump github.com/felixge/fgprof from 0.9.4 to 0.9.5 by @dependabot in #4306
  • Sort packages, optimize Dockerfile by @omerap12 in #4309
  • build(deps): bump golang.org/x/net from 0.28.0 to 0.29.0 by @dependabot in #4310
  • build(deps): bump github.com/prometheus/client_golang from 1.20.2 to 1.20.3 by @dependabot in #4311
  • build(deps): bump google.golang.org/grpc from 1.66.0 to 1.66.1 by @dependabot in #4314
  • build(deps): bump google.golang.org/grpc from 1.66.1 to 1.66.2 by @dependabot in #4315
  • enhance: NodeUnpublishVolume returns early when target path is not existed by @TrafalgarZZZ in #4318
  • enhance: optimize fluid helm chart by @TrafalgarZZZ in #4319
  • build(deps): bump github/codeql-action from 3.26.6 to 3.26.7 by @dependabot in #4320
  • build(deps): bump com.google.protobuf:protobuf-java from 3.16.3 to 3.25.5 in /samples/hdfs by @dependabot in #4323
  • build(deps): bump github.com/prometheus/client_golang from 1.20.3 to 1.20.4 by @dependabot in #4321
  • build(deps): bump google.golang.org/grpc from 1.66.2 to 1.67.0 by @dependabot in #4325
  • build(deps): bump github/codeql-action from 3.26.7 to 3.26.8 by @dependabot in #4326
  • Use Variables for simplify edits and enhance readability. by @omerap12 in #4313
  • doc: fix installation guide for how to set resources for controllers by @TrafalgarZZZ in #4330
  • bugfix: fix data operation failure when upgrading cache engine implementation with same Dataset name by @TrafalgarZZZ in #4329
  • build(deps): bump github/codeql-action from 3.26.8 to 3.26.9 by @dependabot in #4332
  • build(deps): bump google.golang.org/grpc from 1.67.0 to 1.67.1 by @dependabot in #4333
  • fix: fix slice init length by @cuishuang in #4335
  • Refactor Makefile: Add .PHONY declarations by @omerap12 in #4334
  • build(deps): bump golang.org/x/time from 0.6.0 to 0.7.0 by @dependabot in #4336
  • support dataflow affinity using any preceding data operations by @xliuqq in #4324
  • bugfix: avoid setting "storage.data-dirs.capacity" when using MEM as tieredstore's medium type by @TrafalgarZZZ in #4339
  • feat: enable client-side metrics scraping for JindoCache engine by @TrafalgarZZZ in #4331
  • Build docker image for supporting dataflow affinity by @cheyang in #4340
  • Make dataflow affinity's annotations consistent with others by @TrafalgarZZZ in #4342
  • build(deps): bump github/codeql-action from 3.26.9 to 3.26.11 by @dependabot in #4338
  • Revert PR #4339 by @TrafalgarZZZ in #4343
  • bugfix: add startup probe to gha-e2e minio setup by @TrafalgarZZZ in #4344
  • refactor: remove tieredstore argument in func base.BuildRuntimeInfo by @TrafalgarZZZ in #4341
  • feat: support imagePullSecrets in thinRuntime & thinRuntimeProfile by @Syspretor in #4348
  • Make metrics scrape target flexible with mountModeSelector by @TrafalgarZZZ in #4350
  • Fix: fix some typo and log fmt error by @Syspretor in #4347
  • feat: support imagePullSecrets in jindoRuntime by @Syspretor in #4349
  • feat: support mountMode configuration to skip checking mount ready by @Syspretor in #4346
  • Docker build for fixing the skipping check mount ready by @cheyang in #4351
  • build(deps): bump golang.org/x/net from 0.29.0 to 0.30.0 by @dependabot in #4337
  • docs updated by @vaibhav93076 in #4352
  • build(deps): bump github/codeql-action from 3.26.11 to 3.26.12 by @dependabot in #4353
  • refactor: sync schedule info to cache nodes by @TrafalgarZZZ in #4355
  • dataflow ensure the dependent operation was completed by @xliuqq in #4345
  • [WIP] fix: fix the dataload with cronJob failure in jindoCacheRuntime by @Syspretor in #4359
  • Fix: fix the invalid fmt of dataload cronJob helm template by @Syspretor in #4360
  • Build docker images for fixing cron dataload with annotations by @cheyang in #4362
  • Prepare for v1.0.4 by @cheyang in #4365
  • build(deps): bump github.com/prometheus/client_golang from 1.20.4 to 1.20.5 by @dependabot in #4361
  • Revert to v1.0.3 by @cheyang in #4372
  • fix some issues of helm chart by @Syspretor in #4373
  • bugfix: fix NodeUnpublishVolume when checking corrupted mount points by @TrafalgarZZZ in #4374
  • Docker build for fixing NodeUnpublishVolume when checking corrupted by @cheyang in #4375

New Contributors

Full Changelog: v1.0.2...v1.0.3

v1.0.2

30 Aug 11:03
41eefb6
Compare
Choose a tag to compare

New Features

  • Support setting resources requests and limits for DataProcess
  • Add dataset in used info to mutated app pods
  • Support hierarchical imagePullSecrets configuration in AlluxioRuntime
  • Support subpath in dynamic-mount

What's Changed

New Contributors

Full Changelog: v1.0.1...v1.0.2

v1.0.1

12 Jul 06:00
644a191
Compare
Choose a tag to compare

New Features

  • Support data flow affinity scheduling.
  • Support dynamic updates for dataset mount points.
  • Support data acceleration for Fluid Persistent Volume Claim in sidecar mode

What's Changed

Full Changelog: v1.0.0...v1.0.1

v1.0.0

14 May 12:46
b106093
Compare
Choose a tag to compare

Highlights

  • Introduced a flexible, configurable, tiered data locality scheduling capability to optimize the affinity between application pods and data cache.
  • Provided DataProcess for custom data operations, and add three trigger strategies for data operations for all the data operations – once, onEvent, Cron.
  • Provided a Python SDK with dataflow capabilities for data scientists.
  • Implemented A new runtime for sharing in-memory immutable data: VineyardRuntime is supported in Fluid.
  • Major improvements have been made in:
    • Improved security measures by defining stricter, minimum necessary cluster role permissions for Fluid components.
    • Significantly optimized FUSE Recovery features to enhance their performance and reliability.
    • Made significant updates to the project documentation and website.

We acknowledge all the contributors who put their effort in the version release. Credits to @zwwhdls, @xliuqq, @wangshli, @Hexilee, @weixiao-huang, @abowloflrf, @uniqueni, @TrafalgarZZZ, @dashanji, @cheyang, @fengshunli, @frankleaf, @zhang-x-z, @BillyChen1, @wushiming540, @RongGu and many others for their great contributions to Fluid v1.0.0 !

New Features

Data Operation Features

  • Add cron for data migrate.
  • Support cron dataload.
  • Make toleration configurable in helm charts.
  • Data process crd definition.
  • Support dataflow.
  • Data operations support resources.
  • Support ssh password free pod for parallel data migrate.

Vineyard Runtime

  • Add the Vineyard runtime CRD definitions.
  • Add the helm chart for Vineyard runtime.
  • Add the controller and RBAC yaml for Vineyard runtime.
  • Implement Vineyard runtime engine and controller.
  • Add a replicas field to the Vineyard Runtime and delete the svc suffix in the Vineyard helm chart.

Enhancements & Optimizations

CSI Plugin & FUSE Recovery

  • Check path existence and lock in NodeUnpublishVolume.
  • umountDuplicate larger than the threshold.
  • Fix csi plugin concurrency issue on FuseRecovery and NodeUnpublishVolume.
  • Enhancement: recover fuse according to multiple peer group options.
  • Support symlink for NodePublish.

Bug Fix

Website & Documentation Update

Full Changelog: v0.9.0...v1.0.0

v0.9.3

13 Mar 13:26
00741af
Compare
Choose a tag to compare

What's Changed

Full Changelog: v0.9.2...v0.9.3

v0.9.2

01 Oct 08:09
880474b
Compare
Choose a tag to compare

What's Changed

Full Changelog: v0.9.1...v0.9.2

v0.8.7

25 Jul 03:35
f03b7ff
Compare
Choose a tag to compare

What's Changed

Full Changelog: v0.8.6...v0.8.7

v0.9.1

24 Jun 02:49
b5ee92a
Compare
Choose a tag to compare

What's Changed

Full Changelog: v0.9.0...v0.9.1

v0.9.0

26 May 10:20
53c240c
Compare
Choose a tag to compare

v0.9.0

Breaking Changes

  • Change matching pod requests mode of webhook from namespaceSelector to objectSelector

Features

  • Add thinRuntime to simplify integration with third-party storage systems
  • Addon component for Fluid's open source CubeFS, NFS
  • Support for accessing data across namespaces
  • Support for subDataset
  • Native acceleration system EFCRuntime for distributed file systems NFS, GPFS
  • Support dataMigrate for data migration operations (currently only supported by JuiceFSRuntime)
  • Add customizable configuration for cache cleanup timeout and maximum retry times, Webhook timeout limits
  • Add Dataload configuration for ImagePullSecrets, node affinity
  • RBAC permission reduction
  • Upgrade to golang 1.18
  • Support for installing Fluid via Helm Repo

Refactoring

  • Use data operation framework to construct data migrate, load, backup behaviors

Bug Fix

Runtime Upgrade

  • AlluxioRuntime is upgrade from v2.8.2 to v2.9.1
  • JindoRuntime is upgraded from from 4.5.1 to 4.6.7
  • JuicefsRuntime is upgraded from v1.0.0 to v1.0.4

Credits to @yangyuliufeng ,@zwwhdls, @hahchenchen,@frankleaf, @xliuqq, @abowloflrf, @odidev , @allenhaozi, @uniqueni, @yangjun289519474, @wang-mask , @fengshunli , @zhang-x-z , @wangshli @ssz1997 , @myccccccc , @baowj-678 , @BillyChen1 , @Yanghaihai1020, @lizzzcai , @weixiao-huang ,@TrafalgarZZZ and many others for their great contributions to Fluid v0.9.0!

v0.8.6

08 May 06:53
91c05c3
Compare
Choose a tag to compare

What's Changed

Full Changelog: v0.8.5...v0.8.6