All notable changes to this project will be documented in this file.
The format is based on Keep a Changelog and this project adheres to Semantic Versioning.
Generated by auto-changelog.
#311: Replace retries with forever#301: Update dependency aws-sdk to ^2.641.0#297: Update dependency aws-sdk to ^2.639.0#299: Bump acorn from 6.4.0 to 6.4.1#296: Update dependency codecov to ^3.6.5#289: Update dependency got to ^10.6.0#291: Update dependency semver to ^7.1.3#292: Update dependency husky to ^4.2.3#293: Bump codecov from 3.6.4 to 3.6.5#295: Update dependency lint-staged to ^10.0.8#288: Update dependency aws-sdk to ^2.638.0030112f: Upgrade dependenciesf0f4e4e: Update package-lock4a4c336: Upgrade dependencies1ad074f: Replace retries with large number to forevere05c662: Update regex as per linter suggestion
#287: Fix conflicts when aborting the pipeline#278: Update dependency lint-staged to ^10.0.6#281: Upgrade dependencies#273: Update dependency semver to v7#272: Update dependency chance to ^1.1.4#270: Update dependency fast-deep-equal to v3#269: Update dependency lint-staged to ^9.5.0#267: Update dependency eslint to ^6.8.0#264: bugfix: register enhanced fan-out consumers in batches of 517879b7: Updates package-lock9438c42: Upgrade major version dependencies06cba5b: Upgraded dependencies33b9ec0: Fix timeout cheks on an active stream and make sure requests are aborted with the latest Got module4766798: Upgrades got to v.10aadcc5c: Updates package-lock15b5867: fix unit testsdf1466b: fix linting issue
#256: Update dependency prettier to ^1.19.1#257: Update dependency chalk to v3#255: feature: add a max enhanced consumers option#254: Feature/change provisionedthroughputexceededexception to debug#253: bugfix: fix unparsable xml breaking pre-process transform#251: Update dependency auto-changelog to ^1.16.2#249: Update dependency aws-sdk to ^2.568.0#250: Update dependency eslint to ^6.6.0a7fc0f2: Adopt core commons 2.3.496e20ed: Upgrade dependenciese8b9bfe: feature: add a flag for supressing provisioned throughput exceeded exception warning logs75e619c: Fix problems with concurrent DynamoDB updatesd65edc8: feature: apply range limits on the max enhanced consumer option765b015: alphabetize properlyc578008: Remove unexpected record properties coming from S3a321709: feature: add tests for max enhanced consumers options
#247: Optional JSON parse09499be: Simplify JSON parse condition. Improve documentation description.eba49f7: Correct usage of actions/setup-node.version in the CI478ede7: Remove redundant default
#245: expose the list shards method#232: Update dependency aws-sdk to ^2.535.0#234: Update dependency codecov to ^3.6.1#235: Update dependency lint-staged to ^9.3.0#233: Update dependency eslint to ^6.4.0750240b: Upgrade dependencies and fix new linter exceptions
#230: bugfix: s3 config missing default values#229: Update dependency aws-sdk to ^2.526.0714f723: Upgrade aws-sdk
#214: Use S3 for sending large messages#228: Update dependency aws-sdk to ^2.525.0#227: Update dependency is-retry-allowed to ^1.2.0#224: Update dependency aws-sdk to ^2.524.0#225: Update dependency auto-changelog to ^1.16.1#223: Update dependency aws-sdk to ^2.522.0#221: Update dependency auto-changelog to ^1.16.0#222: Update dependency husky to ^3.0.5#220: Update dependency jsdoc-to-markdown to ^5.0.1#219: Update dependency eslint to ^6.3.0#218: Update dependency aws-sdk to ^2.521.0e8c3bb7: feature: add ability to use s3 for large items8902f69: Recreate lock file
#215: Update dependency aws-sdk to ^2.519.0#212: Update dependency lint-staged to ^9.2.5ffd47cb: Recreate the lock file5312182: Adopt core commons 2.3.3034882d: Include “TimeoutError” in the retriable put errorsb54be0d: Bring back the CHANGELOG template8e473c3: Adopt core commons 2.3.3
f02d3d0: Add test coverage for when stopping consumers on start failure9c156be: Make the consumer manager not be forced to wait until for the resolution of the start of a single consumer
#208: Bugfix/enhanced consumers assign conflict#201: Update dependency aws-sdk to ^2.505.0#200: Update dependency aws-sdk to ^2.504.087890c8: Adopt the latest core commons774af91: Recover 100% test coverage644e9a6: Fix failing testsf767fe0: Ensure all errors thrown from timer callbacks are caught3d08082: Create CODE_OF_CONDUCT.md9594ef7: Conditionally clear usage of enhanced fan-out consumers0e1ce54: Fix typo on "shouldReconcile"3af8b44: Remove the .auto-changelog filed07f5f1: Only lock non-used enhanced fan-out consumers8e8be3a: Remove Node 8 from the pipeline
#199: Recreate the shard iterator if it expired in between polling reads#197: Update dependency husky to ^3.0.2#198: Update dependency aws-sdk to ^2.503.0#196: Update dependency aws-sdk to ^2.501.0#194: Update dependency lint-staged to ^9.2.1#195: Update dependency aws-sdk to ^2.500.0#193: Update dependency aws-sdk to ^2.499.0#191: Update dependency aws-sdk to ^2.498.0#192: Update dependency semver to ^6.3.0#190: Update dependency aws-sdk to ^2.497.0#189: Update dependency aws-sdk to ^2.496.0#188: Update dependency husky to ^3.0.1#187: Update dependency aws-sdk to ^2.495.0#186: Update dependency aws-sdk to ^2.494.025e92c5: Recreate the shard iterator if it is expired62a37b0: Recreate lock file2ca7572: Upgrade dependencies
#177: Bugfix/await reconciliation#176: Update dependency eslint-config-lifion to ^1.2.4#167: Update dependency aws-sdk to ^2.486.0#168: Update dependency semver to ^6.1.3#169: Update dependency lint-staged to v9#170: Update dependency husky to v3#165: Update dependency aws-sdk to ^2.484.0#166: Update dependency husky to ^2.7.0#164: Update dependency eslint to ^6.0.1#163: Update dependency aws-sdk to ^2.481.0#159: Update dependency aws-sdk to ^2.480.0#160: Update dependency eslint to v6#161: Update dependency semver to ^6.1.2#162: Update dependency husky to ^2.5.0#158: Update dependency aws-sdk to ^2.479.0#157: Adopt GitHub Actions#156: Update dependency eslint-config-lifion to ^1.2.3#151: Update dependency prettier to ^1.18.2#152: Update dependency aws-sdk to ^2.478.0#154: Update dependency husky to ^2.4.1#155: Update dependency lint-staged to ^8.2.1#150: Update dependency aws-sdk to ^2.470.0#148: Update dependency aws-sdk to ^2.469.0#149: Update dependency lint-staged to ^8.2.06f8d45f: Adopt the latest linterb330f4e: Correct ESLint integration14d49d7: Update main.workflowe772433: Update main.workflowa764481: Correct the maintainers311823b: Update contributors62e21f6: Add a missing await in acquireLeasesfb8bf08: Update main.workflow8705869: Avoid formatting coverage files
#127: Feature/unit tests and updated docs#147: Update dependency husky to ^2.4.0#146: Update dependency aws-sdk to ^2.468.0#145: Update dependency aws-sdk to ^2.464.0#144: Update dependency semver to ^6.1.1#143: Update dependency aws-sdk to ^2.463.0#142: Update dependency aws-sdk to ^2.462.0#141: Update dependency semver to ^6.1.0#140: Update dependency aws-sdk to ^2.461.054662a1: Add tests for lib/state-store8af3763: Add tests for lib/fan-out-consumercb9c34f: Add tests for lib/index254b525: Add tests for lib/kinesis-client5d10b17: Document the rest of the modulesc86066b: Refactor put record(s) resultsefcf145: Add tests for lib/stream2cc0e0d: Upgrade dependenciese9759ad: Recover test-coverage in lib/comsumers-managerbc09da7: Integrate branch with latest releaseeebdb34: Upgrade aws-sdk182d6f5: Upgrade aws-sdkef4e970: Upgrade aws-sdkc3f30a8: Upgrade aws-sdk
#138: Update dependency aws-sdk to ^2.460.0#139: Refactor stream creation on put record(s)#137: Update dependency aws-sdk to ^2.458.0#134: Update dependency codecov to ^3.5.0#135: Update dependency lint-staged to ^8.1.7#133: Update dependency aws-sdk to ^2.455.0#132: Update dependency husky to ^2.3.0#131: Update dependency aws-sdk to ^2.454.0#130: Update dependency prettier to ^1.17.1#129: Update dependency jsdoc-to-markdown to v5#128: Update dependency aws-sdk to ^2.453.0#125: Update dependency aws-sdk to ^2.452.0#126: Update dependency codecov to ^3.4.0#124: Update dependency jest to ^24.8.0#123: Update dependency lint-staged to ^8.1.6#122: Update dependency aws-sdk to ^2.451.0#121: Update dependency jest-junit to ^6.4.0#120: Update dependency husky to ^2.2.0#118: Update dependency aws-sdk to ^2.447.0#119: Update dependency short-uuid to ^3.1.14a9e7b4: Add tests for lib/dynamodb-client0669488: Add tests for lib/lease-managerce8a742: Add tests for lib/polling-consumerb12d83b: Upgrade dependenciesdd845d6: Partial tests for lib/stream4cb343e: Refactor the tests for lib/dynamodb-client3671145: Add tests for lib/records7efc497: Add tests for lib/utilsedaf114: Add tests for lib/table126e455: Add tests for lib/stats3316550: Adopt the latest eslint-config-lifion2d05ec4: Improve resilience of the fan-out consumer462916c: Add tests for lib/heartbeat-manager32a89e1: Upgrade aws-sdk and codecov6ccc463: Remove extra linting rules6fc42b3: Recover 100% test coverage in lib/utils8304786: Include network errorsae4ba4b: Adjust test thresholdseaf7c2b: Tweak intervals
#117: Add shards on update
72eaa66: Fix bug in "getRecords"
83c8b5f: Tweak timeouts for leasing and heartbeats
ab83203: Upgrade aws-sdk8524eee: Minor stats refactor91c2ebf: Allow to override the default pay-per-request billing mode83e5d1f: Correct check for asigned enhanced consumer on the lease manager
#115: Feature/add stats and health#110: Assign enhanced fan-out consumers to instances of the client#114: Update dependency aws-sdk to ^2.444.0#111: Update dependency husky to ^2.1.0#109: Add retry to putRecord(s)302fd9f: Pipe records from enhanced consumers back to the client328cd80: Add stats support29fd0cb: Allow fan-out consumers to use regular checkpointsab57e5d: Fix failing tests9ebcd84: Refactor of enhanced fan-out code to make it easier to follow40f22f6: Implement use all shards in fan-out consumer modebad779e: Re-factor records encoding400959c: Add tests for lib/consumers-manager59a23d3: Implement shard expiration in fan-out consumers03247fe: Remove the utils module272c9f3: Refactor “setUpEnhancedConsumers” so it’s easier to follow4841494: Add initial test files5e1109b: Fix re-assignment of enhanced consumers when there are more consumers than enhanced consumers93a29e2: Add more initial test files6866d9d: Confirm parent depletion works with fan-out consumers7505973: Detect parent shard depletion in fan-out mode4978a32: Add unit tests for lib/compressioncd352fb: Remove “setUpEnhancedConsumers” from the documentationeadb90b: Simplify the polling consumer set checkpoint calls0a92f99: Retry only on throughputa1eeafb: Remove GET request debug messagea46f0e8: Re-create lock file
#102: Feature/polling support#106: Update dependency aws-sdk to ^2.440.0#105: Update dependency auto-changelog to ^1.13.0#107: Add putRecord and putRecords#104: Update dependency prettier to ^1.17.0#103: Update dependency auto-changelog to ^1.12.1#100: Update dependency jest to ^24.7.1#99: Update dependency eslint to ^5.16.0#98: Update dependency aws-sdk to ^2.437.0#97: Update dependency semver to v6#96: Update dependency semver to ^5.7.0#95: Update dependency aws-sdk to ^2.429.0#94: Update dependency aws-sdk to ^2.428.0#88: Update dependency jest to ^24.4.0#86: Update dependency aws-sdk to ^2.418.0#85: Update dependency jest to ^24.3.1#84: Update dependency eslint to ^5.15.1#83: Update dependency lint-staged to ^8.1.5#82: Update dependency aws-sdk to ^2.417.0#81: Update dependency lifion-aws-event-stream to ^1.0.2#80: Update dependency eslint-config-lifion to ^1.1.0#79: Update dependency aws-sdk to ^2.411.0#78: Update dependency eslint to ^5.14.1#77: Update dependency aws-sdk to ^2.404.0#76: Update dependency jest-junit to ^6.3.0#73: Update dependency aws-sdk to ^2.403.0#74: Update dependency codecov to ^3.2.0#75: Update dependency lint-staged to ^8.1.4#72: Update dependency jest to ^24.1.0#71: Update dependency aws-sdk to ^2.397.0#70: Update dependency lint-staged to ^8.1.3#69: Update dependency eslint to ^5.13.0#68: Update dependency prettier to ^1.16.4#67: Update dependency jest-junit to ^6.2.1#66: Update dependency lint-staged to ^8.1.1#65: Update dependency aws-sdk to ^2.395.0#64: Update dependency jest to v24#63: Update dependency aws-sdk to ^2.394.0#60: Update dependency npm-watch to ^0.6.0#62: Update dependency jest-junit to ^6.1.0#61: Update dependency aws-sdk to ^2.393.0#58: Update dependency prettier to ^1.16.1#59: Update dependency aws-sdk to ^2.392.0#57: Update dependency eslint to ^5.12.1#55: Update dependency aws-sdk to ^2.391.0#56: Update dependency got to ^9.6.0#54: Update dependency aws-sdk to ^2.388.0#50: Update dependency aws-sdk to ^2.387.0#51: Update dependency jest-junit to v6#52: Update dependency got to ^9.5.1#53: Update dependency auto-changelog to ^1.11.0#45: Update dependency aws-sdk to ^2.384.0#49: Update dependency chalk to ^2.4.2#46: Update dependency eslint to ^5.12.0#47: Update dependency husky to ^1.3.1#48: Update dependency auto-changelog to ^1.10.3#41: Update dependency aws-sdk to ^2.378.0#42: Update dependency husky to ^1.2.1#43: Update dependency got to ^9.5.0#40: Update dependency got to ^9.4.0#37: Update dependency aws-sdk to ^2.373.0#39: Update dependency eslint to ^5.10.0#38: Update dependency prettier to ^1.15.3bd4f9ff: Upgrade NPM modules41d2b9f: Upgrade NPN dependencies576f166: Make sure the state table is tagged as expected8906c14: Initial leasing algorithm implementation3400bcd: Normalize the stream and table modulescf182c3: Fix continuous polling on a shard splite92c4ac: Correct lock file, optimize renovate9c76b02: Make sure the client recovers to any errorddb50fe: Upgrade aws-sdk7e4ece3: Implement roll call for consumers26675f8: Allow reading from all shards9fcec2f: Document the state-storedb13161: Adopt the concept of consumer group69a2b28: Re-create lock filee64136d: Correct the proxies, prepare for shard reader timers7c707f3: Improve debug messages84e9129: Fix shard distrution and stop consumers after lease expirationd610f8a: Upgrade AWS-SDKfa2be93: Add support to manually set checkpoints65b8470: Remove the coordinated timeout in roll calls08c2834: Correct the README with the correct encryption documentation8fed106: Try to acquire leases for shards by sorted shard ID3b5d6c7: Fix missing initialization of the dynamoDb optiond949dc6: Correct copyright in the license
#36: Update dependency aws-sdk to ^2.366.0#33: Update dependency lint-staged to ^8.1.0#32: Update dependency husky to ^1.2.0#34: Update dependency npm-watch to ^0.5.0#35: Update dependency aws-sdk to ^2.363.0#1: Enhanced Fan-Out Support#31: Update dependency eslint-config-lifion to ^1.0.3#29: Update dependency lint-staged to ^8.0.5#30: Update dependency auto-changelog to ^1.10.2#23: Update dependency prettier to ^1.15.2#28: Update dependency auto-changelog to ^1.10.1#25: Update dependency eslint to ^5.9.0#26: Update dependency auto-changelog to ^1.10.0#27: Update dependency husky to ^1.1.4#24: Update dependency auto-changelog to ^1.9.0#20: Update dependency eslint to ^5.8.0#21: Update dependency lint-staged to v8#22: Update dependency husky to ^1.1.3#19: Update dependency eslint to ^5.7.0#18: Update dependency husky to ^1.1.2#17: Update dependency semver to ^5.6.0#16: Update dependency eslint-config-lifion to ^1.0.2#15: Feature/enable npm publish ci#13: Update dependency auto-changelog to ^1.8.1#12: Update dependency eslint-config-lifion to ^1.0.1#11: Update dependency husky to ^1.1.1#10: Update dependency eslint to ^5.6.1#9: Update dependency husky to ^1.0.1#7: Update dependency eslint-config-lifion to v1#6: Update dependency eslint to v5#8: Update dependency husky to v1#5: Update dependency npm-watch to ^0.4.0#2: Configure Renovate1be561c: Initial commit9894deb: Add basic CircleCI integration27a7d4f: Re-create package-lock.json5823729: Add integration with CircleCIb5b9ce1: Set NVM to use the current LTS3ce84f9: Add management of stream consumers, refactor stream management562bea1: Add test coveragee5588a6: Add enhanced-fanout shard subscriber and initial parsera9765f1: Upgrade aws-sdk, eslint-config-lifion, and eslint38b435f: Update documentation4faac4d: Ensure streams are created, encrypted, and taggedc695f98: Add a Kinesis records decoder0dd328a: Recreate the shard subscription stream when expiring972c7f6: Adopt lifion-aws-event-stream40f156f: Remove the check-dependencies script in favor of Renovate1bb389b: Include the shard ID in the piped recordscd5d904: Connect the parsed records into the clientc591875: Fix the utils tests4f9fad8: Add test coverage for lib/utils197f2c4: Add deploy and publish to circleci30c0a3b: Replace toBeCalledWith calls with its canonical version5ad427a: Fix directory for .npmrc and add reports0ffdc6a: Rename project to lifion-kinesis39f098d: Make the tag test cases more specificce26fc3: Change the Renovate configurationc8d578e: Add renovate.json07fd3aa: Delete renovate.json23ac7b7: Correct the package-lock.json filea641c0d: Make sure the CI stops if the tests fail