🐛 Source S3: Fix discovery for zip file (airbytehq#32677)

Co-authored-by: Alexandre Girard <[email protected]>
fleetio · Nov 21, 2023 · a41d11b · a41d11b
1 parent 9dae0d3
commit a41d11b
Show file tree

Hide file tree

Showing 3 changed files with 4 additions and 3 deletions.
diff --git a/airbyte-integrations/connectors/source-s3/metadata.yaml b/airbyte-integrations/connectors/source-s3/metadata.yaml
@@ -10,7 +10,7 @@ data:
   connectorSubtype: file
   connectorType: source
   definitionId: 69589781-7828-43c5-9f63-8925b1c1ccc2
-  dockerImageTag: 4.2.1
+  dockerImageTag: 4.2.2
   dockerRepository: airbyte/source-s3
   documentationUrl: https://docs.airbyte.com/integrations/sources/s3
   githubIssueLabel: source-s3

diff --git a/airbyte-integrations/connectors/source-s3/source_s3/v4/stream_reader.py b/airbyte-integrations/connectors/source-s3/source_s3/v4/stream_reader.py
@@ -157,7 +157,7 @@ def _page(
                 break
 
     def _handle_file(self, file):
-        if file["Key"].endswith("zip"):
+        if file["Key"].endswith(".zip"):
             yield from self._handle_zip_file(file)
         else:
             yield self._handle_regular_file(file)

diff --git a/docs/integrations/sources/s3.md b/docs/integrations/sources/s3.md
@@ -256,7 +256,8 @@ To perform the text extraction from PDF and Docx files, the connector uses the [
 
 | Version | Date       | Pull Request                                                                                                    | Subject                                                                                                              |
 |:--------|:-----------|:----------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------|
-| 4.2.1 | 2023-11-13 | [32357](https://github.com/airbytehq/airbyte/pull/32357) | Improve spec schema |
+| 4.2.2   | 2023-11-20 | [32677](https://github.com/airbytehq/airbyte/pull/32677)                                                        | Only read files with ".zip" extension as zipped files                                                                                       |
+| 4.2.1   | 2023-11-13 | [32357](https://github.com/airbytehq/airbyte/pull/32357)                                                        | Improve spec schema                                                                                                  |
 | 4.2.0   | 2023-11-02 | [32109](https://github.com/airbytehq/airbyte/pull/32109)                                                        | Fix docs; add HTTPS validation for S3 endpoint; fix coverage                                                         |
 | 4.1.4   | 2023-10-30 | [31904](https://github.com/airbytehq/airbyte/pull/31904)                                                        | Update CDK                                                                                                           |
 | 4.1.3   | 2023-10-25 | [31654](https://github.com/airbytehq/airbyte/pull/31654)                                                        | Reduce image size                                                                                                    |