Skip to content

Commit

Permalink
Test/Bump Version Source File (#5006)
Browse files Browse the repository at this point in the history
* Allow SFTP to define port

* Define port as a string

* Provide a clearer error if port parsing fails

* bump source file version

* try to resolve 409 azure

Co-authored-by: Madison Swain-Bowden <bowdenm@spu.edu>
  • Loading branch information
marcosmarxm and AetherUnbound authored Jul 27, 2021
1 parent 2d5d7e8 commit e269c5f
Show file tree
Hide file tree
Showing 5 changed files with 11 additions and 4 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
"sourceDefinitionId": "778daa7c-feaf-4db6-96f3-70fd645acc77",
"name": "File",
"dockerRepository": "airbyte/source-file",
"dockerImageTag": "0.2.4",
"dockerImageTag": "0.2.5",
"documentationUrl": "https://hub.docker.com/r/airbyte/source-file",
"icon": "file.svg"
}
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@
- sourceDefinitionId: 778daa7c-feaf-4db6-96f3-70fd645acc77
name: File
dockerRepository: airbyte/source-file
dockerImageTag: 0.2.4
dockerImageTag: 0.2.5
documentationUrl: https://hub.docker.com/r/airbyte/source-file
icon: file.svg
- sourceDefinitionId: 253487c0-2246-43ba-a21f-5116b20a2c50
Expand Down
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-file/Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -13,5 +13,5 @@ RUN pip install .

ENV AIRBYTE_ENTRYPOINT "/airbyte/base.sh"

LABEL io.airbyte.version=0.2.4
LABEL io.airbyte.version=0.2.5
LABEL io.airbyte.name=airbyte/source-file
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,9 @@

import json
import os
import random
import socket
import string
import tempfile
import uuid
from pathlib import Path
Expand All @@ -44,6 +46,10 @@
HERE = Path(__file__).parent.absolute()


def random_char(length):
return "".join(random.choice(string.ascii_letters) for x in range(length))


@pytest.fixture(scope="session")
def docker_compose_file() -> Path:
return HERE / "docker-compose.yml"
Expand Down Expand Up @@ -196,7 +202,7 @@ def private_aws_file(aws_credentials, cloud_bucket_name, download_gcs_public_dat
def azblob_file(azblob_credentials, cloud_bucket_name, download_gcs_public_data, public=False):
acc_url = f"https://{azblob_credentials['storage_account']}.blob.core.windows.net"
azblob_client = BlobServiceClient(account_url=acc_url, credential=azblob_credentials["shared_key"])
container_name = cloud_bucket_name
container_name = cloud_bucket_name + random_char(3).lower()
if public:
container_name += "public"
print(f"\nUpload dataset to private azure blob container {container_name}")
Expand Down
1 change: 1 addition & 0 deletions docs/integrations/sources/file.md
Original file line number Diff line number Diff line change
Expand Up @@ -142,6 +142,7 @@ Please see \(or add\) more at `airbyte-integrations/connectors/source-file/integ

| Version | Date | Pull Request | Subject |
| :------ | :-------- | :----- | :------ |
| 0.2.5 | 2021-07-26 | [4953](https://github.com/airbytehq/airbyte/pull/4953) | Allow non-default port for SFTP type |
| 0.2.4 | 2021-06-09 | [3973](https://github.com/airbytehq/airbyte/pull/3973) | Add AIRBYTE_ENTRYPOINT for Kubernetes support |
| 0.2.3 | 2021-06-01 | [3771](https://github.com/airbytehq/airbyte/pull/3771) | Add Azure Storage Blob Files option |
| 0.2.2 | 2021-04-16 | [2883](https://github.com/airbytehq/airbyte/pull/2883) | Fix CSV discovery memory consumption |
Expand Down

0 comments on commit e269c5f

Please sign in to comment.