Skip to content

Commit

Permalink
local file system should not point to IP (OpenLineage#3159)
Browse files Browse the repository at this point in the history
Signed-off-by: Maciej Obuchowski <obuchowski.maciej@gmail.com>
  • Loading branch information
mobuchowski authored Oct 25, 2024
1 parent 7f0fc07 commit 76a8948
Show file tree
Hide file tree
Showing 2 changed files with 17 additions and 1 deletion.
15 changes: 15 additions & 0 deletions spec/Naming.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,7 @@
# Naming

## This document is obsolete, please look at the [OpenLineage Naming Conventions](https://openlineage.io/docs/spec/naming)

We define the unique name strategy per resource to ensure it is followed uniformly independently of who is producing
metadata, so we can connect lineage from various sources.

Expand Down Expand Up @@ -381,6 +383,19 @@ Identifier :

### Local file system

Naming hierarchy:

- Path

Identifier :

- Namespace: file
- Scheme = file
- Unique name: {path}
- URI = file://{path}

### Remote file system

Datasource hierarchy:

- IP
Expand Down
3 changes: 2 additions & 1 deletion website/docs/spec/naming.md
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,8 @@ A dataset, or `table`, is organized according to a producer, namespace, database
| GCS | Blob storage | gs://{bucket name} | {object key} |
| HDFS | Distributed file system | hdfs://{namenode host}:{namenode port} | {path} |
| Kafka | distributed event streaming platform | kafka://{bootstrap server host}:{port} | {topic} |
| Local file system | File system | file://{host} | {path} |
| Local file system | File system | file | {path} |
| Remote file system | File system | file://{host} | {path} |
| S3 | Blob Storage | s3://{bucket name} | {object key} |
| WASBS (Azure Blob Storage) | Blob Storage | wasbs://{container name}@{service name}.dfs.core.windows.net | {object key} |

Expand Down

0 comments on commit 76a8948

Please sign in to comment.