Skip to content

Release 0.1.21: catalog/storage paths and Dremio catalog check in %metadata - #75

Merged
oskaresparza merged 5 commits into
mainfrom
staging
Oct 1, 2026
Merged

oskaresparza merged 5 commits into
mainfrom
staging

Conversation

@oskaresparza

Copy link
Copy Markdown
Collaborator

Promotes staging to main for the 0.1.21 release.

What's in it

  • %metadata push_to_dds takes dds_path with either . or / separators (Release to staging: catalog/storage paths and Dremio catalog check in %metadata #74). A quoted catalog name such as "v1.0" loses its quotes and stays one folder.
  • The path is checked in the Dremio catalog before anything is uploaded.
    • A missing path raises CatalogPathNotFound and nothing reaches DDS.
    • DREMIO_BASE_URL comes from the nearest .env, else the kernel environment.
    • check_catalog=False skips the check, and %metadata check_catalog_path(path) runs it alone.
  • CatalogRestClient.get_entity(segments) looks up names that contain dots. Dremio's 400 for a missing item in its catalog source is treated as "absent".
  • %metadata help describes the . / / separators and leaves dds_base_url() / dremio_base_url() out of the table.
  • Version bump to 0.1.21, with the README install examples updated.

Tests

468 passed, 1 skipped (the live SDI test).

🤖 Generated with Claude Code

oskaresparza and others added 5 commits October 1, 2026 10:52
Sync staging back into development (v0.1.20)
… first

- push_to_dds takes dds_path with '.' or '/' separators; a quoted catalog
  name ("v1.0") loses its quotes and stays one folder (path_segments,
  to_storage_path, to_catalog_path).
- Before uploading, the path is looked up in the Dremio catalog
  (DREMIO_BASE_URL from the nearest .env, else the kernel); a missing path
  raises CatalogPathNotFound and nothing is uploaded. check_catalog=False
  skips it; %metadata check_catalog_path(path) runs the check alone.
- CatalogRestClient.get_entity(segments) for by-path lookups of names that
  contain dots; Dremio's 400 for a missing item in its catalog source reads
  as absent.
- %metadata help: describe the '.' / '/' separators; hide dds_base_url and
  dremio_base_url (still callable).

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Release to staging: catalog/storage paths and Dremio catalog check in %metadata
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant