Skip to content
This repository was archived by the owner on May 17, 2024. It is now read-only.
This repository was archived by the owner on May 17, 2024. It is now read-only.

data-diff does NOT work with dbt version 1.6.0 #660

Closed
@sungchun12

Description

@sungchun12

Describe the bug
A clear and concise description of what the bug is.

I updated dbt to version 1.6.0 with the snowflake adapter, but it keeps showing this error. The manifest.json probably has changed.

Looks like the manifest upgraded to v10 from v9: https://schemas.getdbt.com/dbt/manifest/v10.json

image
image

Make sure to include the following (minus sensitive information):

  • The command or code you used
  • The run output + error you're getting. (including tracestack)
  • Run data-diff with the -d switch for extra debug information.

If possible, please paste these as text, and not a screenshot.

 ~/Desktop/datafold-demo-sung  test-pr *1 !4  data-diff --dbt -d                                                                                     1 ✘  6s  datafold-demo-sung 🐍  02:26:18 PM 
Running with data-diff=0.8.0
14:27:04 INFO     Parsing file dbt_project.yml                                                                                                                                         dbt_parser.py:247
         INFO     Parsing file /Users/sung/Desktop/datafold-demo-sung/target/manifest.json                                                                                             dbt_parser.py:240
         ERROR    Not a soft of manifest.json                                                                                                                                            __main__.py:327
Traceback (most recent call last):
  File "/Users/sung/Desktop/datafold-demo-sung/venv/bin/data-diff", line 8, in <module>
    sys.exit(main())
  File "/Users/sung/Desktop/datafold-demo-sung/venv/lib/python3.9/site-packages/click/core.py", line 1130, in __call__
    return self.main(*args, **kwargs)
  File "/Users/sung/Desktop/datafold-demo-sung/venv/lib/python3.9/site-packages/click/core.py", line 1055, in main
    rv = self.invoke(ctx)
  File "/Users/sung/Desktop/datafold-demo-sung/venv/lib/python3.9/site-packages/click/core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/Users/sung/Desktop/datafold-demo-sung/venv/lib/python3.9/site-packages/click/core.py", line 760, in invoke
    return __callback(*args, **kwargs)
  File "/Users/sung/Desktop/datafold-demo-sung/venv/lib/python3.9/site-packages/data_diff/__main__.py", line 311, in main
    dbt_diff(
  File "/Users/sung/Desktop/datafold-demo-sung/venv/lib/python3.9/site-packages/data_diff/dbt.py", line 79, in dbt_diff
    dbt_parser = DbtParser(profiles_dir_override, project_dir_override, state)
  File "/Users/sung/Desktop/datafold-demo-sung/venv/lib/python3.9/site-packages/data_diff/dbt_parser.py", line 109, in __init__
    self.dev_manifest_obj = self.get_manifest_obj(self.project_dir / MANIFEST_PATH)
  File "/Users/sung/Desktop/datafold-demo-sung/venv/lib/python3.9/site-packages/data_diff/dbt_parser.py", line 242, in get_manifest_obj
    manifest_obj = parse_manifest(manifest=manifest_dict)
  File "/Users/sung/Desktop/datafold-demo-sung/venv/lib/python3.9/site-packages/dbt_artifacts_parser/parser.py", line 100, in parse_manifest
    raise ValueError("Not a soft of manifest.json")
ValueError: Not a soft of manifest.json

Describe the environment

Describe which OS you're using, which data-diff version, and any other information that might be relevant to this bug.

Used this public demo repo: https://github.com/datafold/datafold-demo-sung/tree/test-pr

data-diff version: 0.8.0
dbt version: 1.6.0
dbt-snowflake version: 1.6.0
MacOS
Python Version: 3.9.6

Metadata

Metadata

Assignees

Labels

--dbtIssues/features related to the dbt integrationbugSomething isn't working

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions