Skip to content

Conversation

@jvallesm
Copy link
Contributor

@jvallesm jvallesm commented Sep 3, 2025

Because

  • Old failed files can't be reprocessed because the previous pipeline
    version is used
  • Even if reprocessing succeeds, failure reason isn't cleaned up from
    previous failure
  • Console passes an empty string as the conversion pipeline when setting
    it as the default pipeline

This commit

  • Adds a migration so failed files use the new pipeline
  • Clears failure reason when reprocessing a file
  • Sanitizes conversion pipeline input on catalog creation / update

Because

- When reprocessing a file, if the catalog conversion pipeline was an
  empty string (console uses this as the value to reset the converstion
  pipeline to the default value), an invalid format error was raised.
- This didn't happen on the 1st processing of the document because the
  file and the catalog pipelines were the same (empty)

This commit

- Sanitizes the conversion pipeline input
- Captures the empty value for the pipeline and bypasses it
Because

- Even with reprocessing fixed, the failed files' metadata contains the
  pipeline that couldn't be reprocessed.

This commit

- Sets the new conversion pipeline in the failed file records
@jvallesm jvallesm self-assigned this Sep 3, 2025
@jvallesm jvallesm merged commit c4ec3a0 into main Sep 3, 2025
8 checks passed
@jvallesm jvallesm deleted the jvalles/fix-kbfile-reprocessing branch September 3, 2025 13:57
jvallesm pushed a commit that referenced this pull request Sep 9, 2025
🤖 I have created a release *beep* *boop*
---


##
[0.31.0](v0.30.1...v0.31.0)
(2025-09-09)


### Features

* **kbfile:** add status filter to catalog file list
([#239](#239))
([#244](#244))
([1836e09](1836e09))


### Bug Fixes

* **kbfile:** reprocessing fixes
([#246](#246))
([c4ec3a0](c4ec3a0))


### Miscellaneous

* **x:** update x to v0.10.0-alpha
([#247](#247))
([0ebd3cd](0ebd3cd))


### Tests

* **integration:** init integration tests
([#242](#242))
([84d54b5](84d54b5))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
jvallesm added a commit to instill-ai/instill-core that referenced this pull request Sep 9, 2025
Because
- The version of the artifact-backend service is not updated in the
instill-core repository.

This commit
- updates the `ARTIFACT_BACKEND_VERSION` in the `.env` file to `0.31.0`.
- updates the `artifactBackend.image.tag` in the helm chart values.yaml
file to `0.31.0`.

## Changes in artifact-backend
- chore(main): release 0.31.0 (instill-ai/artifact-backend#245)
- chore(x): update x to v0.10.0-alpha (instill-ai/artifact-backend#247)
- test(integration): init integration tests
(instill-ai/artifact-backend#242)
- fix(kbfile): reprocessing fixes (instill-ai/artifact-backend#246)
- feat(kbfile): add status filter to catalog file list (#239)
(instill-ai/artifact-backend#244)

Co-authored-by: jvallesm <3977183+jvallesm@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants