Fix duplicate key error in FetchedJobs when job has multiple queue entries#419
Merged
azygis merged 1 commit intohangfire-postgres:masterfrom Feb 7, 2026
Conversation
…tries Add DISTINCT/DISTINCT ON to SQL queries in monitoring API to handle cases where a job has multiple entries in the jobqueue table. This prevents ArgumentException when the dashboard displays fetched jobs.
Contributor
Author
|
@azygis ? :) |
Collaborator
|
Will try to merge and publish this week. |
This was referenced Feb 9, 2026
Closed
Closed
This was referenced Feb 16, 2026
Closed
Closed
Closed
This was referenced Feb 23, 2026
Closed
Open
github-merge-queue bot
pushed a commit
to DFE-Digital/teaching-record-system
that referenced
this pull request
Feb 24, 2026
Pinned [Hangfire.AspNetCore](https://github.com/HangfireIO/Hangfire) at 1.8.23. <details> <summary>Release notes</summary> _Sourced from [Hangfire.AspNetCore's releases](https://github.com/HangfireIO/Hangfire/releases)._ ## 1.8.23 ### Release Notes #### Hangfire.Core * **Changed** – Use stable sorting algorithm for background job filters again (by @jirikanda). * **Fixed** – Custom `AutomaticRetryAttribute` is ignored under certain conditions regression from 1.8.14 (by @jirikanda). * **Fixed** – Add missing keys for Swedish translation (by @karl-sjogren). * **Project** – Use `TypeNameAssemblyFormatHandling` in tests with .NET 6 (by @viktor-vintertass). #### Hangfire.AspNetCore * **Fixed** – `InvalidOperationException`: The request reached the end of the pipeline without executing the endpoint. Commits viewable in [compare view](HangfireIO/Hangfire@v1.8.22...v1.8.23). </details> Pinned [Hangfire.Core](https://github.com/HangfireIO/Hangfire) at 1.8.23. <details> <summary>Release notes</summary> _Sourced from [Hangfire.Core's releases](https://github.com/HangfireIO/Hangfire/releases)._ ## 1.8.23 ### Release Notes #### Hangfire.Core * **Changed** – Use stable sorting algorithm for background job filters again (by @jirikanda). * **Fixed** – Custom `AutomaticRetryAttribute` is ignored under certain conditions regression from 1.8.14 (by @jirikanda). * **Fixed** – Add missing keys for Swedish translation (by @karl-sjogren). * **Project** – Use `TypeNameAssemblyFormatHandling` in tests with .NET 6 (by @viktor-vintertass). #### Hangfire.AspNetCore * **Fixed** – `InvalidOperationException`: The request reached the end of the pipeline without executing the endpoint. Commits viewable in [compare view](HangfireIO/Hangfire@v1.8.22...v1.8.23). </details> Pinned [Hangfire.PostgreSql](https://github.com/frankhommers/Hangfire.PostgreSql) at 1.21.1. <details> <summary>Release notes</summary> _Sourced from [Hangfire.PostgreSql's releases](https://github.com/frankhommers/Hangfire.PostgreSql/releases)._ ## 1.21.1 ## What's Changed * Use PrivateAssets for Dapper.Aot package reference by @latop2604 in hangfire-postgres/Hangfire.PostgreSql#422 **Full Changelog**: hangfire-postgres/Hangfire.PostgreSql@1.21.0...1.21.1 ## 1.21.0 ## What's Changed * Fix duplicate key error in FetchedJobs when job has multiple queue entries by @nicolaj-hartmann in hangfire-postgres/Hangfire.PostgreSql#419 * Fix LISTEN/NOTIFY connection self-healing by @nicolaj-hartmann in hangfire-postgres/Hangfire.PostgreSql#420 * Dapper.AOT by @latop2604 in hangfire-postgres/Hangfire.PostgreSql#417 ## New Contributors * @nicolaj-hartmann made their first contribution in hangfire-postgres/Hangfire.PostgreSql#419 * @latop2604 made their first contribution in hangfire-postgres/Hangfire.PostgreSql#417 **Full Changelog**: hangfire-postgres/Hangfire.PostgreSql@1.20.13...1.21.0 Commits viewable in [compare view](hangfire-postgres/Hangfire.PostgreSql@1.20.13...1.21.1). </details> Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore <dependency name> major version` will close this group update PR and stop Dependabot creating any more for the specific dependency's major version (unless you unignore this specific dependency's major version or upgrade to it yourself) - `@dependabot ignore <dependency name> minor version` will close this group update PR and stop Dependabot creating any more for the specific dependency's minor version (unless you unignore this specific dependency's minor version or upgrade to it yourself) - `@dependabot ignore <dependency name>` will close this group update PR and stop Dependabot creating any more for the specific dependency (unless you unignore this specific dependency or upgrade to it yourself) - `@dependabot unignore <dependency name>` will remove all of the ignore conditions of the specified dependency - `@dependabot unignore <dependency name> <ignore condition>` will remove the ignore condition of the specified dependency and ignore conditions </details> --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: James Gunn <james@gunn.io>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Problem
When a job has multiple entries in the
jobqueuetable (e.g., due to re-queuing or race conditions), the Hangfire dashboard crashes with:This occurs in
PostgreSqlMonitoringApi.FetchedJobsbecause the SQL query returns duplicate job IDs which are then passed toToDictionary().Solution
DISTINCTtoGetQueuedOrFetchedJobIdsto ensure unique job IDs are returnedDISTINCT ON (j."id")toFetchedJobsandEnqueuedJobsSQL queries as a safeguardTesting
Added integration test
FetchedJobs_WithDuplicateJobQueueEntries_DoesNotThrowthat:FetchedJobsvia the monitoring API