Skip to content

fix(gatsby-source-drupal): cache backlink records #33444

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
KyleAMathews merged 12 commits into from
Oct 25, 2021
Merged

fix(gatsby-source-drupal): cache backlink records #33444

KyleAMathews merged 12 commits into from
Oct 25, 2021

Conversation

@KyleAMathews
Copy link
Contributor

@KyleAMathews KyleAMathews commented Oct 5, 2021 •
edited
Loading

Write the in-memory lookup map to the cache after a successful run of "sourceNodes" and reload it for use in subsequent builds.

This fixes an issue where backlinks aren't preserved properly for incremental node updates with a warm cache.

Fixes #33267

GatsbyJS Bot and others added 6 commits September 17, 2021 17:52
@KyleAMathews
fix(gatsby-source-drupal): check relationships type exists on node be…
c410082 
…fore filtering (#33181) (#33228)

* fix(gatsby-source-drupal): check relationships type exists on node before filtering

* Update packages/gatsby-source-drupal/src/utils.js

Co-authored-by: Dustin Schau <DSchau@users.noreply.github.com>

* format

Co-authored-by: Dustin Schau <DSchau@users.noreply.github.com>
(cherry picked from commit d4f8355)

Co-authored-by: Kyle Mathews <mathews.kyle@gmail.com>
@vladar
chore(release): Publish
f3f1bbc 
 - babel-plugin-remove-graphql-queries@3.14.0
 - babel-preset-gatsby-package@1.14.0
 - babel-preset-gatsby@1.14.0
 - create-gatsby@1.14.0
 - gatsby-admin@0.24.0
 - gatsby-cli@3.14.0
 - gatsby-codemods@2.14.0
 - gatsby-core-utils@2.14.0
 - gatsby-cypress@1.14.0
 - gatsby-design-tokens@3.14.0
 - gatsby-dev-cli@3.14.0
 - gatsby-graphiql-explorer@1.14.0
 - gatsby-legacy-polyfills@1.14.0
 - gatsby-link@3.14.0
 - gatsby-page-utils@1.14.0
 - gatsby-plugin-benchmark-reporting@1.14.0
 - gatsby-plugin-canonical-urls@3.14.0
 - gatsby-plugin-catch-links@3.14.0
 - gatsby-plugin-coffeescript@3.14.0
 - gatsby-plugin-create-client-paths@3.14.0
 - gatsby-plugin-cxs@3.14.0
 - gatsby-plugin-emotion@6.14.0
 - gatsby-plugin-facebook-analytics@3.14.0
 - gatsby-plugin-feed@3.14.0
 - gatsby-plugin-flow@2.14.0
 - gatsby-plugin-fullstory@3.14.0
 - gatsby-plugin-gatsby-cloud@3.2.0
 - gatsby-plugin-google-analytics@3.14.0
 - gatsby-plugin-google-gtag@3.14.0
 - gatsby-plugin-google-tagmanager@3.14.0
 - gatsby-plugin-graphql-config@0.23.0
 - gatsby-plugin-image@1.14.0
 - gatsby-plugin-jss@3.14.0
 - gatsby-plugin-layout@2.14.0
 - gatsby-plugin-less@5.14.0
 - gatsby-plugin-lodash@4.14.0
 - gatsby-plugin-manifest@3.14.0
 - gatsby-plugin-mdx@2.14.0
 - gatsby-plugin-netlify-cms@5.14.0
 - gatsby-plugin-no-sourcemaps@3.14.0
 - gatsby-plugin-nprogress@3.14.0
 - gatsby-plugin-offline@4.14.0
 - gatsby-plugin-page-creator@3.14.0
 - gatsby-plugin-postcss@4.14.0
 - gatsby-plugin-preact@5.14.0
 - gatsby-plugin-preload-fonts@2.14.0
 - gatsby-plugin-react-css-modules@3.14.0
 - gatsby-plugin-react-helmet@4.14.0
 - gatsby-plugin-remove-trailing-slashes@3.14.0
 - gatsby-plugin-sass@4.14.0
 - gatsby-plugin-schema-snapshot@2.14.0
 - gatsby-plugin-sharp@3.14.0
 - gatsby-plugin-sitemap@4.10.0
 - gatsby-plugin-styled-components@4.14.0
 - gatsby-plugin-styled-jsx@4.14.0
 - gatsby-plugin-styletron@6.14.0
 - gatsby-plugin-stylus@3.14.0
 - gatsby-plugin-subfont@3.14.0
 - gatsby-plugin-twitter@3.14.0
 - gatsby-plugin-typescript@3.14.0
 - gatsby-plugin-typography@3.14.0
 - gatsby-plugin-utils@1.14.0
 - gatsby-react-router-scroll@4.14.0
 - gatsby-recipes@0.25.0
 - gatsby-remark-autolink-headers@4.11.0
 - gatsby-remark-code-repls@5.11.0
 - gatsby-remark-copy-linked-files@4.11.0
 - gatsby-remark-custom-blocks@3.14.0
 - gatsby-remark-embed-snippet@6.11.0
 - gatsby-remark-graphviz@3.11.0
 - gatsby-remark-images-contentful@4.11.0
 - gatsby-remark-images@5.11.0
 - gatsby-remark-katex@5.11.0
 - gatsby-remark-prismjs@5.11.0
 - gatsby-remark-responsive-iframe@4.11.0
 - gatsby-remark-smartypants@4.11.0
 - gatsby-source-contentful@5.14.0
 - gatsby-source-drupal@4.14.0
 - gatsby-source-faker@3.14.0
 - gatsby-source-filesystem@3.14.0
 - gatsby-source-graphql@3.14.0
 - gatsby-source-hacker-news@3.14.0
 - gatsby-source-lever@3.14.0
 - gatsby-source-medium@3.14.0
 - gatsby-source-mongodb@3.14.0
 - gatsby-source-npm-package-search@3.14.0
 - gatsby-source-shopify@5.6.0
 - gatsby-source-wikipedia@3.14.0
 - gatsby-source-wordpress@5.14.0
 - gatsby-telemetry@2.14.0
 - gatsby-transformer-asciidoc@2.14.0
 - gatsby-transformer-csv@3.14.0
 - gatsby-transformer-documentationjs@5.14.0
 - gatsby-transformer-excel@3.14.0
 - gatsby-transformer-hjson@3.14.0
 - gatsby-transformer-javascript-frontmatter@3.14.0
 - gatsby-transformer-javascript-static-exports@3.14.0
 - gatsby-transformer-json@3.14.0
 - gatsby-transformer-pdf@2.14.0
 - gatsby-transformer-react-docgen@6.14.0
 - gatsby-transformer-remark@4.11.0
 - gatsby-transformer-screenshot@3.14.0
 - gatsby-transformer-sharp@3.14.0
 - gatsby-transformer-sqip@3.14.0
 - gatsby-transformer-toml@3.14.0
 - gatsby-transformer-xml@3.14.0
 - gatsby-transformer-yaml@3.14.0
 - gatsby-worker@0.5.0
 - gatsby@3.14.0
@kszot-ref
Preserve backlink/reference lookup tables in cache
0c10243
@kszot-ref
Merge branch 'master' into gatsby-source-drupal-inc-build-backlink-fi…
8438e7a 
…x-pr
@KyleAMathews
Merge remote-tracking branch 'origin/master' into gatsby-source-drupa…
c49dee8 
…l-inc-build-backlink-fix-pr
@KyleAMathews
test
80befd5
@gatsbot gatsbot bot added the status: triage needed Issue or pull request that need to be triaged and assigned to a reviewer label Oct 5, 2021
@KyleAMathews KyleAMathews added topic: source-drupal Related to Gatsby's integration with Drupal type: bug An issue or pull request relating to a bug in Gatsby and removed status: triage needed Issue or pull request that need to be triaged and assigned to a reviewer labels Oct 5, 2021
KyleAMathews added a commit that referenced this pull request Oct 25, 2021
@KyleAMathews
cache backlink records #33444
3fa6041
wardpeet
wardpeet reviewed Oct 25, 2021
View reviewed changes
packages/gatsby-source-drupal/src/utils.js
Comment on lines +20 to +24
backRefsNamesLookup = new Map(JSON.parse(backRefsNamesLookupStr))
}

if (referencedNodesLookupStr) {
referencedNodesLookup = new Map(JSON.parse(referencedNodesLookupStr))
Copy link
Contributor

@wardpeet wardpeet Oct 25, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I wonder if this can become very memory expensive. Does this run on PSU without problems? If not we should look into http://ndjson.org/

Copy link
Contributor Author

@KyleAMathews KyleAMathews Oct 25, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I tested it on a smaller site but good point — lemme test how expensive this is for a PSU-sized site

Copy link
Contributor Author

@KyleAMathews KyleAMathews Oct 25, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

rss increases about 400mb while stringifying the two maps into a totoal of ~85 million characters. Execution time is ~600ms.

I think reasonable enough given how big PSU is — they're using ~6.5gb already at this point so this is a temp 15% bump in memory use that'll be GCed fairly soon after that.

@KyleAMathews KyleAMathews merged commit 0def3ac into master Oct 25, 2021
@KyleAMathews KyleAMathews deleted the kyle-s-fork branch October 25, 2021 19:56
@gatsbybot gatsbybot mentioned this pull request Oct 27, 2021
Merged
vladar added a commit that referenced this pull request Oct 27, 2021
@KyleAMathews @vladar @kszot-ref
fix(gatsby-source-drupal): cache backlink records (#33444)
092a204 
* fix(gatsby-source-drupal): check relationships type exists on node before filtering (#33181) (#33228)

* fix(gatsby-source-drupal): check relationships type exists on node before filtering

* Update packages/gatsby-source-drupal/src/utils.js

Co-authored-by: Dustin Schau <DSchau@users.noreply.github.com>

* format

Co-authored-by: Dustin Schau <DSchau@users.noreply.github.com>
(cherry picked from commit d4f8355)

Co-authored-by: Kyle Mathews <mathews.kyle@gmail.com>

* chore(release): Publish

 - babel-plugin-remove-graphql-queries@3.14.0
 - babel-preset-gatsby-package@1.14.0
 - babel-preset-gatsby@1.14.0
 - create-gatsby@1.14.0
 - gatsby-admin@0.24.0
 - gatsby-cli@3.14.0
 - gatsby-codemods@2.14.0
 - gatsby-core-utils@2.14.0
 - gatsby-cypress@1.14.0
 - gatsby-design-tokens@3.14.0
 - gatsby-dev-cli@3.14.0
 - gatsby-graphiql-explorer@1.14.0
 - gatsby-legacy-polyfills@1.14.0
 - gatsby-link@3.14.0
 - gatsby-page-utils@1.14.0
 - gatsby-plugin-benchmark-reporting@1.14.0
 - gatsby-plugin-canonical-urls@3.14.0
 - gatsby-plugin-catch-links@3.14.0
 - gatsby-plugin-coffeescript@3.14.0
 - gatsby-plugin-create-client-paths@3.14.0
 - gatsby-plugin-cxs@3.14.0
 - gatsby-plugin-emotion@6.14.0
 - gatsby-plugin-facebook-analytics@3.14.0
 - gatsby-plugin-feed@3.14.0
 - gatsby-plugin-flow@2.14.0
 - gatsby-plugin-fullstory@3.14.0
 - gatsby-plugin-gatsby-cloud@3.2.0
 - gatsby-plugin-google-analytics@3.14.0
 - gatsby-plugin-google-gtag@3.14.0
 - gatsby-plugin-google-tagmanager@3.14.0
 - gatsby-plugin-graphql-config@0.23.0
 - gatsby-plugin-image@1.14.0
 - gatsby-plugin-jss@3.14.0
 - gatsby-plugin-layout@2.14.0
 - gatsby-plugin-less@5.14.0
 - gatsby-plugin-lodash@4.14.0
 - gatsby-plugin-manifest@3.14.0
 - gatsby-plugin-mdx@2.14.0
 - gatsby-plugin-netlify-cms@5.14.0
 - gatsby-plugin-no-sourcemaps@3.14.0
 - gatsby-plugin-nprogress@3.14.0
 - gatsby-plugin-offline@4.14.0
 - gatsby-plugin-page-creator@3.14.0
 - gatsby-plugin-postcss@4.14.0
 - gatsby-plugin-preact@5.14.0
 - gatsby-plugin-preload-fonts@2.14.0
 - gatsby-plugin-react-css-modules@3.14.0
 - gatsby-plugin-react-helmet@4.14.0
 - gatsby-plugin-remove-trailing-slashes@3.14.0
 - gatsby-plugin-sass@4.14.0
 - gatsby-plugin-schema-snapshot@2.14.0
 - gatsby-plugin-sharp@3.14.0
 - gatsby-plugin-sitemap@4.10.0
 - gatsby-plugin-styled-components@4.14.0
 - gatsby-plugin-styled-jsx@4.14.0
 - gatsby-plugin-styletron@6.14.0
 - gatsby-plugin-stylus@3.14.0
 - gatsby-plugin-subfont@3.14.0
 - gatsby-plugin-twitter@3.14.0
 - gatsby-plugin-typescript@3.14.0
 - gatsby-plugin-typography@3.14.0
 - gatsby-plugin-utils@1.14.0
 - gatsby-react-router-scroll@4.14.0
 - gatsby-recipes@0.25.0
 - gatsby-remark-autolink-headers@4.11.0
 - gatsby-remark-code-repls@5.11.0
 - gatsby-remark-copy-linked-files@4.11.0
 - gatsby-remark-custom-blocks@3.14.0
 - gatsby-remark-embed-snippet@6.11.0
 - gatsby-remark-graphviz@3.11.0
 - gatsby-remark-images-contentful@4.11.0
 - gatsby-remark-images@5.11.0
 - gatsby-remark-katex@5.11.0
 - gatsby-remark-prismjs@5.11.0
 - gatsby-remark-responsive-iframe@4.11.0
 - gatsby-remark-smartypants@4.11.0
 - gatsby-source-contentful@5.14.0
 - gatsby-source-drupal@4.14.0
 - gatsby-source-faker@3.14.0
 - gatsby-source-filesystem@3.14.0
 - gatsby-source-graphql@3.14.0
 - gatsby-source-hacker-news@3.14.0
 - gatsby-source-lever@3.14.0
 - gatsby-source-medium@3.14.0
 - gatsby-source-mongodb@3.14.0
 - gatsby-source-npm-package-search@3.14.0
 - gatsby-source-shopify@5.6.0
 - gatsby-source-wikipedia@3.14.0
 - gatsby-source-wordpress@5.14.0
 - gatsby-telemetry@2.14.0
 - gatsby-transformer-asciidoc@2.14.0
 - gatsby-transformer-csv@3.14.0
 - gatsby-transformer-documentationjs@5.14.0
 - gatsby-transformer-excel@3.14.0
 - gatsby-transformer-hjson@3.14.0
 - gatsby-transformer-javascript-frontmatter@3.14.0
 - gatsby-transformer-javascript-static-exports@3.14.0
 - gatsby-transformer-json@3.14.0
 - gatsby-transformer-pdf@2.14.0
 - gatsby-transformer-react-docgen@6.14.0
 - gatsby-transformer-remark@4.11.0
 - gatsby-transformer-screenshot@3.14.0
 - gatsby-transformer-sharp@3.14.0
 - gatsby-transformer-sqip@3.14.0
 - gatsby-transformer-toml@3.14.0
 - gatsby-transformer-xml@3.14.0
 - gatsby-transformer-yaml@3.14.0
 - gatsby-worker@0.5.0
 - gatsby@3.14.0

* Preserve backlink/reference lookup tables in cache

* test

* fix bad merge

* try try again

* Improve log

* Get working with tests

Co-authored-by: GatsbyJS Bot <mathews.kyle+gatsbybot@gmail.com>
Co-authored-by: Vladimir Razuvaev <vladimir.razuvaev@gmail.com>
Co-authored-by: Krzysztof Szot <kszot@reference.be>
(cherry picked from commit 0def3ac)
vladar pushed a commit that referenced this pull request Oct 27, 2021
@KyleAMathews
fix(gatsby-source-drupal): cache backlink records (#33444) (#33701)
26c51c0 
* fix(gatsby-source-drupal): check relationships type exists on node before filtering (#33181) (#33228)

* fix(gatsby-source-drupal): check relationships type exists on node before filtering

* Update packages/gatsby-source-drupal/src/utils.js

Co-authored-by: Dustin Schau <DSchau@users.noreply.github.com>

* format

Co-authored-by: Dustin Schau <DSchau@users.noreply.github.com>
(cherry picked from commit d4f8355)

Co-authored-by: Kyle Mathews <mathews.kyle@gmail.com>

* chore(release): Publish

 - babel-plugin-remove-graphql-queries@3.14.0
 - babel-preset-gatsby-package@1.14.0
 - babel-preset-gatsby@1.14.0
 - create-gatsby@1.14.0
 - gatsby-admin@0.24.0
 - gatsby-cli@3.14.0
 - gatsby-codemods@2.14.0
 - gatsby-core-utils@2.14.0
 - gatsby-cypress@1.14.0
 - gatsby-design-tokens@3.14.0
 - gatsby-dev-cli@3.14.0
 - gatsby-graphiql-explorer@1.14.0
 - gatsby-legacy-polyfills@1.14.0
 - gatsby-link@3.14.0
 - gatsby-page-utils@1.14.0
 - gatsby-plugin-benchmark-reporting@1.14.0
 - gatsby-plugin-canonical-urls@3.14.0
 - gatsby-plugin-catch-links@3.14.0
 - gatsby-plugin-coffeescript@3.14.0
 - gatsby-plugin-create-client-paths@3.14.0
 - gatsby-plugin-cxs@3.14.0
 - gatsby-plugin-emotion@6.14.0
 - gatsby-plugin-facebook-analytics@3.14.0
 - gatsby-plugin-feed@3.14.0
 - gatsby-plugin-flow@2.14.0
 - gatsby-plugin-fullstory@3.14.0
 - gatsby-plugin-gatsby-cloud@3.2.0
 - gatsby-plugin-google-analytics@3.14.0
 - gatsby-plugin-google-gtag@3.14.0
 - gatsby-plugin-google-tagmanager@3.14.0
 - gatsby-plugin-graphql-config@0.23.0
 - gatsby-plugin-image@1.14.0
 - gatsby-plugin-jss@3.14.0
 - gatsby-plugin-layout@2.14.0
 - gatsby-plugin-less@5.14.0
 - gatsby-plugin-lodash@4.14.0
 - gatsby-plugin-manifest@3.14.0
 - gatsby-plugin-mdx@2.14.0
 - gatsby-plugin-netlify-cms@5.14.0
 - gatsby-plugin-no-sourcemaps@3.14.0
 - gatsby-plugin-nprogress@3.14.0
 - gatsby-plugin-offline@4.14.0
 - gatsby-plugin-page-creator@3.14.0
 - gatsby-plugin-postcss@4.14.0
 - gatsby-plugin-preact@5.14.0
 - gatsby-plugin-preload-fonts@2.14.0
 - gatsby-plugin-react-css-modules@3.14.0
 - gatsby-plugin-react-helmet@4.14.0
 - gatsby-plugin-remove-trailing-slashes@3.14.0
 - gatsby-plugin-sass@4.14.0
 - gatsby-plugin-schema-snapshot@2.14.0
 - gatsby-plugin-sharp@3.14.0
 - gatsby-plugin-sitemap@4.10.0
 - gatsby-plugin-styled-components@4.14.0
 - gatsby-plugin-styled-jsx@4.14.0
 - gatsby-plugin-styletron@6.14.0
 - gatsby-plugin-stylus@3.14.0
 - gatsby-plugin-subfont@3.14.0
 - gatsby-plugin-twitter@3.14.0
 - gatsby-plugin-typescript@3.14.0
 - gatsby-plugin-typography@3.14.0
 - gatsby-plugin-utils@1.14.0
 - gatsby-react-router-scroll@4.14.0
 - gatsby-recipes@0.25.0
 - gatsby-remark-autolink-headers@4.11.0
 - gatsby-remark-code-repls@5.11.0
 - gatsby-remark-copy-linked-files@4.11.0
 - gatsby-remark-custom-blocks@3.14.0
 - gatsby-remark-embed-snippet@6.11.0
 - gatsby-remark-graphviz@3.11.0
 - gatsby-remark-images-contentful@4.11.0
 - gatsby-remark-images@5.11.0
 - gatsby-remark-katex@5.11.0
 - gatsby-remark-prismjs@5.11.0
 - gatsby-remark-responsive-iframe@4.11.0
 - gatsby-remark-smartypants@4.11.0
 - gatsby-source-contentful@5.14.0
 - gatsby-source-drupal@4.14.0
 - gatsby-source-faker@3.14.0
 - gatsby-source-filesystem@3.14.0
 - gatsby-source-graphql@3.14.0
 - gatsby-source-hacker-news@3.14.0
 - gatsby-source-lever@3.14.0
 - gatsby-source-medium@3.14.0
 - gatsby-source-mongodb@3.14.0
 - gatsby-source-npm-package-search@3.14.0
 - gatsby-source-shopify@5.6.0
 - gatsby-source-wikipedia@3.14.0
 - gatsby-source-wordpress@5.14.0
 - gatsby-telemetry@2.14.0
 - gatsby-transformer-asciidoc@2.14.0
 - gatsby-transformer-csv@3.14.0
 - gatsby-transformer-documentationjs@5.14.0
 - gatsby-transformer-excel@3.14.0
 - gatsby-transformer-hjson@3.14.0
 - gatsby-transformer-javascript-frontmatter@3.14.0
 - gatsby-transformer-javascript-static-exports@3.14.0
 - gatsby-transformer-json@3.14.0
 - gatsby-transformer-pdf@2.14.0
 - gatsby-transformer-react-docgen@6.14.0
 - gatsby-transformer-remark@4.11.0
 - gatsby-transformer-screenshot@3.14.0
 - gatsby-transformer-sharp@3.14.0
 - gatsby-transformer-sqip@3.14.0
 - gatsby-transformer-toml@3.14.0
 - gatsby-transformer-xml@3.14.0
 - gatsby-transformer-yaml@3.14.0
 - gatsby-worker@0.5.0
 - gatsby@3.14.0

* Preserve backlink/reference lookup tables in cache

* test

* fix bad merge

* try try again

* Improve log

* Get working with tests

Co-authored-by: GatsbyJS Bot <mathews.kyle+gatsbybot@gmail.com>
Co-authored-by: Vladimir Razuvaev <vladimir.razuvaev@gmail.com>
Co-authored-by: Krzysztof Szot <kszot@reference.be>
(cherry picked from commit 0def3ac)

Co-authored-by: Kyle Mathews <mathews.kyle@gmail.com>
wardpeet pushed a commit to herecydev/gatsby that referenced this pull request Oct 29, 2021
@KyleAMathews @vladar
@kszot-ref @wardpeet
fix(gatsby-source-drupal): cache backlink records (gatsbyjs#33444)
c3ef48c 
* fix(gatsby-source-drupal): check relationships type exists on node before filtering (gatsbyjs#33181) (gatsbyjs#33228)

* fix(gatsby-source-drupal): check relationships type exists on node before filtering

* Update packages/gatsby-source-drupal/src/utils.js

Co-authored-by: Dustin Schau <DSchau@users.noreply.github.com>

* format

Co-authored-by: Dustin Schau <DSchau@users.noreply.github.com>
(cherry picked from commit d4f8355)

Co-authored-by: Kyle Mathews <mathews.kyle@gmail.com>

* chore(release): Publish

 - babel-plugin-remove-graphql-queries@3.14.0
 - babel-preset-gatsby-package@1.14.0
 - babel-preset-gatsby@1.14.0
 - create-gatsby@1.14.0
 - gatsby-admin@0.24.0
 - gatsby-cli@3.14.0
 - gatsby-codemods@2.14.0
 - gatsby-core-utils@2.14.0
 - gatsby-cypress@1.14.0
 - gatsby-design-tokens@3.14.0
 - gatsby-dev-cli@3.14.0
 - gatsby-graphiql-explorer@1.14.0
 - gatsby-legacy-polyfills@1.14.0
 - gatsby-link@3.14.0
 - gatsby-page-utils@1.14.0
 - gatsby-plugin-benchmark-reporting@1.14.0
 - gatsby-plugin-canonical-urls@3.14.0
 - gatsby-plugin-catch-links@3.14.0
 - gatsby-plugin-coffeescript@3.14.0
 - gatsby-plugin-create-client-paths@3.14.0
 - gatsby-plugin-cxs@3.14.0
 - gatsby-plugin-emotion@6.14.0
 - gatsby-plugin-facebook-analytics@3.14.0
 - gatsby-plugin-feed@3.14.0
 - gatsby-plugin-flow@2.14.0
 - gatsby-plugin-fullstory@3.14.0
 - gatsby-plugin-gatsby-cloud@3.2.0
 - gatsby-plugin-google-analytics@3.14.0
 - gatsby-plugin-google-gtag@3.14.0
 - gatsby-plugin-google-tagmanager@3.14.0
 - gatsby-plugin-graphql-config@0.23.0
 - gatsby-plugin-image@1.14.0
 - gatsby-plugin-jss@3.14.0
 - gatsby-plugin-layout@2.14.0
 - gatsby-plugin-less@5.14.0
 - gatsby-plugin-lodash@4.14.0
 - gatsby-plugin-manifest@3.14.0
 - gatsby-plugin-mdx@2.14.0
 - gatsby-plugin-netlify-cms@5.14.0
 - gatsby-plugin-no-sourcemaps@3.14.0
 - gatsby-plugin-nprogress@3.14.0
 - gatsby-plugin-offline@4.14.0
 - gatsby-plugin-page-creator@3.14.0
 - gatsby-plugin-postcss@4.14.0
 - gatsby-plugin-preact@5.14.0
 - gatsby-plugin-preload-fonts@2.14.0
 - gatsby-plugin-react-css-modules@3.14.0
 - gatsby-plugin-react-helmet@4.14.0
 - gatsby-plugin-remove-trailing-slashes@3.14.0
 - gatsby-plugin-sass@4.14.0
 - gatsby-plugin-schema-snapshot@2.14.0
 - gatsby-plugin-sharp@3.14.0
 - gatsby-plugin-sitemap@4.10.0
 - gatsby-plugin-styled-components@4.14.0
 - gatsby-plugin-styled-jsx@4.14.0
 - gatsby-plugin-styletron@6.14.0
 - gatsby-plugin-stylus@3.14.0
 - gatsby-plugin-subfont@3.14.0
 - gatsby-plugin-twitter@3.14.0
 - gatsby-plugin-typescript@3.14.0
 - gatsby-plugin-typography@3.14.0
 - gatsby-plugin-utils@1.14.0
 - gatsby-react-router-scroll@4.14.0
 - gatsby-recipes@0.25.0
 - gatsby-remark-autolink-headers@4.11.0
 - gatsby-remark-code-repls@5.11.0
 - gatsby-remark-copy-linked-files@4.11.0
 - gatsby-remark-custom-blocks@3.14.0
 - gatsby-remark-embed-snippet@6.11.0
 - gatsby-remark-graphviz@3.11.0
 - gatsby-remark-images-contentful@4.11.0
 - gatsby-remark-images@5.11.0
 - gatsby-remark-katex@5.11.0
 - gatsby-remark-prismjs@5.11.0
 - gatsby-remark-responsive-iframe@4.11.0
 - gatsby-remark-smartypants@4.11.0
 - gatsby-source-contentful@5.14.0
 - gatsby-source-drupal@4.14.0
 - gatsby-source-faker@3.14.0
 - gatsby-source-filesystem@3.14.0
 - gatsby-source-graphql@3.14.0
 - gatsby-source-hacker-news@3.14.0
 - gatsby-source-lever@3.14.0
 - gatsby-source-medium@3.14.0
 - gatsby-source-mongodb@3.14.0
 - gatsby-source-npm-package-search@3.14.0
 - gatsby-source-shopify@5.6.0
 - gatsby-source-wikipedia@3.14.0
 - gatsby-source-wordpress@5.14.0
 - gatsby-telemetry@2.14.0
 - gatsby-transformer-asciidoc@2.14.0
 - gatsby-transformer-csv@3.14.0
 - gatsby-transformer-documentationjs@5.14.0
 - gatsby-transformer-excel@3.14.0
 - gatsby-transformer-hjson@3.14.0
 - gatsby-transformer-javascript-frontmatter@3.14.0
 - gatsby-transformer-javascript-static-exports@3.14.0
 - gatsby-transformer-json@3.14.0
 - gatsby-transformer-pdf@2.14.0
 - gatsby-transformer-react-docgen@6.14.0
 - gatsby-transformer-remark@4.11.0
 - gatsby-transformer-screenshot@3.14.0
 - gatsby-transformer-sharp@3.14.0
 - gatsby-transformer-sqip@3.14.0
 - gatsby-transformer-toml@3.14.0
 - gatsby-transformer-xml@3.14.0
 - gatsby-transformer-yaml@3.14.0
 - gatsby-worker@0.5.0
 - gatsby@3.14.0

* Preserve backlink/reference lookup tables in cache

* test

* fix bad merge

* try try again

* Improve log

* Get working with tests

Co-authored-by: GatsbyJS Bot <mathews.kyle+gatsbybot@gmail.com>
Co-authored-by: Vladimir Razuvaev <vladimir.razuvaev@gmail.com>
Co-authored-by: Krzysztof Szot <kszot@reference.be>
axe312ger pushed a commit that referenced this pull request Nov 9, 2021
@KyleAMathews @vladar
@kszot-ref @axe312ger
fix(gatsby-source-drupal): cache backlink records (#33444)
ad2938c 
* fix(gatsby-source-drupal): check relationships type exists on node before filtering (#33181) (#33228)

* fix(gatsby-source-drupal): check relationships type exists on node before filtering

* Update packages/gatsby-source-drupal/src/utils.js

Co-authored-by: Dustin Schau <DSchau@users.noreply.github.com>

* format

Co-authored-by: Dustin Schau <DSchau@users.noreply.github.com>
(cherry picked from commit d4f8355)

Co-authored-by: Kyle Mathews <mathews.kyle@gmail.com>

* chore(release): Publish

 - babel-plugin-remove-graphql-queries@3.14.0
 - babel-preset-gatsby-package@1.14.0
 - babel-preset-gatsby@1.14.0
 - create-gatsby@1.14.0
 - gatsby-admin@0.24.0
 - gatsby-cli@3.14.0
 - gatsby-codemods@2.14.0
 - gatsby-core-utils@2.14.0
 - gatsby-cypress@1.14.0
 - gatsby-design-tokens@3.14.0
 - gatsby-dev-cli@3.14.0
 - gatsby-graphiql-explorer@1.14.0
 - gatsby-legacy-polyfills@1.14.0
 - gatsby-link@3.14.0
 - gatsby-page-utils@1.14.0
 - gatsby-plugin-benchmark-reporting@1.14.0
 - gatsby-plugin-canonical-urls@3.14.0
 - gatsby-plugin-catch-links@3.14.0
 - gatsby-plugin-coffeescript@3.14.0
 - gatsby-plugin-create-client-paths@3.14.0
 - gatsby-plugin-cxs@3.14.0
 - gatsby-plugin-emotion@6.14.0
 - gatsby-plugin-facebook-analytics@3.14.0
 - gatsby-plugin-feed@3.14.0
 - gatsby-plugin-flow@2.14.0
 - gatsby-plugin-fullstory@3.14.0
 - gatsby-plugin-gatsby-cloud@3.2.0
 - gatsby-plugin-google-analytics@3.14.0
 - gatsby-plugin-google-gtag@3.14.0
 - gatsby-plugin-google-tagmanager@3.14.0
 - gatsby-plugin-graphql-config@0.23.0
 - gatsby-plugin-image@1.14.0
 - gatsby-plugin-jss@3.14.0
 - gatsby-plugin-layout@2.14.0
 - gatsby-plugin-less@5.14.0
 - gatsby-plugin-lodash@4.14.0
 - gatsby-plugin-manifest@3.14.0
 - gatsby-plugin-mdx@2.14.0
 - gatsby-plugin-netlify-cms@5.14.0
 - gatsby-plugin-no-sourcemaps@3.14.0
 - gatsby-plugin-nprogress@3.14.0
 - gatsby-plugin-offline@4.14.0
 - gatsby-plugin-page-creator@3.14.0
 - gatsby-plugin-postcss@4.14.0
 - gatsby-plugin-preact@5.14.0
 - gatsby-plugin-preload-fonts@2.14.0
 - gatsby-plugin-react-css-modules@3.14.0
 - gatsby-plugin-react-helmet@4.14.0
 - gatsby-plugin-remove-trailing-slashes@3.14.0
 - gatsby-plugin-sass@4.14.0
 - gatsby-plugin-schema-snapshot@2.14.0
 - gatsby-plugin-sharp@3.14.0
 - gatsby-plugin-sitemap@4.10.0
 - gatsby-plugin-styled-components@4.14.0
 - gatsby-plugin-styled-jsx@4.14.0
 - gatsby-plugin-styletron@6.14.0
 - gatsby-plugin-stylus@3.14.0
 - gatsby-plugin-subfont@3.14.0
 - gatsby-plugin-twitter@3.14.0
 - gatsby-plugin-typescript@3.14.0
 - gatsby-plugin-typography@3.14.0
 - gatsby-plugin-utils@1.14.0
 - gatsby-react-router-scroll@4.14.0
 - gatsby-recipes@0.25.0
 - gatsby-remark-autolink-headers@4.11.0
 - gatsby-remark-code-repls@5.11.0
 - gatsby-remark-copy-linked-files@4.11.0
 - gatsby-remark-custom-blocks@3.14.0
 - gatsby-remark-embed-snippet@6.11.0
 - gatsby-remark-graphviz@3.11.0
 - gatsby-remark-images-contentful@4.11.0
 - gatsby-remark-images@5.11.0
 - gatsby-remark-katex@5.11.0
 - gatsby-remark-prismjs@5.11.0
 - gatsby-remark-responsive-iframe@4.11.0
 - gatsby-remark-smartypants@4.11.0
 - gatsby-source-contentful@5.14.0
 - gatsby-source-drupal@4.14.0
 - gatsby-source-faker@3.14.0
 - gatsby-source-filesystem@3.14.0
 - gatsby-source-graphql@3.14.0
 - gatsby-source-hacker-news@3.14.0
 - gatsby-source-lever@3.14.0
 - gatsby-source-medium@3.14.0
 - gatsby-source-mongodb@3.14.0
 - gatsby-source-npm-package-search@3.14.0
 - gatsby-source-shopify@5.6.0
 - gatsby-source-wikipedia@3.14.0
 - gatsby-source-wordpress@5.14.0
 - gatsby-telemetry@2.14.0
 - gatsby-transformer-asciidoc@2.14.0
 - gatsby-transformer-csv@3.14.0
 - gatsby-transformer-documentationjs@5.14.0
 - gatsby-transformer-excel@3.14.0
 - gatsby-transformer-hjson@3.14.0
 - gatsby-transformer-javascript-frontmatter@3.14.0
 - gatsby-transformer-javascript-static-exports@3.14.0
 - gatsby-transformer-json@3.14.0
 - gatsby-transformer-pdf@2.14.0
 - gatsby-transformer-react-docgen@6.14.0
 - gatsby-transformer-remark@4.11.0
 - gatsby-transformer-screenshot@3.14.0
 - gatsby-transformer-sharp@3.14.0
 - gatsby-transformer-sqip@3.14.0
 - gatsby-transformer-toml@3.14.0
 - gatsby-transformer-xml@3.14.0
 - gatsby-transformer-yaml@3.14.0
 - gatsby-worker@0.5.0
 - gatsby@3.14.0

* Preserve backlink/reference lookup tables in cache

* test

* fix bad merge

* try try again

* Improve log

* Get working with tests

Co-authored-by: GatsbyJS Bot <mathews.kyle+gatsbybot@gmail.com>
Co-authored-by: Vladimir Razuvaev <vladimir.razuvaev@gmail.com>
Co-authored-by: Krzysztof Szot <kszot@reference.be>
@snyk-bot snyk-bot mentioned this pull request Feb 18, 2022
Open
@snyk-bot snyk-bot mentioned this pull request Jun 6, 2022
Open
@kaocher82 kaocher82 mentioned this pull request Jun 6, 2022
Open
@nidhi42 nidhi42 mentioned this pull request Jun 6, 2022
Open
This was referenced Apr 15, 2024
Open
Open
Open
Open
@MaxMood96 MaxMood96 mentioned this pull request Apr 15, 2024
Open
This was referenced Apr 15, 2024
Open
Open
Open
Open
Open
Open
Open
Open
Open
Open
This was referenced Apr 15, 2024
Open
Open
This was referenced Apr 15, 2024
Open
Open
This was referenced Apr 15, 2024
Open
Open
Open
This was referenced Apr 15, 2024
Open
Open
Open
Open
@impactyogi impactyogi mentioned this pull request Apr 15, 2024
Open
@MaxMood96 MaxMood96 mentioned this pull request Apr 15, 2024
Open
This was referenced Apr 15, 2024
Open
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

1 more reviewer

@wardpeet wardpeet wardpeet approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

topic: source-drupal Related to Gatsby's integration with Drupal type: bug An issue or pull request relating to a bug in Gatsby

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

gatsby-source-drupal: Incremental build breaks backlinks

5 participants

@KyleAMathews @wardpeet @vladar @kszot-ref