Runs the specified loaders in a worker pool.
npm install --save-dev thread-loaderor
yarn add -D thread-loaderor
pnpm add -D thread-loaderPut this loader in front of other loaders. The following loaders run in a worker pool.
Loaders running in a worker pool have limitations. Examples:
- Loaders cannot emit files.
- Loaders cannot use custom loader APIs (i.e. by plugins).
- Loaders cannot access webpack options.
Each worker is a separate Node.js process, which has an overhead of ~600ms. There is also additional overhead from inter-process communication.
Use this loader only for expensive operations!
webpack.config.js
module.exports = {
module: {
rules: [
{
test: /\.js$/,
include: path.resolve('src'),
use: [
'thread-loader',
// your expensive loader (e.g babel-loader)
],
},
],
},
};with options
use: [
{
loader: 'thread-loader',
// loaders with equal options will share worker pools
options: {
// the number of spawned workers, defaults to (number of cpus - 1) or
// fallback to 1 when require('os').cpus() is undefined
workers: 2,
// number of jobs a worker processes in parallel
// defaults to 20
workerParallelJobs: 50,
// additional node.js arguments
workerNodeArgs: ['--max-old-space-size=1024'],
// Allow to respawn a dead worker pool
// respawning slows down the entire compilation
// and should be set to false for development
poolRespawn: false,
// timeout for killing the worker processes when idle
// defaults to 500 (ms)
// can be set to Infinity for watching builds to keep workers alive
poolTimeout: 2000,
// number of jobs the pool distributes to the workers
// defaults to 200
// decrease for less efficient but more fair distribution
poolParallelJobs: 50,
// name of the pool
// can be used to create different pools with otherwise identical options
name: 'my-pool',
},
},
// your expensive loader (e.g babel-loader)
];prewarming
To prevent the high delays when booting workers, it is possible to warm up the worker pool.
This boots the max number of workers in the pool and loads the specified modules into the Node.js module cache.
const threadLoader = require('thread-loader');
threadLoader.warmup(
{
// pool options, like passed to loader options
// must match loader options to boot the correct pool
},
[
// modules to load
// can be any module, i.e.
'babel-loader',
'@babel/preset-env',
'sass-loader',
],
);We welcome all contributions! If you're new here, please take a moment to review our contributing guidelines before submitting issues or pull requests.
