Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(NA): increase kbn legacy logging max listeners #84437

Closed

Conversation

mistic
Copy link
Member

@mistic mistic commented Nov 26, 2020

We've started again to get the following error logs when starting Kibana

(node:5223) MaxListenersExceededWarning: Possible EventEmitter memory leak detected. 26 finish listeners added to [WriteStream]. Use emitter.setMaxListeners() to increase limit
server   error  [20:29:22.859] [warning][process] MaxListenersExceededWarning: Possible EventEmitter memory leak detected. 26 finish listeners added to [WriteStream]. Use emitter.setMaxListeners() to increase limit
    at _addListener (events.js:389:17)
    at WriteStream.addListener (events.js:405:10)
    at WriteStream.Readable.on (_stream_readable.js:874:35)
    at WriteStream.once (events.js:436:8)
    at KbnLoggerStringFormat.Readable.pipe (_stream_readable.js:772:8)

In order to fix them I'm increasing the maxListeners again.

@mistic mistic added chore Team:Operations Team label for Operations Team v8.0.0 release_note:skip Skip the PR/issue when compiling release notes v7.11.0 labels Nov 26, 2020
@mistic mistic self-assigned this Nov 26, 2020
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-operations (Team:Operations)

@mistic mistic requested a review from jbudz November 26, 2020 20:36
@ylasri
Copy link

ylasri commented Nov 27, 2020

Getting same error when running kibana from master branch

$ yarn start
yarn run v1.22.5
$ node scripts/kibana --dev
  log   [17:52:29.739] [info][plugins-service] Plugin initialization disabled.
  log   [17:52:29.791] [warning][savedobjects-service] Skipping Saved Object migrations on startup. Note: Individual documents will still be migrated when read or written.
 watching for changes  (7514 files)
  log   [17:52:42.234] [info][server] basepath proxy server running at http://localhost:5601/kbn
np bld    log   [17:52:42.487] [info][@kbn/optimizer] initialized, 105 bundles cached
np bld    log   [17:52:42.488] [warning][@kbn/optimizer] only building [v7dark,v7light] themes, customize with the KBN_OPTIMIZER_THEMES environment variable
np bld    log   [17:52:42.489] [success][@kbn/optimizer] all bundles cached, success after 8 sec
server    log   [17:53:01.266] [info][plugins-service] Plugin "visTypeXy" is disabled.
server    log   [17:53:01.325] [warning][config][deprecation] "kibana.index" is deprecated. Multitenancy by changing "kibana.index" will not be supported starting in 8.0. See
 https://ela.st/kbn-remove-legacy-multitenancy for more details
server    log   [17:53:25.940] [info][plugins-system] Setting up [101] plugins: [taskManager,licensing,globalSearch,globalSearchProviders,code,usageCollection,xpackLegacy,tel
emetryCollectionManager,telemetry,telemetryCollectionXpack,kibanaUsageCollection,mapsLegacy,securityOss,newsfeed,kibanaLegacy,translations,share,embeddable,uiActionsEnhanced,
legacyExport,esUiShared,expressions,charts,bfetch,data,home,observability,console,consoleExtensions,apmOss,searchprofiler,painlessLab,grokdebugger,management,indexPatternMana
gement,advancedSettings,fileUpload,savedObjects,visualizations,visTypeTimeseries,visTypeTimeseriesEnhanced,visTypeVislib,visTypeVega,visTypeTagcloud,visTypeTimelion,timelion,
features,licenseManagement,graph,dataEnhanced,watcher,canvas,visTypeMetric,visTypeMarkdown,visTypeTable,tileMap,mapsOss,regionMap,lensOss,inputControlVis,savedObjectsTagging,
dashboard,lens,maps,dashboardEnhanced,visualize,discover,discoverEnhanced,savedObjectsManagement,spaces,security,reporting,lists,encryptedSavedObjects,beatsManagement,cloud,u
pgradeAssistant,snapshotRestore,fleet,indexManagement,rollup,remoteClusters,crossClusterReplication,indexLifecycleManagement,enterpriseSearch,ml,dashboardMode,transform,inges
tPipelines,eventLog,actions,case,alerts,triggersActionsUi,securitySolution,stackAlerts,infra,monitoring,logstash,apm,uptime]
server    log   [17:53:25.944] [info][plugins][taskManager] TaskManager is identified by the Kibana UUID: 0dcb940c-ec49-4c75-9ba9-5af704bc56ca
server    log   [17:53:26.290] [warning][config][plugins][security] Session cookies will be transmitted over insecure connections. This is not recommended.
server    log   [17:53:26.334] [info][config][plugins][reporting] Chromium sandbox provides an additional layer of protection, and is supported for Win32 OS. Automatically en
abling Chromium sandbox.
server    log   [17:53:26.520] [info][monitoring][monitoring][plugins] config sourced from: production cluster
server    log   [17:53:26.792] [info][savedobjects-service] Waiting until all Elasticsearch nodes are compatible with Kibana before starting saved objects migrations...
server    log   [17:53:26.930] [info][savedobjects-service] Starting saved objects migrations
server    log   [17:53:27.019] [info][plugins-system] Starting [101] plugins: [taskManager,licensing,globalSearch,globalSearchProviders,code,usageCollection,xpackLegacy,telem
etryCollectionManager,telemetry,telemetryCollectionXpack,kibanaUsageCollection,mapsLegacy,securityOss,newsfeed,kibanaLegacy,translations,share,embeddable,uiActionsEnhanced,le
gacyExport,esUiShared,expressions,charts,bfetch,data,home,observability,console,consoleExtensions,apmOss,searchprofiler,painlessLab,grokdebugger,management,indexPatternManage
ment,advancedSettings,fileUpload,savedObjects,visualizations,visTypeTimeseries,visTypeTimeseriesEnhanced,visTypeVislib,visTypeVega,visTypeTagcloud,visTypeTimelion,timelion,fe
atures,licenseManagement,graph,dataEnhanced,watcher,canvas,visTypeMetric,visTypeMarkdown,visTypeTable,tileMap,mapsOss,regionMap,lensOss,inputControlVis,savedObjectsTagging,da
shboard,lens,maps,dashboardEnhanced,visualize,discover,discoverEnhanced,savedObjectsManagement,spaces,security,reporting,lists,encryptedSavedObjects,beatsManagement,cloud,upg
radeAssistant,snapshotRestore,fleet,indexManagement,rollup,remoteClusters,crossClusterReplication,indexLifecycleManagement,enterpriseSearch,ml,dashboardMode,transform,ingestP
ipelines,eventLog,actions,case,alerts,triggersActionsUi,securitySolution,stackAlerts,infra,monitoring,logstash,apm,uptime]
server    log   [17:53:27.398] [error][data][elasticsearch] [version_conflict_engine_exception]: [task:Lens-lens_telemetry]: version conflict, document already exists (curren
t version [4])
server    log   [17:53:27.979] [info][listening] Server running at http://localhost:5603/kbn
server    log   [17:53:28.678] [info][plugins][watcher] Your basic license does not support watcher. Please upgrade your license.
server    log   [17:53:28.693] [info][crossClusterReplication][plugins] Your basic license does not support crossClusterReplication. Please upgrade your license.
server    log   [17:53:28.695] [info][kibana-monitoring][monitoring][monitoring][plugins] Starting monitoring stats collection
(node:10004) MaxListenersExceededWarning: Possible EventEmitter memory leak detected. 26 unpipe listeners added to [WriteStream]. Use emitter.setMaxListeners() to increase li
mit
server   error  [17:53:28.741] [warning][process] MaxListenersExceededWarning: Possible EventEmitter memory leak detected. 26 unpipe listeners added to [WriteStream]. Use emi
tter.setMaxListeners() to increase limit
    at _addListener (events.js:389:17)
    at WriteStream.addListener (events.js:405:10)
    at WriteStream.Readable.on (_stream_readable.js:874:35)
    at KbnLoggerStringFormat.Readable.pipe (_stream_readable.js:671:8)
    at Object.getLogReporter (C:\dev\kibana\packages\kbn-legacy-logging\target\log_reporter.js:45:47)
    at Object.getLoggingConfiguration (C:\dev\kibana\packages\kbn-legacy-logging\target\get_logging_config.js:57:41)
    at Object.setupLogging (C:\dev\kibana\packages\kbn-legacy-logging\target\setup_logging.js:36:39)
    at new LegacyLoggingServer (C:\dev\kibana\packages\kbn-legacy-logging\target\legacy_logging_server.js:73:25)
    at new LegacyAppender (C:\dev\kibana\src\core\server\legacy\logging\appenders\/legacy_appender.ts:49:26)
    at Function.create (C:\dev\kibana\src\core\server\logging\appenders\/appenders.ts:65:16)
    at LoggingSystem.applyBaseConfig (C:\dev\kibana\src\core\server\logging\/logging_system.ts:171:49)
    at LoggingSystem.setContextConfig (C:\dev\kibana\src\core\server\logging\/logging_system.ts:113:12)
    at SafeSubscriber._next (C:\dev\kibana\src\core\server\logging\/logging_service.ts:89:27)
    at SafeSubscriber.__tryOrUnsub (C:\dev\kibana\node_modules\rxjs\src\internal\Subscriber.ts:265:10)
    at SafeSubscriber.next (C:\dev\kibana\node_modules\rxjs\src\internal\Subscriber.ts:207:14)
    at Subscriber._next (C:\dev\kibana\node_modules\rxjs\src\internal\Subscriber.ts:139:22)
(node:10004) MaxListenersExceededWarning: Possible EventEmitter memory leak detected. 26 error listeners added to [WriteStream]. Use emitter.setMaxListeners() to increase lim
it
server   error  [17:53:28.754] [warning][process] MaxListenersExceededWarning: Possible EventEmitter memory leak detected. 26 error listeners added to [WriteStream]. Use emit
ter.setMaxListeners() to increase limit
    at _addListener (events.js:389:17)
    at WriteStream.prependListener (events.js:412:14)
    at prependListener (_stream_readable.js:75:20)
    at KbnLoggerStringFormat.Readable.pipe (_stream_readable.js:759:3)
    at Object.getLogReporter (C:\dev\kibana\packages\kbn-legacy-logging\target\log_reporter.js:45:47)
    at Object.getLoggingConfiguration (C:\dev\kibana\packages\kbn-legacy-logging\target\get_logging_config.js:57:41)
    at Object.setupLogging (C:\dev\kibana\packages\kbn-legacy-logging\target\setup_logging.js:36:39)
    at new LegacyLoggingServer (C:\dev\kibana\packages\kbn-legacy-logging\target\legacy_logging_server.js:73:25)
    at new LegacyAppender (C:\dev\kibana\src\core\server\legacy\logging\appenders\/legacy_appender.ts:49:26)
    at Function.create (C:\dev\kibana\src\core\server\logging\appenders\/appenders.ts:65:16)
    at LoggingSystem.applyBaseConfig (C:\dev\kibana\src\core\server\logging\/logging_system.ts:171:49)
    at LoggingSystem.setContextConfig (C:\dev\kibana\src\core\server\logging\/logging_system.ts:113:12)
    at SafeSubscriber._next (C:\dev\kibana\src\core\server\logging\/logging_service.ts:89:27)
    at SafeSubscriber.__tryOrUnsub (C:\dev\kibana\node_modules\rxjs\src\internal\Subscriber.ts:265:10)
    at SafeSubscriber.next (C:\dev\kibana\node_modules\rxjs\src\internal\Subscriber.ts:207:14)
    at Subscriber._next (C:\dev\kibana\node_modules\rxjs\src\internal\Subscriber.ts:139:22)
(node:10004) MaxListenersExceededWarning: Possible EventEmitter memory leak detected. 26 close listeners added to [WriteStream]. Use emitter.setMaxListeners() to increase lim
it
server   error  [17:53:28.764] [warning][process] MaxListenersExceededWarning: Possible EventEmitter memory leak detected. 26 close listeners added to [WriteStream]. Use emit
ter.setMaxListeners() to increase limit
    at _addListener (events.js:389:17)
    at WriteStream.addListener (events.js:405:10)
    at WriteStream.Readable.on (_stream_readable.js:874:35)
    at WriteStream.once (events.js:436:8)
    at KbnLoggerStringFormat.Readable.pipe (_stream_readable.js:766:8)
    at Object.getLogReporter (C:\dev\kibana\packages\kbn-legacy-logging\target\log_reporter.js:45:47)
    at Object.getLoggingConfiguration (C:\dev\kibana\packages\kbn-legacy-logging\target\get_logging_config.js:57:41)
    at Object.setupLogging (C:\dev\kibana\packages\kbn-legacy-logging\target\setup_logging.js:36:39)
    at new LegacyLoggingServer (C:\dev\kibana\packages\kbn-legacy-logging\target\legacy_logging_server.js:73:25)
    at new LegacyAppender (C:\dev\kibana\src\core\server\legacy\logging\appenders\/legacy_appender.ts:49:26)
    at Function.create (C:\dev\kibana\src\core\server\logging\appenders\/appenders.ts:65:16)
    at LoggingSystem.applyBaseConfig (C:\dev\kibana\src\core\server\logging\/logging_system.ts:171:49)
    at LoggingSystem.setContextConfig (C:\dev\kibana\src\core\server\logging\/logging_system.ts:113:12)
    at SafeSubscriber._next (C:\dev\kibana\src\core\server\logging\/logging_service.ts:89:27)
    at SafeSubscriber.__tryOrUnsub (C:\dev\kibana\node_modules\rxjs\src\internal\Subscriber.ts:265:10)
    at SafeSubscriber.next (C:\dev\kibana\node_modules\rxjs\src\internal\Subscriber.ts:207:14)
(node:10004) MaxListenersExceededWarning: Possible EventEmitter memory leak detected. 26 finish listeners added to [WriteStream]. Use emitter.setMaxListeners() to increase li
mit
server   error  [17:53:28.772] [warning][process] MaxListenersExceededWarning: Possible EventEmitter memory leak detected. 26 finish listeners added to [WriteStream]. Use emi
tter.setMaxListeners() to increase limit
    at _addListener (events.js:389:17)
    at WriteStream.addListener (events.js:405:10)
    at WriteStream.Readable.on (_stream_readable.js:874:35)
    at WriteStream.once (events.js:436:8)
    at KbnLoggerStringFormat.Readable.pipe (_stream_readable.js:772:8)
    at Object.getLogReporter (C:\dev\kibana\packages\kbn-legacy-logging\target\log_reporter.js:45:47)
    at Object.getLoggingConfiguration (C:\dev\kibana\packages\kbn-legacy-logging\target\get_logging_config.js:57:41)
    at Object.setupLogging (C:\dev\kibana\packages\kbn-legacy-logging\target\setup_logging.js:36:39)
    at new LegacyLoggingServer (C:\dev\kibana\packages\kbn-legacy-logging\target\legacy_logging_server.js:73:25)
    at new LegacyAppender (C:\dev\kibana\src\core\server\legacy\logging\appenders\/legacy_appender.ts:49:26)
    at Function.create (C:\dev\kibana\src\core\server\logging\appenders\/appenders.ts:65:16)
    at LoggingSystem.applyBaseConfig (C:\dev\kibana\src\core\server\logging\/logging_system.ts:171:49)
    at LoggingSystem.setContextConfig (C:\dev\kibana\src\core\server\logging\/logging_system.ts:113:12)
    at SafeSubscriber._next (C:\dev\kibana\src\core\server\logging\/logging_service.ts:89:27)
    at SafeSubscriber.__tryOrUnsub (C:\dev\kibana\node_modules\rxjs\src\internal\Subscriber.ts:265:10)
    at SafeSubscriber.next (C:\dev\kibana\node_modules\rxjs\src\internal\Subscriber.ts:207:14)
server    log   [17:53:28.781] [error][data][elasticsearch] [version_conflict_engine_exception]: [task:Actions-actions_telemetry]: version conflict, document already exists (
current version [5])
server    log   [17:53:28.793] [info][server][Kibana][http] http server running at http://localhost:5603/kbn
server    log   [17:53:28.802] [error][data][elasticsearch] [version_conflict_engine_exception]: [task:Alerts-alerts_invalidate_api_keys]: version conflict, document already
exists (current version [4])
server    log   [17:53:28.806] [error][data][elasticsearch] [version_conflict_engine_exception]: [task:apm-telemetry-task]: version conflict, document already exists (current
 version [4])
server    log   [17:53:28.808] [error][data][elasticsearch] [version_conflict_engine_exception]: [task:endpoint:user-artifact-packager:1.0.0]: version conflict, document alre
ady exists (current version [10])
server    log   [17:53:28.809] [error][data][elasticsearch] [version_conflict_engine_exception]: [task:Alerting-alerting_telemetry]: version conflict, document already exists
 (current version [4])
server    log   [17:53:28.812] [error][data][elasticsearch] [version_conflict_engine_exception]: [task:Alerting-alerting_health_check]: version conflict, document already exi
sts (current version [4])
server    log   [17:54:35.438] [info][plugins][routes][security] Logging in with provider "basic" (basic)
server    log   [17:55:37.621] [error][data][elasticsearch] [index_not_found_exception]: no such index [apm-*-transaction*]
server    log   [17:55:37.624] [error][data][elasticsearch] [index_not_found_exception]: no such index [auditbeat-*]
server    log   [17:55:37.625] [error][data][elasticsearch] [index_not_found_exception]: no such index [endgame-*]
server    log   [17:55:37.626] [error][data][elasticsearch] [index_not_found_exception]: no such index [winlogbeat-*]
server    log   [17:55:37.627] [error][data][elasticsearch] [index_not_found_exception]: no such index [packetbeat-*]
server    log   [17:55:37.628] [error][data][elasticsearch] [index_not_found_exception]: no such index [logs-*]
server    log   [17:55:37.629] [error][data][elasticsearch] [index_not_found_exception]: no such index [filebeat-*]
server    log   [17:55:37.841] [error][data][elasticsearch] [index_not_found_exception]: no such index [metrics-endpoint.metadata-*]
server    log   [17:55:58.915] [info][fleet][plugins] Found previous transform references:
 []
server    log   [17:55:58.916] [info][fleet][plugins] Deleting currently installed transform ids

@mistic
Copy link
Member Author

mistic commented Nov 30, 2020

@elasticmachine merge upstream

@kibanamachine
Copy link
Contributor

💚 Build Succeeded

Metrics [docs]

✅ unchanged

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

@mistic
Copy link
Member Author

mistic commented Nov 30, 2020

closed by #84497

@mistic mistic closed this Nov 30, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
chore release_note:skip Skip the PR/issue when compiling release notes Team:Operations Team label for Operations Team v7.11.0 v8.0.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants