Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failed to export data to ElasticSearch sink #283

Open
fengjie926 opened this issue Dec 19, 2023 · 0 comments
Open

Failed to export data to ElasticSearch sink #283

fengjie926 opened this issue Dec 19, 2023 · 0 comments

Comments

@fengjie926
Copy link

fengjie926 commented Dec 19, 2023

K8S Server v1.28.2

kube-eventer image: registry.aliyuncs.com/acs/kube-eventer:v1.2.7-ca03be0-aliyun

Elastic 版本: [阿里云 Elasticsearch Serverless服务] 入门版本7.10

spec: dnsPolicy: ClusterFirstWithHostNet serviceAccount: kube-eventer containers: - image: registry.aliyuncs.com/acs/kube-eventer:v1.2.7-ca03be0-aliyun name: kube-eventer command: - "/kube-eventer" - "--source=kubernetes:https://kubernetes.default" ## .e.g,dingtalk sink demo - --sink=elasticsearch:http://estest-hq1.public.cn-hangzhou.es-serverless.aliyuncs.com:9200?sniff=false&index=kubeeventer&esUserName=****&esUserSecret=****

看起来是 ES index 中部分字段不支持,能帮忙给出建议的 index 或如何解决

W1219 17:28:30.999337 1 driver.go:110] Failed to export data to ElasticSearch sink: elastic: Error 400 (Bad Request): Failed to parse mapping [_doc]: Root mapping definition has unsupported parameters: [default : {_all={enabled=false}}] [general : {properties={MetricsTags={properties={cluster_name={index=not_analyzed, type=string}, type={index=not_analyzed, type=string}, host_id={index=not_analyzed, type=string}, labels={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, namespace_name={type=string, fields={raw={index=not_analyzed, type=string}}}, pod_name={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, nodename={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, hostname={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, container_base_image={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, container_name={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, namespace_id={index=not_analyzed, type=string}, resource_id={index=not_analyzed, type=string}, pod_id={index=not_analyzed, type=string}}}, MetricsValue={properties={value={type=double}}}, GeneralMetricsTimestamp={format=strict_date_optional_time||epoch_millis, type=date}, MetricsName={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}}}] [memory : {properties={Metrics={properties={memory/request={properties={value={type=double}}}, memory/rss={properties={value={type=double}}}, memory/node_reservation={properties={value={type=double}}}, memory/node_capacity={properties={value={type=double}}}, memory/page_faults={properties={value={type=double}}}, memory/cache={properties={value={type=double}}}, memory/working_set={properties={value={type=double}}}, memory/usage={properties={value={type=double}}}, memory/limit={properties={value={type=double}}}, memory/node_allocatable={properties={value={type=double}}}, memory/major_page_faults_rate={properties={value={type=double}}}, memory/node_utilization={properties={value={type=double}}}, memory/page_faults_rate={properties={value={type=double}}}, memory/major_page_faults={properties={value={type=double}}}}}, MetricsTags={properties={cluster_name={index=not_analyzed, type=string}, type={index=not_analyzed, type=string}, host_id={index=not_analyzed, type=string}, labels={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, namespace_name={type=string, fields={raw={index=not_analyzed, type=string}}}, pod_name={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, nodename={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, hostname={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, container_base_image={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, container_name={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, namespace_id={index=not_analyzed, type=string}, resource_id={index=not_analyzed, type=string}, pod_id={index=not_analyzed, type=string}}}, MemoryMetricsTimestamp={format=strict_date_optional_time||epoch_millis, type=date}}}] [cpu : {properties={Metrics={properties={cpu/usage_rate={properties={value={type=double}}}, cpu/node_reservation={properties={value={type=double}}}, cpu/request={properties={value={type=double}}}, cpu/usage={properties={value={type=double}}}, cpu/node_utilization={properties={value={type=double}}}, cpu/node_allocatable={properties={value={type=double}}}, cpu/limit={properties={value={type=double}}}, cpu/node_capacity={properties={value={type=double}}}}}, CpuMetricsTimestamp={format=strict_date_optional_time||epoch_millis, type=date}, MetricsTags={properties={cluster_name={index=not_analyzed, type=string}, type={index=not_analyzed, type=string}, host_id={index=not_analyzed, type=string}, labels={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, namespace_name={type=string, fields={raw={index=not_analyzed, type=string}}}, pod_name={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, nodename={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, hostname={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, container_base_image={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, container_name={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, namespace_id={index=not_analyzed, type=string}, resource_id={index=not_analyzed, type=string}, pod_id={index=not_analyzed, type=string}}}}}] [filesystem : {properties={FilesystemMetricsTimestamp={format=strict_date_optional_time||epoch_millis, type=date}, Metrics={properties={filesystem/usage={properties={value={type=double}}}, filesystem/inodes={properties={value={type=double}}}, filesystem/inodes_free={properties={value={type=double}}}, filesystem/available={properties={value={type=double}}}, filesystem/limit={properties={value={type=double}}}}}, MetricsTags={properties={cluster_name={index=not_analyzed, type=string}, type={index=not_analyzed, type=string}, host_id={index=not_analyzed, type=string}, labels={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, namespace_name={type=string, fields={raw={index=not_analyzed, type=string}}}, pod_name={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, nodename={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, hostname={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, container_base_image={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, container_name={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, namespace_id={index=not_analyzed, type=string}, resource_id={index=not_analyzed, type=string}, pod_id={index=not_analyzed, type=string}}}}}] [events : {properties={EventTags={properties={eventID={index=not_analyzed, type=string}, cluster_name={index=not_analyzed, type=string}, hostname={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, pod_id={index=not_analyzed, type=string}, pod_name={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}}}, Type={index=not_analyzed, type=string}, Message={type=string, fields={raw={index=not_analyzed, type=string}}}, FirstOccurrenceTimestamp={format=strict_date_optional_time||epoch_millis, type=date}, Metadata={properties={uid={index=not_analyzed, type=string}, resourceVersion={index=not_analyzed, type=string}, creationTimestamp={format=strict_date_optional_time||epoch_millis, type=date}, name={type=string, fields={raw={index=not_analyzed, type=string}}}, namespace={type=string, fields={raw={index=not_analyzed, type=string}}}, selfLink={index=not_analyzed, type=string}}}, Count={type=long}, Reason={index=not_analyzed, type=string}, Source={properties={component={index=not_analyzed, type=string}, host={type=string, fields={raw={index=not_analyzed, type=string}}}}}, InvolvedObject={properties={uid={index=not_analyzed, type=string}, apiVersion={index=not_analyzed, type=string}, kind={index=not_analyzed, type=string}, resourceVersion={index=not_analyzed, type=string}, fieldPath={type=string, fields={raw={index=not_analyzed, type=string}}}, name={type=string, fields={raw={index=not_analyzed, type=string}}}, namespace={type=string, fields={raw={index=not_analyzed, type=string}}}}}, LastOccurrenceTimestamp={format=strict_date_optional_time||epoch_millis, type=date}}}] [network : {properties={NetworkMetricsTimestamp={format=strict_date_optional_time||epoch_millis, type=date}, Metrics={properties={network/tx_errors={properties={value={type=double}}}, network/tx_rate={properties={value={type=double}}}, network/rx={properties={value={type=double}}}, network/tx_errors_rate={properties={value={type=double}}}, network/rx_errors={properties={value={type=double}}}, network/rx_errors_rate={properties={value={type=double}}}, network/tx={properties={value={type=double}}}, network/rx_rate={properties={value={type=double}}}}}, MetricsTags={properties={cluster_name={index=not_analyzed, type=string}, type={index=not_analyzed, type=string}, host_id={index=not_analyzed, type=string}, labels={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, namespace_name={type=string, fields={raw={index=not_analyzed, type=string}}}, pod_name={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, nodename={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, hostname={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, container_base_image={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, container_name={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, namespace_id={index=not_analyzed, type=string}, resource_id={index=not_analyzed, type=string}, pod_id={index=not_analyzed, type=string}}}}}] [type=mapper_parsing_exception]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant