You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Sample Data:{ "_index": "logstash-2021.01.29", "_type": "_doc", "_id": "https://www.wsj.com/articles/qualtrics-shares-jump-in-trading-debut-11611863999", "_version": 12, "_score": null, "_source": { "Feed": "https://feeds.a.dj.com/rss/RSSMarketsMain.xml", "title": "Qualtrics Shares Jump in Trading Debut", "link": "https://www.wsj.com/articles/qualtrics-shares-jump-in-trading-debut-11611863999", "published": "2021-01-28T20:00:00.000Z", "tags": [ "rss" ], "message": "Shares of Qualtrics, a spinoff from SAP, rose roughly 38% in its public-markets debut amid a surge of investor interest in the enterprise-software sector.", "@version": "1", "@timestamp": "2021-01-29T17:44:12.186Z", }, "fields": { "@timestamp": [ "2021-01-29T17:44:12.186Z" ], "published": [ "2021-01-28T20:00:00.000Z" ] }, "sort": [ 1611942252186 ] }
Steps to Reproduce: it looks like the RSS input is manipulating the data becuase the published is not a field in the RSS xml it's PubDate. I've tried to do the date filter on published and it doesn't work becuase I am met with a dateparse issue when I use. date { match => [ "[published]", "ISO8601" ] }
The text was updated successfully, but these errors were encountered:
Version:logstash:7.10.2
Operating System:Docker
Config File
input { rss { url => "https://feeds.a.dj.com/rss/WSJcomUSBusiness.xml" interval => 300 } tags => ["rss"] } } filter { date { match => [ "pubDate", "EEE, dd MMM yyyy HH:mm:ss z" ] } } output { elasticsearch { hosts => ["http://server:9200"] index => "logstash-%{+YYYY.MM.dd}" document_id => "%{link}" user => #### password => #### } }
Sample
Data:{ "_index": "logstash-2021.01.29", "_type": "_doc", "_id": "https://www.wsj.com/articles/qualtrics-shares-jump-in-trading-debut-11611863999", "_version": 12, "_score": null, "_source": { "Feed": "https://feeds.a.dj.com/rss/RSSMarketsMain.xml", "title": "Qualtrics Shares Jump in Trading Debut", "link": "https://www.wsj.com/articles/qualtrics-shares-jump-in-trading-debut-11611863999", "published": "2021-01-28T20:00:00.000Z", "tags": [ "rss" ], "message": "Shares of Qualtrics, a spinoff from SAP, rose roughly 38% in its public-markets debut amid a surge of investor interest in the enterprise-software sector.", "@version": "1", "@timestamp": "2021-01-29T17:44:12.186Z", }, "fields": { "@timestamp": [ "2021-01-29T17:44:12.186Z" ], "published": [ "2021-01-28T20:00:00.000Z" ] }, "sort": [ 1611942252186 ] }
Steps to Reproduce: it looks like the RSS input is manipulating the data becuase the published is not a field in the RSS xml it's PubDate. I've tried to do the date filter on published and it doesn't work becuase I am met with a dateparse issue when I use.
date { match => [ "[published]", "ISO8601" ] }
The text was updated successfully, but these errors were encountered: