-
Notifications
You must be signed in to change notification settings - Fork 1.4k
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
DDSaaS: HubSpot Content Hub: Crawler Integration v1.0.0 (#18670)
* initial commit * modified labeler.yml file * HubSpot Content Hub crawler integration with assets * updated sample logs and dashboard images * Addressed HubSpot review comments - updated readme.md file - updated monitors title - updated dashboard description * Modified codeowners file * Update HubSpot readme.md file * Update HubSpot monitors name --------- Co-authored-by: narendranandaniya-crest <narendra.nandaniya@crestdata.ai>
- Loading branch information
1 parent
0463253
commit ce551bc
Showing
21 changed files
with
9,538 additions
and
15 deletions.
There are no files selected for viewing
Validating CODEOWNERS rules …
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
574 changes: 574 additions & 0 deletions
574
hubspot_content_hub/assets/dashboards/hubspot_content_hub_audit_activity.json
Large diffs are not rendered by default.
Oops, something went wrong.
2,032 changes: 2,032 additions & 0 deletions
2,032
hubspot_content_hub/assets/dashboards/hubspot_content_hub_content_analytics.json
Large diffs are not rendered by default.
Oops, something went wrong.
2,165 changes: 2,165 additions & 0 deletions
2,165
hubspot_content_hub/assets/dashboards/hubspot_content_hub_geolocation_analytics.json
Large diffs are not rendered by default.
Oops, something went wrong.
688 changes: 688 additions & 0 deletions
688
hubspot_content_hub/assets/dashboards/hubspot_content_hub_login_activity.json
Large diffs are not rendered by default.
Oops, something went wrong.
680 changes: 680 additions & 0 deletions
680
hubspot_content_hub/assets/dashboards/hubspot_content_hub_security_activity.json
Large diffs are not rendered by default.
Oops, something went wrong.
2,176 changes: 2,176 additions & 0 deletions
2,176
hubspot_content_hub/assets/dashboards/hubspot_content_hub_source_analytics.json
Large diffs are not rendered by default.
Oops, something went wrong.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
219 changes: 219 additions & 0 deletions
219
hubspot_content_hub/assets/logs/hubspot-content-hub.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,219 @@ | ||
| id: hubspot-content-hub | ||
| metric_id: hubspot-content-hub | ||
| backend_only: false | ||
| facets: | ||
| - groups: | ||
| - Web Access | ||
| name: User-Agent | ||
| path: http.useragent | ||
| source: log | ||
| - groups: | ||
| - Web Access | ||
| name: Browser | ||
| path: http.useragent_details.browser.family | ||
| source: log | ||
| - groups: | ||
| - Web Access | ||
| name: Device | ||
| path: http.useragent_details.device.family | ||
| source: log | ||
| - groups: | ||
| - Web Access | ||
| name: OS | ||
| path: http.useragent_details.os.family | ||
| source: log | ||
| - groups: | ||
| - Geoip | ||
| name: City Name | ||
| path: network.client.geoip.city.name | ||
| source: log | ||
| - groups: | ||
| - Geoip | ||
| name: Continent Code | ||
| path: network.client.geoip.continent.code | ||
| source: log | ||
| - groups: | ||
| - Geoip | ||
| name: Continent Name | ||
| path: network.client.geoip.continent.name | ||
| source: log | ||
| - groups: | ||
| - Geoip | ||
| name: Country ISO Code | ||
| path: network.client.geoip.country.iso_code | ||
| source: log | ||
| - groups: | ||
| - Geoip | ||
| name: Country Name | ||
| path: network.client.geoip.country.name | ||
| source: log | ||
| - groups: | ||
| - Geoip | ||
| name: Subdivision ISO Code | ||
| path: network.client.geoip.subdivision.iso_code | ||
| source: log | ||
| - groups: | ||
| - Geoip | ||
| name: Subdivision Name | ||
| path: network.client.geoip.subdivision.name | ||
| source: log | ||
| - groups: | ||
| - Web Access | ||
| name: Client IP | ||
| path: network.client.ip | ||
| source: log | ||
| - groups: | ||
| - User | ||
| name: User Email | ||
| path: usr.email | ||
| source: log | ||
| - groups: | ||
| - User | ||
| name: User ID | ||
| path: usr.id | ||
| source: log | ||
| pipeline: | ||
| type: pipeline | ||
| name: HubSpot Content Hub | ||
| enabled: true | ||
| filter: | ||
| query: "source:hubspot-content-hub" | ||
| processors: | ||
| - type: pipeline | ||
| name: Audit Logs | ||
| enabled: true | ||
| filter: | ||
| query: "service:audit" | ||
| processors: | ||
| - type: date-remapper | ||
| name: Define `occurredAt` as the official date of the log | ||
| enabled: true | ||
| sources: | ||
| - occurredAt | ||
| - type: attribute-remapper | ||
| name: Map `actingUser.userId` to `usr.id` | ||
| enabled: true | ||
| sources: | ||
| - actingUser.userId | ||
| sourceType: attribute | ||
| target: usr.id | ||
| targetType: attribute | ||
| preserveSource: false | ||
| overrideOnConflict: false | ||
| - type: attribute-remapper | ||
| name: Map `actingUser.userEmail` to `usr.email` | ||
| enabled: true | ||
| sources: | ||
| - actingUser.userEmail | ||
| sourceType: attribute | ||
| target: usr.email | ||
| targetType: attribute | ||
| preserveSource: false | ||
| overrideOnConflict: false | ||
| - type: pipeline | ||
| name: Login Logs | ||
| enabled: true | ||
| filter: | ||
| query: "service:login" | ||
| processors: | ||
| - type: date-remapper | ||
| name: Define `loginAt` as the official date of the log | ||
| enabled: true | ||
| sources: | ||
| - loginAt | ||
| - type: attribute-remapper | ||
| name: Map `userId` to `usr.id` | ||
| enabled: true | ||
| sources: | ||
| - userId | ||
| sourceType: attribute | ||
| target: usr.id | ||
| targetType: attribute | ||
| preserveSource: false | ||
| overrideOnConflict: false | ||
| - type: attribute-remapper | ||
| name: Map `email` to `usr.email` | ||
| enabled: true | ||
| sources: | ||
| sourceType: attribute | ||
| target: usr.email | ||
| targetType: attribute | ||
| preserveSource: false | ||
| overrideOnConflict: false | ||
| - type: attribute-remapper | ||
| name: Map `userAgent` to `http.useragent` | ||
| enabled: true | ||
| sources: | ||
| - userAgent | ||
| sourceType: attribute | ||
| target: http.useragent | ||
| targetType: attribute | ||
| preserveSource: false | ||
| overrideOnConflict: false | ||
| - type: attribute-remapper | ||
| name: Map `ipAddress` to `network.client.ip` | ||
| enabled: true | ||
| sources: | ||
| - ipAddress | ||
| sourceType: attribute | ||
| target: network.client.ip | ||
| targetType: attribute | ||
| preserveSource: false | ||
| overrideOnConflict: false | ||
| - type: user-agent-parser | ||
| name: Extract details from `http.useragent` | ||
| enabled: true | ||
| sources: | ||
| - http.useragent | ||
| target: http.useragent_details | ||
| encoded: false | ||
| combineVersionDetails: false | ||
| - type: pipeline | ||
| name: Security Logs | ||
| enabled: true | ||
| filter: | ||
| query: "service:security" | ||
| processors: | ||
| - type: date-remapper | ||
| name: Define `createdAt` as the official date of the log | ||
| enabled: true | ||
| sources: | ||
| - createdAt | ||
| - type: attribute-remapper | ||
| name: Map `userId` to `usr.id` | ||
| enabled: true | ||
| sources: | ||
| - userId | ||
| sourceType: attribute | ||
| target: usr.id | ||
| targetType: attribute | ||
| preserveSource: false | ||
| overrideOnConflict: false | ||
| - type: attribute-remapper | ||
| name: Map `actingUser` to `usr.email` | ||
| enabled: true | ||
| sources: | ||
| - actingUser | ||
| sourceType: attribute | ||
| target: usr.email | ||
| targetType: attribute | ||
| preserveSource: false | ||
| overrideOnConflict: false | ||
| - type: attribute-remapper | ||
| name: Map `ipAddress` to `network.client.ip` | ||
| enabled: true | ||
| sources: | ||
| - ipAddress | ||
| sourceType: attribute | ||
| target: network.client.ip | ||
| targetType: attribute | ||
| preserveSource: false | ||
| overrideOnConflict: false | ||
| - type: geo-ip-parser | ||
| name: GeoIP Parser for `network.client.ip` (ipAddress) | ||
| enabled: true | ||
| sources: | ||
| - network.client.ip | ||
| target: network.client.geoip | ||
| ip_processing_behavior: do-nothing |
Oops, something went wrong.