Skip to content

Created a HTTP client to send batch of logs over HTTP to Datadog #87

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 43 commits into from
May 20, 2019
Merged

Created a HTTP client to send batch of logs over HTTP to Datadog #87

Changes from all commits
Commits
Show all changes
43 commits
Select commit Hold shift + click to select a range
1ab5b9a
Created a HTTP client to send batch of logs over HTTP to Datadog
ajacquemot Feb 1, 2019
7a33670
Refactored metadata
ajacquemot Feb 1, 2019
c517667
Improved the readbility and the logic to retry
ajacquemot Feb 4, 2019
7177071
Refactored generate_metadata
ajacquemot Feb 4, 2019
a69beef
Make use of a session to improve network performances
ajacquemot Feb 4, 2019
cff52e8
Removed unecessary comments and fix a typo
ajacquemot Feb 6, 2019
e52cf44
Run black
ajacquemot Feb 7, 2019
6df5447
Extracted the retry logic from both client and refactor TCP client
ajacquemot Feb 19, 2019
4dda52d
Make sur metadata are taken into account
ajacquemot Feb 19, 2019
3c5657e
Make sure the TCP connection gets reset on exception
ajacquemot Feb 19, 2019
5ea8281
Added comments
ajacquemot Feb 19, 2019
322c2f3
Added back the scrubbing logic
ajacquemot Feb 19, 2019
d38e4ef
Added logic to switch to the right endpoint
ajacquemot Feb 19, 2019
a9027fb
Fixed npe on close for TCP client
ajacquemot Feb 19, 2019
288ccdb
Fixed issue with batch
ajacquemot Feb 19, 2019
fab9d36
Fixed frame for TCP Client
ajacquemot Feb 19, 2019
34ca135
Fixed socket init for TCP Client
ajacquemot Feb 19, 2019
73e745a
Isolated the scrub logic into a class
ajacquemot Feb 20, 2019
7945b8f
Improved how to reset the connection on exception
ajacquemot Feb 20, 2019
40cd819
Fix TCP connect
ajacquemot Feb 20, 2019
e04306a
Improved the logic for batching logs
ajacquemot Feb 20, 2019
becbc1f
Added comment, optimized batching logic string concat
ajacquemot Feb 21, 2019
a0727d7
Isolate ip regex
ajacquemot Feb 21, 2019
1916382
made underlying clients reusable with with statement
ajacquemot Feb 21, 2019
f3f5ca0
Optimized batcher
ajacquemot Feb 21, 2019
c67f058
Make use http usable from env var
ajacquemot Feb 21, 2019
65b728e
Added missing if to scrubber ctor
ajacquemot Feb 22, 2019
7f584fb
Make sure requests is imported
ajacquemot Feb 22, 2019
40ec294
Set ip regex to None if should not scrub
ajacquemot Feb 25, 2019
39c9764
Fixed issue when preparing client
ajacquemot Mar 4, 2019
8a8e5dd
Fixed issue with unproper casted value
ajacquemot Mar 8, 2019
f83f113
Merge logs and metadata upstream
ajacquemot Mar 12, 2019
825551a
Merge branch 'master' into ajacquemot/logs_client_http_switch
ajacquemot Apr 11, 2019
ac744b3
Made scrubbing rules easier to configure, to use
ajacquemot Apr 11, 2019
e0c7ce5
Added a timeout and sendall bytes to TCP client
ajacquemot Apr 11, 2019
93c5313
Fixed run time issue with scrubbing rules
ajacquemot Apr 11, 2019
2199af8
Removed timeout for tcp
ajacquemot Apr 11, 2019
ec0aa06
Fixed scrubbing ctor
ajacquemot Apr 11, 2019
892fe8b
Always retry and use a exponential backoff
ajacquemot May 15, 2019
7a2579e
Fixed comments and raise an exception when cannot build a scrubbing rule
ajacquemot May 15, 2019
9525928
Merge branch 'master' into ajacquemot/logs_client_http_switch
ajacquemot May 15, 2019
f96358f
Run linter
ajacquemot May 15, 2019
a08ca0a
Merge branch 'master' into ajacquemot/logs_client_http_switch
ajacquemot May 17, 2019
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading