Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add CDK support to Axiom cloudwatch template #68

Open
wants to merge 9 commits into
base: main
Choose a base branch
from

Conversation

zscgeek
Copy link

@zscgeek zscgeek commented Jul 14, 2024

Add CloudWatch Lambda constructs for Axiom ingestion, backfilling, and subscription

  • Updated .gitignore to include common ignores such as *.swp, package-lock.json, pycache, .pytest_cache, .venv, *.egg-info, .cdk.staging, and cdk.out.
  • Created Axiom.py to define three CDK constructs:
    • CloudWatchIngester: Manages the ingestion of CloudWatch logs to Axiom with parameters for axiom_token, axiom_url, axiom_dataset, cloudwatch_log_group_names, data_tags, and disable_json.
    • CloudWatchBackfiller: Handles backfilling of CloudWatch logs with parameters for axiom_cloudwatch_lambda_ingester_arn and cloudwatch_log_groups_prefix.
    • CloudWatchSubscriber: Automatically subscribes new CloudWatch log groups to Axiom with parameters for axiom_cloudwatch_lambda_ingester_arn, cloudwatch_log_groups_prefix, and enable_cloudtrail.
  • Added app.py to initialize the CDK app and deploy the AxiomStack with environment variables and parameters.
  • Updated backfill.py to replace cfnresponse with custom send_response function for handling CloudFormation responses.
  • Created cdk.json with CDK app configurations and context settings.
  • Added requirements.txt to specify required dependencies for the CDK app.

@dasfmi
Copy link
Collaborator

dasfmi commented Jul 19, 2024

hi @zscgeek, thanks for your contribution!

I am currently working on restructuring the Ingester and the components around it in #69 . I would wait with this one until we reach a good design/setup. I promise to take a look after #69 has landed, cheers!

@dasfmi
Copy link
Collaborator

dasfmi commented Jul 30, 2024

do you mind if I push changes to your PR to make it match the new changes we made? It might need some work.

@zscgeek
Copy link
Author

zscgeek commented Nov 12, 2024

Hi @dasfmi - sorry for super late reply. I just saw your question. It does indeed look like it might be a pretty major change to align with you latest stuff. I will give it some eyes since we need to update the stack as well and will see if i can align better with your latest stuff if you have not already gotten native CDK support in.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants