Empowering businesses with cloud solutions and automation π | AWS DevOps Professional | 13+ years of IT expertise
Hi, Iβm Swapnil Yavalkar, an AWS Cloud Professional with over 5 years of experience in AWS & DevOps and 13+ years of IT expertise. I specialize in building scalable, resilient infrastructure and automating processes for maximum efficiency, helping businesses reduce costs and improve workflows. With a background in Tableau & SAP BO administration, I have managed complex environments and led numerous successful cloud projects.
π» Cloud & DevOps Engineer | π§ Automation Expert | π BI Specialist
Iβm passionate about cloud computing, automation, and DevOps, and I've worked with multiple organizations to optimize their cloud infrastructure, reduce operational costs, and streamline deployments through CI/CD pipelines. My experience in Business Intelligence also includes implementing large-scale solutions using Tableau and SAP BO.
π AWS Certified Solutions Architect - Professional
π SCJP (Sun Certified Java Programmer)
π CCNA (Cisco Certified Network Associate)
Languages | Cloud Platforms | DevOps Tools | Automation & Monitoring |
---|---|---|---|
Here are some key projects Iβve worked on, showcasing my experience in AWS and DevOps:
-
Cloud Infrastructure Optimization for E-commerce Platform
Optimized AWS infrastructure for a global e-commerce company, reducing costs by 30% through EC2 Spot Instances and Reserved Instances (RIs), while automating the environment with CloudFormation templates.
Technologies: AWS (EC2, RDS, S3, CloudFormation), Jenkins, Docker. -
CI/CD Pipeline Implementation for an Online Payment Firm
Designed and implemented a CI/CD pipeline using Jenkins for a payment processing company, reducing deployment times by 50% and improving software delivery efficiency.
Technologies: Jenkins, Docker, Kubernetes, AWS ECS. -
Highly Available Tableau Deployment for a Fortune 500 Company
Deployed a highly available multi-node Tableau environment on AWS with RDS for database storage, S3 for backups, and CloudWatch for monitoring. Ensured continuous uptime with Auto Scaling and Elastic Load Balancing.
Technologies: AWS (EC2, RDS, S3, CloudWatch), Tableau, Auto Scaling. -
Serverless API for Retail Analytics
Developed and deployed a serverless API for a retail company using AWS Lambda, API Gateway, and DynamoDB to handle real-time analytics data processing.
Technologies: AWS Lambda, API Gateway, DynamoDB, S3. -
Data Lake Implementation for a Media Streaming Service
Implemented a data lake architecture using S3 and AWS Glue for a media streaming service to centralize and process streaming analytics data.
Technologies: AWS S3, AWS Glue, Athena.
Hereβs what my clients have to say about my work:
-
Surajit Bhowmick - AWS Cloud Specialist:
"Swapnil's expertise in AWS, DevOps, BO, and Tableau is commendable. He is dedicated and always goes the extra mile, helping our team deliver efficient solutions." -
Subhash A Kotian - Product Support Head at LearningMate:
"Swapnil manages pressure with ease and communicates challenges effectively. His work ethic and dedication make him a great team player." -
Sanket Shah - Project Manager:
"Swapnil is an excellent asset with commendable knowledge in BI and DevOps. His constant learning attitude and dedication make him stand out." -
Sandesh Kortikar - Senior Delivery Manager: "Since I know Swapnil, I always found him to be very dedicated, self motivated and go getter fella. He is very sincere in his work and keeps on Innovating some or the other thing to ease out everyone's life in team. Technically very good and he us quite fast learner. I wish him all the best in his future endeavors."
-
π£οΈ You can find testimonials on my LinkedIn profile.
Here are some of my community projects and open-source repositories:
Repository | Description |
---|---|
AWS DevOps Real-World Projects | Experience hands-on, industry-inspired AWS & DevOps projects, crafted to teach and empower teammates and students alike based on my work experience. This repository showcases practical, real-world scenarios for designing, automating, and managing cloud infrastructure on AWS. Each project incorporates a variety of AWS services, CI/CD practices, containerization, and infrastructure as code, offering a comprehensive guide to building scalable, resilient, and secure cloud solutions. Ideal for anyone looking to deepen their skills in AWS and DevOps. |
Each project folder is organized into AWS Infrastructure Projects and DevOps Projects categories, with subcategories based on difficulty levels: Easy, Medium, Hard, and Complex. Each project folder contains a detailed README.md file with step-by-step instructions to keep everything simple and easy to follow.
π¦ aws-devops-realworld-projects
β£ π aws-infrastructure-projects
β β£ π easy
β β β£ π 01-cloudfront-s3-static-websites
β β β£ π 02-s3-crossregion-replication
β β β£ π 03-security-best-practices-iam
β β β£ π 04-ec2-autoscaling-loadbalancer
β β β£ π 05-monitoring-ecs-prometheus-grafana
β β β π 06-infrastructure-as-code-cloudformation
β β£ π medium
β β β£ π 01-multiregion-failover-route53
β β β£ π 02-loadbalancing-alb-nlb
β β β£ π 03-automated-backups-aws-backup
β β β£ π 04-secure-configurations-secretsmanager
β β β£ π 05-lambdaatedge-content-delivery
β β β£ π 06-data-lake-s3-athena-glue
β β β£ π 07-s3-event-driven-architecture-with-sns-lambda-sqs
β β β π 08-serverless-lambda-api-gateway-dynamodb
β β£ π hard
β β β£ π 01-api-security-waf
β β β£ π 02-vpc-peering-transitive-routing
β β β£ π 03-data-migration-dms
β β β£ π 04-stepfunctions-orchestration
β β β£ π 05-amazon-aurora-highavailability
β β β π 06-graphql-api-appsync
β β£ π complex
β β β£ π 01-multiregion-activeactive-rds
β β β£ π 02-data-lakehouse-redshift-s3
β β β£ π 03-data-governance-lakeformation
β β β£ π 04-hybrid-cloud-aws-outposts-s3
β β β£ π 05-edge-computing-greengrass
β β β£ π 06-security-compliance-macie-guardduty
β β β£ π 07-codeartifact-codepipeline
β β β£ π 08-serverless-container-fargate
β β β£ π 09-rds-proxy-aurora-optimization
β β β π 10-serverless-container-lambda
β π devops-projects
β β£ π easy
β β β£ π 01-ci-cd-jenkins-docker
β β β£ π 02-ci-cd-jenkins-ec2
β β β£ π 03-kubernetes-cluster-kops
β β β£ π 04-kubernetes-cluster-terraform
β β β£ π 05-automated-deployment-codebuild
β β β π 06-ci-cd-jenkins-github-elastic-beanstalk
β β£ π medium
β β β£ π 01-automated-deployment-codedeploy
β β β£ π 02-containerized-microservices-ecs
β β β£ π 03-stepfunctions-orchestration
β β β£ π 04-realtime-dataanalytics-kinesis-lambda
β β β£ π 05-containerized-microservices-eks
β β β π 06-automated-microservices-deployment-ecs-cicd
β β£ π hard
β β β£ π 01-deploying-microservices-ecs
β β β£ π 02-music-streaming-service-aws
β β β£ π 03-video-streaming-service-aws
β β β£ π 04-serverless-webapp-aws-amplify
β β β£ π 05-scalable-node.js-app-deployment-elastic-beanstalk
β β β π 06-enterprise-application-deployment-kubernetes-terraform-ansible-gitlab
β β£ π complex
β β β£ π 01-ecs-bluegreen-deployment
β β β£ π 02-music-streaming-portal-amazonmusic
β β β£ π 03-video-streaming-netflix
β β β£ π 04-image-processing-sagemaker
β β β£ π 05-advanced-cicd-pipeline-codepipeline
β β β£ π 06-sagemaker-ml-pipeline
β β β£ π 07-realtime-video-processing-kinesis-s3
β β β π 08-full-stack-cicd-pipeline-jenkins-aws-codedeploy-nginx
Repository | Description |
---|---|
AWS Features Explorer App | A dynamic platform to explore AWS services such as API interactions, file uploads, and monitoring, all managed via a user-friendly UI. |
AWS Lambda Contact Form | A serverless web application that handles contact form submissions using AWS Lambda, API Gateway, and SNS, containerized with Docker and deployed on ECS. |
DynamicWeb NodeApp | A Node.js web application serving both static and dynamic content, including a sample API for dynamic data handling. |
Task Management App | A web application built to manage and track weekly tasks and activities, providing features to organize, prioritize, and monitor task progress. |
Streamlit Time Series Forecasting App | A customized time-series forecasting app built with Streamlit, enabling interactive visualizations of forecasted data. |
Rebranded Streamlit Forecasting App | An enhanced forecasting application developed with Streamlit, designed to offer time-series forecasting with an interactive and branded user interface. |
Streamlit Time Series Forecasting App | A customized time-series forecasting app built with Streamlit, enabling interactive visualizations of forecasted data. |
Repository | Description |
---|---|
Tableau Metadata Extractor | A Python tool that extracts metadata from Tableau Server, aiding in data lineage, compliance, and reporting. |
Tableau Server Backup | A Python script that automates Tableau Server backups, ensuring data integrity through systematic creation, management, and storage of backups. |
Tableau Subscriptions Removal | A Python script to automate the removal of Tableau Server subscriptions for unlicensed users, including logging and sending email notifications. |
Tableau Sync Users | A Python script to synchronize Tableau Server users with external data sources, ensuring updated and accurate user access. |
Tableau Change Bulk User Roles | A Python script that automates updating bulk user roles on Tableau Server based on a CSV file. It logs the changes and exports a detailed report in Excel. |
Tableau Update Datasource Script | A Python script to automate the process of updating specific data connections in Tableau Server by fetching data from PostgreSQL and updating Tableau Server accordingly. |
Tableau Prometheus Exporter | Custom exporters designed to enable Tableau monitoring through Prometheus. |
Tableau Delete Subscriptions | Automates the cleanup of subscriptions on Tableau Server by removing subscriptions based on predefined criteria and deleting old log files. |
Tableau Others | Automates the cleanup of subscriptions on Tableau Server by removing subscriptions based on predefined criteria and deleting old log files. |
Repository | Description |
---|---|
SAP BO SQL Queries Extractor | A tool that extracts SQL queries from Web Intelligence reports in SAP BO, aiding in analysis and compliance. |
UserDetailsBI41 | A collection of automated tools for SAP BO Administrators to assist in daily, weekly, and quarterly maintenance tasks for SAP BI4.1 servers. |
SAP BO Folder Report Structure | A Java utility to extract report details from specific SAP BusinessObjects (BOBJ) folders and export them to Excel for administrative purposes. |
SAP BO Universe Reports Extractor | A Java utility to extract and list reports associated with a specific universe in SAP BusinessObjects, saving the details in an Excel file. |
Password Reset | An automated web application designed to reset user passwords on SAP BI4.1 servers, making the process easier and more secure. |
Repository | Description |
---|---|
Disk Space Monitoring | A PowerShell script to monitor disk space on remote servers, sending email alerts when space is low. It also deletes large or outdated log files to free up space. |
SSL Cert Monitoring | A PowerShell script to monitor SSL certificate expiration dates and send email alerts if certificates are nearing expiration. |
Grafana | A repository for creating customized dashboards with Grafana, enabling system metrics and performance monitoring through visualized data. |
Prometheus | A collection of customized exporters built to extend Prometheus's monitoring capabilities for different infrastructure components. |
Check out my Docker images on Docker Hub:
Swapnil Yavalkar's Docker Hub
π¬ Iβm always open to connecting with fellow professionals and collaborating on exciting AWS, DevOps, or automation projects! Reach out to me via LinkedIn or check out my open-source projects on GitHub. Letβs discuss how I can help you automate cloud processes or streamline your DevOps pipelines.
Here's a simple Python script I created to automate Tableau Subscriptions Removal:
import pandas as pd
import tableauserverclient as TSC
import logging
import time
import os
import datetime
# Define the log directory path where the files are located
directory_path = "logs/"
# Define the threshold time to delete files that are older than 10 days
threshold_time = datetime.datetime.now() - datetime.timedelta(days=10)
""" SPECIFY TABLEAU SERVER LOGIN DETAILS BELOW """
server_url = ''
sites = ''
username = ''
password = ''
LOG_FILE_GEN_TIME = time.strftime("%Y%m%d-%H%M%S")
logging.basicConfig(
level=logging.DEBUG,
format='%(asctime)s, %(levelname)-8s [%(filename)s:%(module)s:%(funcName)s:%(name)s:%(lineno)d] %(message)s',
datefmt='%Y-%m-%d:%H:%M:%S',
filename='logs/SubscriptionsRemoval{0}.log'.format(LOG_FILE_GEN_TIME),
filemode='a'
)
logger = logging.getLogger(__name__)
def delete_logs():
global directory_path
# Loop through all files in the logs directory
try:
for file_name in os.listdir(directory_path):
# Get the creation time of the file
file_path = os.path.join(directory_path, file_name)
creation_time = datetime.datetime.fromtimestamp(os.path.getctime(file_path))
# Check if the file is older than the threshold time
if creation_time < threshold_time:
# Delete the file if it's older than the threshold time
os.remove(file_path)
print(f"Log Deleted file: {file_name}")
logger.info(f"Log file older than 10 days deleted file: {file_name}")
except Exception as e:
logging.error(f"Error while deleting log files: {str(e)}")