Bhavani Rajaput

3+ years of work experience

Jun 20251 yr 5 mosPresent

Remote

Jun 20233 yrs 5 mosPresent

Hyderabad, Telangana, India

Deployed and managed Apache Airflow on Kubernetes using Helm charts by configuring webserver, scheduler, worker pods, executor settings, and Airflow metadata DB; implemented autoscaling, node affinity, persistent volumes, and secrets management for a highly available and scalable workflow orchestration platform. Designed, built, and optimized complex Airflow DAGs with robust retries, SLA monitoring, error handling, and dependency management, ensuring reliable workflow execution and reducing failure rates across distributed systems. Containerized Airflow components and required custom packages using Docker, ensuring consistent artifact delivery and environment parity across development, staging, and production clusters. Implemented Prometheus-based observability across Kubernetes clusters, Airflow services, and system components; configured alert rules, exporters, and metric scraping, and integrated dashboards for proactive monitoring and reduced operational downtime. Strengthened CI/CD pipelines by integrating security gate checks, secret management using Vault, role-based access policies, and automated vulnerability remediation, achieving compliance with organizational security standards. Developed a Python Flask application to fetch real-time Cassandra/Scylla cluster health metrics—repairs, compactions, disk utilization, and node status—automating maintenance tasks and improving cluster visibility. Automated ScyllaDB cluster operations using Ansible for node repairs, rolling restarts, schema updates, and backup workflows, improving operational efficiency and reducing manual intervention. Optimized ScyllaDB performance by tuning compaction strategies, cache settings, and cluster parameters, achieving a 30% improvement in query latency and automating storage upgrade workflows using Puppet for consistent deployments.