Headline

Data & AI Platforms | AI Solutions Architect | Snowflake | Enterprise AI | Engineering Leadership | Editor @ Data Engineer Things

About

With over 16 years of extensive experience in data engineering, analytics, and machine learning, I specialize in designing and deploying scalable data platforms and architectures. My career has been defined by a consistent pursuit of excellence in building robust, high-volume data systems across diverse industry domains. I bring a deep understanding of cloud environments, data integration strategies, and machine learning operationalization. In my current role as Principal Data Engineering and AI & ML OPS at Beckman Coulter, I lead data strategy and platform development initiatives, overseeing cross-functional teams to deliver cutting-edge data solutions. I am responsible for shaping the product roadmap and data architecture in a hybrid cloud setup, while managing the end-to-end lifecycle of data and ML products. Previously, I played a pivotal role in transforming Chegg Inc.’s data infrastructure, spearheading the migration to AWS and modernizing ETL processes for real-time analytics. My tenure at Cognizant and Wipro included architecting large-scale data marts and leading cloud migration initiatives in collaboration with Fortune 500 clients like Nike and Apple. Beyond technical expertise, I am passionate about mentoring, community engagement, and continuous learning. I have delivered public presentations, authored technical publications, and contributed to AWS community initiatives. Please feel free to connect with me at srivignesh.kn@gmail.com.

Location

Coimbatore

AI stack

anthropic apis

cursor

github copilot

notion

opencode

claudecode

Work experience

Data Engineering & AI Leader at Beckman Coulter Diagnostics, Jan 2021 - Present · 5 yrs 8 mos, Responsible for data platform architecture, operationalizing ML models, and building scalable ETL pipelines across hybrid cloud environments. Oversees CI/CD for data workflows, manages AWS and Azure cloud accounts, and leads cross-functional engineering teams. Drives product strategy, stakeholder collaboration, and architectural decisions for enterprise analytics and AI solutions.

Data Architect at Chegg Inc., Oct 2018 - Oct 2020 · 2 yrs 1 mo, On-site

Data Engineer at Chegg Inc., Oct 2016 - Oct 2018 · 2 yrs 1 mo, Santa Clara, AWS Enthusiast Building Real time / event streaming pipelines using AWS technologies - Kinesis, Kinesis Firehose, Kinesis Analytics and API Gateway into Redshift and Elastic Search. Instrument click stream and search stream data and funnel it to event lake in s3. Building data lake in S3 and registering data in data catalog. Building event lake for real time streaming events. Building data pipelines on Micro services architectures using AWS Lambda. Building Node.js based Json validator using open source ajv framework. Building docker based pipelines and containerizing using Fargate. Building AWS Fargate repositories and deploying ECS containers in AWS fargate. Developing self service based etl architecture. Docker based pipeline validation for pre-prod executions. Developing Data pipelines using AWS Glue / pyspark / AWS Lake formation. Orchestrating data pipelines on a DAG based model. Notebook based spark/Scala scripts using zeppelin/ data bricks. Managing EC2 instances and EMR clusters. Configuring Zabbix rules to monitor the EC2 clusters. Administering & Maintaining Talend jobs and its execution servers. Effective usage of services include S3, IAM, ec2, emr, athena, api gateway, kinesis firehose, kinesis analytics , kinesis streams, glue etl, glue crawler, lambda, sns, sqs, ses, cloud watch, MySQL, Postgres, rds, redshift, aws cli, aws data pipeline, aws glue, python, domo.

Technical Lead at Nike, Nov 2015 - Oct 2016 · 1 yr

Business Intelligence Consultant at Apple Inc at Wipro Limited, Feb 2014 - Oct 2015 · 1 yr 9 mos, San Francisco Bay Area, ● Working as Techno Functional Lead for Apple Inc, California ● Interact with business users and business analysts to get the functional requirements and provide end user support. ● Analyze BRDs and work out solutions to business problems. ● Handling huge volumes, Terabytes and Petabytes of data. ● Working in Onsite-Offshore Model. ● Data Profiling ● Co-ordinating with service teams for IT, UAT and Production cut over. ● Designing solutions for building teradata aggregate tables and views.

Senior Software Engineer at Apple Inc. at Wipro Limited, Nov 2012 - Dec 2013 · 1 yr 2 mos

Software Engineer at Apple Inc. at Wipro Limited, Nov 2008 - Nov 2015 · 7 yrs 1 mo, Greater Chennai Area, Technical Responsibilities : ● Building new data marts. Inducting data into Data warehouse. ● Developing Informatica Mappings using various transformations and loading data into warehouse. ● Develop teradata Bteq scripts ans stored procedures. ● Load data into staging and core layer using teradata utilities like Tpump, Multi Load, Fastload and TPT scripts. ● Export data from the data warehouse to external system using Fast Export and TPT scripts. ● Develop stored procedures in teradata , Build aggregate tables and views to support Business Objects performance. ● Performance tuning of high CPU consumption queries in teradata. ● Generate Webi Reports using Business Objects and Corda Dashboards. ● Create Unix shell scripts to connect to Teradata database and perform business validations. ● Production support for the existing data mart applications and addressing adhoc requests. Project Responsibilities : ● Responding to project RFPs. ● Delegating work to sub-ordinates and consolidating the work. ● Prepare LOEs and Project estimates. ● Prepare Weekly Status Reports and update client. ● Conduct technical training sessions to train the new team members. ● Mentor subordinates and delegate tasks.

Education

Professional Certificate Programme, Data Science and Artificial Intelligence for Managers, Data science and Artificial Intelligence AI, Indian Institute of Management, Kozhikode

Master of Science (MS), Computer Science, Birla Institute of Technology and Science, Pilani