Irshad Patil
Hadoop Administrator | Bigdata Platform Reliability Engineer
Pune District
10+ years of work experience
Apr 20233 yrs 2 mosPresent
Pune District, Maharashtra, India
Cluster build to migrate the jobs from CDP 7.1.6 to CDP 7.1.9
Ranger policy migration from CDP 7.1.6 to CDP 7.1.9 cluster.
Monitoring and maintaining the cluster for smooth execution of jobs.
OS Patching of server's with ansible tower.
Automated the steps to perform pre-post validation for activity.
Performed DB switchover activity.
Commission and Decommission of the data nodes.
Supporting operation team during the job failure and finding the RCA.
Automated the user onboarding.
Automated repetitive tasks on 150+ hosts.
Manage and maintain the Cribl data pipelines from Kafka to S3, Elastic search.
New-relic agent configuration on the server for service failure alert.
Jan 20212 yrs 3 mosMar 2023
India
Maintaining, and monitoring HDFS, Yarn Zookeeper, Sqoop, Flume, Pig, Hue, Hive, Impala, HBase, Spark, Kerberos, Ranger in Cloudera.
Worked on CDP cluster and manage, maintain, monitor the cluster.
Using JIRA ticketing tool to solve user's issue.
Running a cron job to schedule jobs.
Setting HDFS quotas for the users as per requirements.
Providing access to user's, creating HDFS directories and hive Databases.
Creating Policies via Ranger to authorize the user's on HDFS directory.
Aug 20204 mosNov 2020
Hyderabad, Telangana, India
4.11 years of total experience in Configuring, Deploying, Maintaining, Securing, Troubleshooting, and Administrating a Hadoop Cluster on Enterprise Cloudera Distribution of Hadoop, Cloud Computing(PAAS) and Linux.
Sep 201911 mosJul 2020
Bangalore Urban, Karnataka, India
Jun 20154 yrsMay 2019
Pune District, Maharashtra, India
Involved in start to end process of providing access to the users on Hadoop Environment.
Responsible for Cluster maintenance, commissioning and decommissioning Data nodes,
Cluster Monitoring, Troubleshooting, Manage and review data backups, Manage & review Hadoop log files.
Restarting the CDH services whenever needed.
Work on JIRA tickets to resolve all types of issues with hadoop.
HDFS maintenance and adding and removing files from HDFS.
Providing access to Talend, Hue, Kafka access and Habilitating new users to Development, and Production Clusters.
Creation of Applicative users, Groups, Directories , Hive policies in Hadoop and providing access to them.
Updating Ranger policies and permissions.
Securing cluster with Kerberos and providing user access to Kerberos.
Continuous monitoring and managing the Hadoop cluster through Cloudera Manager and CLI.
Created user accounts and given users the access to the Hadoop cluster.
Managed and reviewed Hadoop Log files as a part of administration for troubleshooting purpose.
Use of Sqoop to import and export data from HDFS to RDBMS vice versa.
Backup and Restore Namenode & Cloudera Manager.
Assisted with performance tuning.
Resolved tickets submitted by users, troubleshoot the errors.
Configuring and maintaining YARN Schedulers (Fair and Capacity)
Education
Master of Computer Applications (M.C.A.), Information Technology
Savitribai Phule Pune University
20123 yrs2015
BCA, Computer Application
Savitribai Phule Pune University
20093 yrs2012
Join Irshad and 10k+ other professionals on
Tal is the app where bosses meet engineers & builders directly, without middlemen
Download Tal Boss