Job Information
Infoville, Inc Sr Programmer Analyst in Belle MEad, New Jersey
Managing multiple cloudera Hadoop cluster for PoC environment. Installation & Configuration of various Hadoop services for POC. Install and configure Kafka cluster to ingest the data. Managed & monitored kafka services. Troubleshooting Kafka & Zookeeper issues. Handling and running job on 5 PB of data. Doing POC on multiple applications like Arcadia, Trifacta, H2O, SAS, Solix etc. Implemented and integrated solix with Hadoop Implemented security like Kerberos, sentry, ACL, SSL/TLS. Worked on to add user through AD/LDAP and to integrate with groups and roles at unix level. Always worked with users on priority to troubleshoot/debugging the Hive, Impala, Spark issues. Working on capacity planning to enhance the capacity of the existing cluster. Giving production support of Hadoop ecosystem. Using Linux RHEL to handle Hadoop cluster and troubleshoot the issue. Worked on cloudera upgrade from 5.13 to 5.16. Expertise in upgrading CDH 5.16.2 to CDP 7.1.4 Private cloud. Planning, Pre-upgrade Upgrade,Post Validation Write multiple bash scripts to automate the work. Applied patches to mitigate the environmental issues.In lieu of Master , Bachelors degree with 5 yr of experience is acceptable. May be required to travel to unanticipated locations for projects.-->-->