Hadoop Developer will be responsible to implement and maintain solutions in the Cloudera HDFS cluster. You will be responsible for coordinating data requests from the various teams, reviewing and approving efficient approaches to ingesting, extracting, transferring, and maintaining data. In addition, you’ll work with team members to mentor other developers to grow their knowledge and expertise. You’ll be working in a fast-paced and high-volume processing environment, where quality and attention to detail are vital. 
 
PRIMARY RESPONSIBILITIES 
•    Design and develop Cloudera HDFS-based solutions using Hive, Spark, PySpark, Talend, Pig, Flume, Kafka 
•    Programming using Hive QL to generate reports 
•    Developing data pipelines using Spark Java 
•    Writing Scoop Jobs to Import/Export data from Hadoop 
•    Programming using Shell script/Python to create automation scripts 
•    Programming using Java and Map Reduce framework 
•    Programming using SQL and SQL/RDBMS utilities 
•    Work closely with Technology Leadership, Product Managers, and Reporting Team for understanding the functional and system requirements 
•    Work closely with our QA Team to ensure data integrity and overall system quality