Job Description :
Job Description: Skill: Hadoop developer
Location: Hyderabad
Exp: 5 to 8 yrs
Notice Period: max 20 days
Job description:
Should have hands on in Hadoop/Hive/HBase and SQL technologies.
· Should have knowledge on Apache Spark and Map reduce.
· Defining Hadoop Job Flows.
· Build distributed, reliable and scalable data pipelines to ingest and process data in real-time. Hadoop developer deals with fetching impression streams, transaction behaviours, clickstream data and other unstructured data.
· Managing Hadoop jobs using scheduler.
· Reviewing and managing hadoop log files.
· Design and implement column family schemas of Hive and HBase within HDFS.
· Assign schemas and create Hive tables.
· Managing and deploying HBase clusters.
· Develop efficient pig and hive scripts with joins on datasets using various techniques.
· Assess the quality of datasets for a hadoop data lake.
· Apply different HDFS formats and structure like Parquet, Avro, etc. to speed up analytics.
· Build new hadoop clusters
Key Skills: Skill: Hadoop developer
Location: Hyderabad
Exp: 5 to 8 yrs
Notice Period: max 20 days
Job description:
Should have hands on in Hadoop/Hive/HBase and SQL technologies.
· Should have knowledge on Apache Spark and Map reduce.
· Defining Hadoop Job Flows.
· Build distributed, reliable and scalable data pipelines to ingest and process data in real-time. Hadoop developer deals with fetching impression streams, transaction behaviours, clickstream data and other unstructured data.
· Managing Hadoop jobs using scheduler.
· Reviewing and managing hadoop log files.
· Design and implement column family schemas of Hive and HBase within HDFS.
· Assign schemas and create Hive tables.
· Managing and deploying HBase clusters.
· Develop efficient pig and hive scripts with joins on datasets using various techniques.
· Assess the quality of datasets for a hadoop data lake.
· Apply different HDFS formats and structure like Parquet, Avro, etc. to speed up analytics.
· Build new hadoop clusters
Source link
