Description
Big Data Lead Candidates Specification – Education Qualification – 10+2+3/4 Years of regular education Job Description – Should have done at least 2 large big data projects. Should have worked in 1 large big data project on AWS done at scale. Expert in AWS Big data solution leveraging Python , PySpark, Spark, Expert in Snowflake. Good experience in Airflow for job orchestration. Writing scalable and efficient Batch data pipelines using AWS EMR stack Real-time data pipelines: Solid development experience building solutions leveraging serverless architecture ( kinesis, lambda, and other AWS server less components) Good to have experience in building and implementing Micro services Prior experience productionizing data science / ML pipelines Hands on Big data engineer with ability to lead tech solutions , direct teams , develop and recommend architecture patterns
Source link