SR TECH ARCH BIG DATA
Location : Bangalore
Job Description:
‘Data Architect with overall 15 years of experience Experience with Big Data Technologies such as Hadoop, HDFS, Hive, S3 and the related Ecosystem Expert in SQL Programming. Experience in Python & Pyspark Programming Good understanding of ETL Data warehousing concepts Knowledge in NoSQL Databases & Unix Shell Scripting Responsibilities Analyze and organize raw data Build data systems and pipelines Evaluate business needs and objectives Interpret trends and patterns Conduct complex data analysis and report on results Prepare data for prescriptive and predictive modeling Build algorithms and prototypes Combine raw information from different sources Explore ways to enhance data quality and reliability Identify opportunities for data acquisition Develop analytical tools and programs Collaborate with data scientists and architects on several projects Previous experience as a data engineer or in a similar role Technical expertise with data models, data mining, and segmentation techniques Knowledge of programming languages (e.g. Java and Python) Hands-on experience with SQL database design Great numerical and analytical skills Degree in Computer Science, IT, or similar field; a Master’s is a plus Data engineering certification (e.g IBM Certified Data Engineer) is a plus
Job Requirements: PYSPARK, PYTHON, Dataiku, DATA ARCHITECTURE, DATA SOLUTIONING, BIG DATA ARCHITECTURE DOCUMENT, DATA PROCESSING DESIGN, ETL DESIGN
Source link
