· Participate in architectural discussions and design exercises to create large scale solutions built on AWS and also be part of the development lifecycle.
· Identity workarounds for specific issues and corner scenarios observed during migration
· Automate solutions for repeatable problems
· Work closely with application teams to ensure business functionality and SLAs are met
· Consult for optimal design of database environments, analyzing complex distributed production deployments, and making recommendations to optimize performance
· Develop innovative solutions to complex business and technology problems
· Conduct technical sessions for internal teams, partners and customers
Implementation and tuning experience with various tools and frameworks in the Big Data Ecosystem such as Hadoop, Spark, Presto, Hive.
· Strong verbal and written communication skills, with the ability to work effectively across internal and external organizations.
· Programming skills in Java/Python/Perl/PowerShell.
· Strong hands-on experience in integrating multiple databases like Oracle, SQL Server, PostgreSQL, Teradata,SQL server etc.
· Familiarity with one or more SQL-on-Hadoop technology (Hive, Pig, Impala, Spark SQL, Presto).
· Ability to think strategically about business, product, and technical challenges in an enterprise environment. Leadership and innovation around Data Analytics.
· · Leading/Involved in highly-available and fault-tolerant enterprise and web-scale software applications.
· High end Troubleshooting and Communication skills.
· Understanding of Apache Spark/Hadoop and the Data Analytics ecosystem. Experience with one or more relevant tools (Sqoop, Flume, Kinesis, Kafka, Oozie, Hue, Zookeeper, Ranger, Elasticsearch, Avro).
· Familiarity with one or more SQL-on-Hadoop technology (Hive, Pig, Impala, Spark SQL, Presto).
Source link
