Data Engineer- Job Summary
As a data engineer, you’ll be handling the design and development of scalable data management systems, ensuring that all data systems meet company requirements.
You should also know the ins and outs of the industry such as data mining practices, algorithms, and how data can be used. Overall, you’ll strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you should have strong analytical skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming language and platforms.
Data Engineer Principal Duties & Responsibilities :
-Design, construct, install, test and maintain data management systems.
-Build high-performance data engineering algorithms, and prototypes.
-Ensure that all systems meet the business/company requirements as well as -industry practices.
-Integrate up-and-coming data management and software engineering technologies into existing and new data structures.
-Develop set processes for data mining, data modeling, and data lineage.
-Research new uses for existing data.
-Collaborate with members of your team (e.g., data architects, the IT team, data scientists) on the project’s goals.
-Install/update disaster recovery procedures.
-Recommend different ways to constantly improve data reliability and quality.
Data Engineer Education & Experience:
– Bachelor’s degree in Engineering or computer science (preferred), specialized training, certification, and at least 6 year experience in data engineering.
– Requires experience and deep understanding of data engineer and multiple programming languages.
Data Engineer Job Knowledge & Skills
– Technical expertise with data modelling, data mining, data governance and segmentation techniques
– Knowledge of programming languages (e.g. Python, Shell scripting)
– Hands-on experience with SQL database design
– Data Warehousing/Data Governance/Data Modelling
– Data cataloguing
– RDBMS – Oracle/MS SQL/Teradata
– Data integration through ETL tools Talend, Informatica etc.
– Hands on experience on Snowflake (SaaS cloud data warehousing) – Desirable
Desired Attributes in Candidate Profile
– Should be an effective communicator and team/task manager
– Soft skills in terms of training, leadership and understanding of teams problems Sense of ownership is a must to drive and work with a sense of urgency
Source link
