Data Engineer
Job Description
Summary: Research, develop, design and implement new or modified software products or ongoing business projects. Typically sitting within the IT team of a business, the Software Developer will be involved in liaising with the Business Analysts and Development Managers to ensure software projects meet requirements.
Responsibilities:
- Participate in requirements definition, analysis and the design of logical and physical data models for SAP and non SAP Data marts
- Leading data discovery discussions with Business in JAD sessions and map the business requirements to logical and physical data modelling solutions.
- Conduct data model reviews with project team members
- Gather technical metadata through data modelling tools
- Ensure database designs efficiently support BI and end user requirements
- Drive continual improvement and enhancement of existing systems.
- Collaborate with ETL/Data Engineering teams to create data process pipelines for data ingestion and transformation.
- Collaborate with Data Architects for data model management, documentation, and version control.
- Maintain expertise and proficiency in the various application areas
- Maintain current knowledge of industry trends and standards
Required skills:
- Strong experience in building SAP and non SAP Data Analytics solutions
- Proficient in Data modelling, data analysis and data profiling
- Strong Conceptual, Logical and Physical data modelling for Cloud Data warehouse
- Hands on experience working with any of the following data platforms like Redshift, Databricks, Big query, Synapse & snowflake.
- Exposure to tools like Databricks Spark, Delta Technologies, Informatica ETL or other industry leading tools
- Good experience with AWS Redshift, Athena, Glue.
- Solid Expertise on AWS Cloud technologies, mainly on the services of VPC, EC2, S3, DMS and Glue.
- Excellent verbal and written communication skill including the ability to describe complex technical concepts in relatable terms.
- Ability to lead and prioritize multiple workstreams and confidence in making decisions about how to prioritize work efforts.
- Data-driven mentality. Self-motivated, responsible, diligent, and detail oriented
- Effective oral and written communication skills
- Ability to learn and maintain knowledge of multiple application areas.
- Ability to work independently and in conjunction with a team.
- Understanding of industry standard methodologies pertaining to Quality Assurance concepts and procedures.
Qualifications
Education/Experience Level:
- Bachelor’s degree in computer science, Engineering, or relevant fields with 10+ years of experience as a Data and Solution Architect supporting Enterprise Data and Integration Applications or similar role for large scale enterprise solutions.
- 8+ years of experience with Data Modeling in finance, commercial, supply chains, procurement, Customer analytics
- 3+ years of experience in Data Transformation/ETL tools and technologies, and related concepts such as data catalog
- 5+ years of experience in Big Data Infrastructure and tuning experience in Lakehouse Data Ecosystem including Data Lake, Data Warehouses, and Graph DB
- AWS Solutions Architect Professional Level certifications
- Extensive experience in data analysis on critical enterprise systems like SAP, SFDC etc