Data Engineer (GCH)

Data Engineer position responsible for designing and implementing scalable processes for ingesting and transforming complex datasets, and supporting data governance and stewardship.

Requirements

• Designs, develops, constructs, maintains and supports data pipelines for ETL from a multitude of sources.
• Creates blueprints for data management systems to centralize, protect, and maintain data sources.
• Ingest large, complex data sets that meet functional and non-functional requirements.
• Enable the business to solve the problem of working with large volumes of data in diverse formats, and in doing so, enable innovative solutions.
• Design and build bulk and delta data lift patterns for optimal extraction, transformation, and loading of data.
• Supports the organisation’s cloud strategy and aligns to the data architecture and governance including the implementation of these data governance practices.
• Engineer data in the appropriate formats for downstream customers, risk and product analytics or enterprise applications.
• Assist in identifying, designing and implementing robust process improvement activities to drive efficiency and automation for greater scalability.
• Provide support in the operational environment with all relevant support teams for data services.
• Provide input into the management of demand across the various data streams and use cases.
• Create and maintain functional requirements and system specifications in support of data architecture and detailed design specifications for current and future designs.
• Support test and deployment of new services and features.
• Provides technical leadership to junior data engineers in the team.

Tagged as: Data Analysis, SQL