Data Engineer

Shell is seeking a Data Engineer to join their team in London. The successful candidate will have experience in software engineering best practices, delivering software products, and adhering to enterprise technology principles. The role involves designing, building, and maintaining scalable ETL/ELT pipelines, developing batch and near-real-time pipelines, and building and maintaining Power BI datasets and dashboards. Shell offers a competitive salary, flexible working hours, and the possibility of remote/mobile working, paid parental leave, and a range of training and development programs.

Requirements

• Proven experience in adhering to software engineering best practices
• Delivering software products and applications that generate business value
• Continuous-improvement mindset, driving value-based process and product/application optimization
• Solution consultation and development in accordance with the enterprise technology principles
• Estimation, solution design, detailed technical design, application technical deliverables
• Contribution to functional excellence in terms of definition and maintenance of standards, methods, and tools
• Manage complex integration scenarios and interfaces between on-premises solutions, cloud, and legacy systems
• Design, build, and maintain scalable ETL/ELT pipelines in Azure Data Factory and Databricks
• Develop batch and near real-time pipelines in Python/SQL to process trades, prices, reference data, and operational feeds
• Build and maintain Power BI datasets and dashboards that are reliable, performant, and intuitive
• Good knowledge of Microsoft Azure services like Azure KeyVault, Azure Datalake Stoarage, Azure Key Vault, Azure SQL Database, Azure Service Bus
• Trading Data & Domain Expertise
• Apply foundational trading data knowledge
• Understand how accurate and timely positions flow into P&L and risk processes
• Model and optimize datasets used by Risk and Front Office for position management, Mark to Market, P&L calculation, and exposure reporting
• Work with data sourced from ETRM systems, understanding how trades, marks, and market data land in upstream platforms and propagate through downstream pipelines
• Engineering Excellence & Best Practices
• Follow enterprise engineering principles, architecture standards, and development practices
• Experience in version control (Github), CI/CD through Github Actions, Azure DevOps Pipelines
• Troubleshoot and root cause data issues under time pressure with strong debugging and analytical skills
• Collaborate closely with business and technical teams to clarify requirements, drive continuous improvement, and deliver high value data products

Benefits

• Flexible working hours
• Possibility of remote/mobile working
• Paid parental leave
• Competitive starting salary and annual performance-related salary increase
• Training and development programs