Design, build, and maintain scalable data pipelines using AWS Glue, and manage AWS Redshift data warehouse operations. Develop CI/CD pipelines for data workflows and implement automated testing. Collaborate with technical teams on data architecture and enhancements.
Requirements
- Strong experience in data engineering and data pipeline development
- Proficient in SQL, Python, and shell scripting
- Hands-on experience with AWS data services such as Redshift, S3, Glue, Lambda, and CloudWatch
- Experience in data warehouse design and performance optimisation
- Strong knowledge of CI/CD pipelines (GitLab preferred)
- Experience with Infrastructure as Code tools such as Terraform or CloudFormation
- Solid understanding of data modelling and database design principles
- Strong troubleshooting and performance tuning skills
Follow us on social media