Data Engineer – Web Scraping (4 months contract)

We are hiring a Data Engineer – Web Scraping to work on a 4 months contract remotely. The role involves maintaining and managing website scraping configurations using Python, monitoring scraping configurations for errors, and overseeing retrieved data to detect potential issues.

Requirements

• Proven experience in data engineering with expertise in designing and implementing scalable data architectures.
• Strong experience with ETL processes, data modeling, and data warehousing (Airflow & DBT preferred).
• Expertise in database technologies, both relational (SQL) and NoSQL.
• Knowledge of cloud platforms, particularly Azure.
• Solid understanding of data security measures and compliance standards.
• Excellent Python experience for data engineering and automation.
• Strong collaboration skills to work closely with data scientists and analysts.
• Ability to optimize data pipelines for performance and efficiency.
• Ability to build, test, and maintain tasks and projects.
• Experience with version control systems, such as Git.
• Hands-on experience with Airflow and/or DBT.
• Experience with Terraform for infrastructure management.