Data Engineer (Python/PySpark/Apache Spark)

Infinitive is seeking a highly skilled Data Engineer to join its dynamic team. As a Data Engineer, you will design, develop, and maintain clients’ data infrastructure using expertise in Apache Spark, Python, PySpark, ETL processes, CI/CD, and experience with both streaming and batch workflows.

Requirements

• Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
• Proven experience as a Data Engineer or similar role.
• Strong programming skills in Python and deep expertise in Apache Spark and PySpark for both batch and streaming data processing.
• Hands-on experience developing, tuning, and troubleshooting distributed data pipelines.
• Solid understanding of ETL tools, data modeling, database design, and data warehousing concepts.
• Familiarity with CI/CD tools such as Jenkins or GitHub Actions.
• Excellent problem-solving, analytical, communication, and collaboration skills.

Tagged as: Python