Data Engineer

We are looking for a Data Engineer to develop high performance, distributed computing tasks using technologies like Apache Spark, Apache Flink, Kafka, and SQL/NoSQL database. As a Data Engineer, you will be responsible for analyzing, designing, programming, debugging, and modifying software enhancements and/or new products used in distributed, large-scale analytics solutions.

Requirements

• B.E/B.Tech/M.E/M.Tech
• 3 – 5 Years of experience as Data/Backend Engineer
• Strong object oriented or functional programming skills in: Java/Python/Scala
• Experience working in a technical environment with tools like Spark, Flink, Storm, Kafka, Elastic Search etc.
• Have knowledge on AWS cloud services: EC2, S3, EMR, RDS, Redshift, Lambda, Step functions.
• Exposure to stream-processing systems like Spark-Streaming, Flink, Kafka Streams etc.
• Experience with relational SQL and/or NoSQL databases: MySql, Postgres, MongoDB and Cassandra.
• Experience with data pipeline orchestrating tools: Airflow, Luigi etc.
• Experience using AI-powered development tools (e.g., GitHub Copilot, Cursor etc )
• You are well versed with modern software development practices (Agile, TDD, CI/CD)
• Knowledge of Software Engineering best practices with experience on implementing CI/CD, Log aggregation/Monitoring/alerting for production system.

Benefits

• Health & Wellbeing
• Personal & Professional Development
• Unconditional Inclusion

Tagged as: Python, SQL