Data Operations Engineer

We are seeking a highly motivated and experienced Data Operations Engineer to join our team. As a Data Operations Engineer, you will be responsible for monitoring and managing maintenance of multiple data ETL pipelines, ensuring that data is accurate, reliable, and available to our customers and stakeholders.

Requirements

• B.S. in computer science or information systems fields
• 5+ years related work experience
• Strong analytical and critical thinking skills
• Strong technical background with development and automation skills
• Exceptional communication and interpersonal skills
• Ability to work independently with little guidance
• Proficient in shell scripting, Python, Scala, or other programming languages
• Knowledge of Spark/PySpark
• Excellent SQL knowledge
• Skilled in Hive (HQL) and HDFS
• Experience working with big data environments and large diverse data sets
• Proficient in Linux environments
• Familiarity with source code management/versioning tools such as Github
• Understanding of CI/CD principles and best practices in data processing
• Experience building data visualization dashboards using tools like Tableau, Big Data Studio
• Understanding of public cloud technologies such as AWS, GCP, and Azure