Data Ops Engineer

Shamrock Trading Corporation is seeking a DataOps Engineer who is passionate about data automation and lifecycle management. The role involves implementing cutting-edge DataOps methodologies to optimize data engineering and analytics frameworks, ensuring high-quality data solutions and contributing to the overall robustness and reliability of data systems.

Requirements

• Bachelor’s degree in Computer Science, Engineering, Analytics or a related field
• Experience with Databricks, including Unity Catalog, Delta Lake, and Spark Streaming
• Experience in build and deployment technologies such as Docker, AWS Code Build, Code Deploy, ECR, ECS
• Experience with star schema data warehouse
• Proficient in automated testing frameworks and tools
• Skilled in cloud data technologies and modern programming languages including Python, SQL, Java, and Spark
• Experience using CLI tools and familiarity with linux
• Demonstrated ability to work collaboratively in a dynamic team environment with a proactive, positive attitude

Benefits

• Training and Development
• Medical: Fully paid healthcare, dental and vision premiums for employees and eligible dependents, and gym benefits
• Financial: One-time sign-on bonus, generous company 401(k) contributions and employee stock ownership after one year
• Work-Life Balance: Competitive PTO and work from home opportunities after an introductory period

Tagged as: SQL