Staff Data Engineer

Pismo is hiring a Staff Data Engineer to design and build robust data pipelines for our corporate Data Lake. As a Staff Data Engineer, you’ll own data products end-to-end in production, work autonomously on significant projects, and mentor junior engineers.

Requirements

• Design and implement data ingestion and transformation pipelines (batch and near-real-time) using PySpark/SparkSQL on Databricks.
• Own data pipelines end-to-end in production: freshness, correctness, availability, and SLA adherence.
• Build and maintain Delta Lake tables following medallion architecture patterns (bronze/silver/gold).
• Design and optimize Airflow DAGs (MWAA) for complex orchestration scenarios.
• Implement and maintain data quality frameworks (Great Expectations or equivalent) as integrated pipeline gates.
• Write advanced SQL for data modeling, transformation, and performance optimization.
• Conduct thorough code reviews. mentor Analyst-level engineers through pairing and design guidance.
• Investigate, diagnose, and resolve data quality incidents and pipeline failures independently.
• Collaborate with Analytics, BI, and Product teams to design consumer-friendly datasets.
• Contribute to CI/CD, testing standards, and data governance practices.

Benefits

• Generous Paid Time Off
• 401k Matching
• Retirement Plan
• Visa Sponsorship

Tagged as: SQL