Pismo is hiring a Staff Data Engineer to design and build robust data pipelines for our corporate Data Lake. As a Staff Data Engineer, you’ll own data products end-to-end in production, work autonomously on significant projects, and mentor junior engineers.
Requirements
- Design and implement data ingestion and transformation pipelines (batch and near-real-time) using PySpark/SparkSQL on Databricks.
- Own data pipelines end-to-end in production: freshness, correctness, availability, and SLA adherence.
- Build and maintain Delta Lake tables following medallion architecture patterns (bronze/silver/gold).
- Design and optimize Airflow DAGs (MWAA) for complex orchestration scenarios.
- Implement and maintain data quality frameworks (Great Expectations or equivalent) as integrated pipeline gates.
- Write advanced SQL for data modeling, transformation, and performance optimization.
- Conduct thorough code reviews. mentor Analyst-level engineers through pairing and design guidance.
- Investigate, diagnose, and resolve data quality incidents and pipeline failures independently.
- Collaborate with Analytics, BI, and Product teams to design consumer-friendly datasets.
- Contribute to CI/CD, testing standards, and data governance practices.
Benefits
- Generous Paid Time Off
- 401k Matching
- Retirement Plan
- Visa Sponsorship
Follow us on social media