The Lead BI Engineer will be responsible for architecting, developing, and optimizing enterprise-scale business intelligence solutions, leading the design and development of Power BI dashboards, reports, and KPI scorecards, and championing BI adoption and fostering a culture of data-driven decision-making.
Requirements
- Design and implement data ingestion pipelines from multiple sources using Azure Databricks.
- Develop scalable and reusable frameworks for ingesting and transforming datasets.
- Integrate end-to-end data pipelines ensuring data quality, consistency, and governance.
- Work with event-based/streaming technologies for real-time data ingestion and processing.
- Optimize Databricks code and perform performance tuning for large-scale workloads.
- Write, analyze, and optimize complex SQL queries including stored procedures, functions, triggers, joins, updates, and constraints.
- Lead the design and development of Power BI dashboards, reports, and KPI scorecards.
- Collaborate with business stakeholders to translate requirements into actionable BI solutions.
- Champion BI adoption and foster a culture of data-driven decision-making.
- Design and deploy data applications on Azure cloud solutions (Synapse, Data Lake, SQL DB, Blob Storage).
- Hands-on experience with Azure Data Factory, Azure Functions, and Azure DevOps for automation and orchestration.
- Provision and manage Databricks clusters, including scheduling and job automation.
- Familiarity with AWS/GCP integration where applicable.
- Experience with PySpark and Python for data processing and advanced analytics.
- Hands-on experience with Spark SQL, Spark Streaming, Delta Lake, and Scala/Python notebooks.
- Develop proofs of concept (POCs) and prototypes with customer teams.
- Implement transformational big data projects, including real-time streaming using Databricks.
Benefits
- Generous Paid Time Off
- 401k Matching
- Retirement Plan
- Health Insurance
- Dental Insurance
- Vision Insurance
Follow us on social media