Azure Data Engineering Lead / Technical Lead

Location: Indianapolis, IN (Onsite)

Employment Type: Full-Time / Direct-Hire / FTEWe are seeking an experienced Data Engineering Technical Lead specializing in Azure Databricks and Enterprise Lakehouse architectures. This role will own the end-to-end design, development, and optimization of scalable batch and near-real-time data processing platforms.

Key Responsibilities: Architect & Design: Lead Lakehouse solutions using Delta Lake (Bronze/Silver/Gold layers) and PySpark. Governance & Security: Configure Unity Catalog for object lineage, data access policies, and fine-grained permissions. Orchestration & Ingestion: Build modular pipelines using Azure Data Factory (ADF) and Databricks Workflows. Cloud Infrastructure: Integrate with Azure networking, Private Endpoints, Key Vaults, and ADLS Gen 2.Leadership: Technical design (HLD/LLD), team mentorship, code reviews, and cross-functional Agile leadership.

Key Requirements: 8+ years: Azure Cloud & Azure Databricks with PySpark 4+ years: Databricks Workflows & Unity Catalog 5+ years: ADF, ADLS Gen 2, and Azure SQL4+ years: Python programming & custom package builds Hands-on experience with Spark tuning, partitioning strategies, and T-SQL.

Nice to Have: Git Hub Actions, Airflow/Dagster, CDC (Debezium), Kafka/Event Hubs, or Azure Synapse to Databricks migration experience.