Skip to main content
Building and optimizing production pipelines on the Databricks Lakehouse, the full-time Databricks Engineer will work remotely, collaborating with customers and Databricks' field teams while managing data ingestion, transformation, and deployment processes.
Key responsibilities: Build and maintain batch and streaming ETL pipelines using PySpark, SQL, and Delta Lake on Databricks Implement Medallion architecture layers and manage data resources on AWS, Azure, or GCP Troubleshoot pipeline failures and data quality issues, including in productionRequired qualifications 8+ years in data engineering/architecture or analytics platform development Demonstrated ownership of end-to-end architecture for at least two enterprise-scale data platforms Deep experience migrating legacy data warehouses or ETL estates to a modern cloud platform Strong proficiency in Python and SQL; working knowledge of Apache Spark Experience with data modeling across dimensional, normalized, and Lakehouse patterns

Also on the board Same function, level within a rung

Level

Senior

Location

New York, NY

Occupation

Data Warehousing Specialists

Industry

Computer Systems Design Services

Posted

today

Apply for this role (opens in a new tab)