virtual vocationsNew York, NY
Databricks Engineer
Databricks Engineer
Apply for this role (opens in a new tab)Building and optimizing production pipelines on the Databricks Lakehouse, the full-time Databricks Engineer will work remotely, collaborating with customers and Databricks' field teams while managing data ingestion, transformation, and deployment processes.
Key responsibilities:
Build and maintain batch and streaming ETL pipelines using PySpark, SQL, and Delta Lake on Databricks
Implement Medallion architecture layers and manage data resources on AWS, Azure, or GCP
Troubleshoot pipeline failures and data quality issues, including in productionRequired qualifications 8+ years in data engineering/architecture or analytics platform development
Demonstrated ownership of end-to-end architecture for at least two enterprise-scale data platforms
Deep experience migrating legacy data warehouses or ETL estates to a modern cloud platform
Strong proficiency in Python and SQL; working knowledge of Apache Spark
Experience with data modeling across dimensional, normalized, and Lakehouse patterns
Also on the board Same function, level within a rung
Level
Senior
Location
New York, NY
Occupation
Data Warehousing Specialists
Industry
Computer Systems Design Services
Posted
today