Skip to main content
Key Responsibilities: Lead the design and implementation of data ingestion, transformation and processing solutions using AWS native services including S3, Glue, EMR, Redshift and Athena. Define appropriate engineering patterns for batch and large-scale data processing using Python and PySpark. Guide implementation of modern lake/lakehouse patterns, including S3 and Apache Iceberg, where applicable. Provide technical direction across design, development, testing, deployment and production support. Conduct design and code reviews for Python/PySpark and AWS data-engineering components. Establish development standards, reusable patterns and engineering best practices. Ensure appropriate data validation and reconciliation are incorporated into pipelines. Troubleshoot performance and scalability issues across data pipelines and processing workloads. Provide day-to-day technical guidance to Data Engineers. Break functional/data requirements into engineering tasks and coordinate delivery. Communicate technical risks, dependencies and design decisions to stakeholders. Mentor engineers and build the team's AWS/Python/PySpark engineering capability.

Also on the board Same function, level within a rung

Level

Lead

Location

Newark, NJ

Occupation

Data Warehousing Specialists

Industry

Computer Systems Design Services

Posted

today

Apply for this role (opens in a new tab)