ipolarityPiscataway, NJ
DATA ENGINEERS
$166,754 per year
Apply (opens in a new tab)DATA ENGINEERS
DATA ENGINEERS
ipolarityPiscataway, NJ
2 days ago
$166,754 per year
Computer Systems Design ServicesCustom Computer Programming ServicesOther Scientific and Technical Consulting Services
Apply for this role (opens in a new tab)Experience Required:
5 YearsMinimum Education Required
BachelorsExpected Start Date
11/16/2026 Compensation
$166,754.00 - $166,754.00 / YearlyHours Per Week
40 Number Of Positions
5Shift
First Shift (Day)
Job Description:
Design and implement automation frameworks underpinning the migration. Build reusable transformation component libraries covering parameterized ingestion, SCD processing, data quality assertion, and reconciliation reporting. Construct end-to-end column-level data lineage and data flow diagrams. Identify and eliminate data processing redundancies and perform pipeline inventory analysis. Implement Terraform IaC managing all Databricks and AWS resources. Execute Ab Initio legacy pipelines in parallel with new PySpark/Databricks equivalents. Track lineage from Oracle/Snowflake source systems through Ab Initio transformation layers and PySpark pipelines to Delta Lake Gold consumption tables. Skills required: AWS, Python, PySpark, Databricks, Terraform, ETL, Ab Initio, Oracle, Snowflake, airflow, dbt and Apache Kafka. Bachelor’s degree in Science, Technology, or Engineering (any) with 5 years of experience in the job offered or related occupation is required. Work location: Piscataway, NJ and various unanticipated locations throughout the U.S.Email Resume to HR Dept., Ipolarity, LLC., at hr@ipolarityllc.comPlace of Work
On-siteRequisition ID
DE191Job Type
Full TimeApplication Email
hr@ipolarityllc.com
Also on the board Same function, level within a rung
Level
Senior
Salary
$166,754 per year
Location
Piscataway, NJ
Occupation
Data Warehousing Specialists
Industry
Computer Systems Design Services
Posted
2 days ago