Data Engineer

Location: Parsippany NJ | Hybrid (must be onsite Tuesday-Thursday)

Duration: 6+ months

Job Description: We are seeking a Data Engineer to support the development and optimization of a Databricks-based enterprise analytics platform. This role will focus on building scalable data pipelines, integrating data from multiple enterprise sources, and delivering curated datasets that support reporting, customer analytics, and AI initiatives. The ideal candidate is a hands-on engineer with strong Databricks, SQL, Python, PySpark, and AWS experience who can contribute across architecture, development, and operational support activities.

Key Responsibilities: Design and develop scalable data ingestion and transformation pipelines. Build and maintain curated datasets for analytics and reporting. Integrate structured and unstructured data from enterprise systems. Optimize Databricks workloads, data models, and query performance. Implement data quality, validation, and monitoring processes. Support analytics and AI initiatives through reliable data engineering practices. Collaborate with analysts, architects, and business stakeholders.

Required Skills: 8+ years of Data Engineering experience. Strong Databricks experience, including Delta Lake, Workflows, and Databricks SQL.Advanced SQL, Python, and PySpark skills. Experience building enterprise-scale ETL/ELT solutions. AWS cloud platform experience. Strong understanding of data modeling and lakehouse architectures. Experience with GitHub, Jira, and Agile delivery practices.

Preferred Skills: Experience with vector databases, graph databases, or NoSQL technologies. Exposure to AI/ML solutions, RAG architectures, or LLM-related data platforms. Experience with Terraform, Jenkins, Splunk, or Dynatrace.