Data Engineer III - Digital and Technology Partners - Hybrid/Remote

Responsibilities: Facilitate data collection from diverse sources, ensure proper formats and data quality, and provide a common interface for downstream users Build scalable, repeatable, and secure data pipelines serving multiple users within the Institute Contribute as a core Agile team member, collaborating with Application/Database/Data Scientists Create infrastructure to derive insights from raw data and manage diverse data sources Enable big data and batch/real-time analytics using emerging technologies Develop prototypes and proofs of concept; execute complex big data projects for research and data science Translate business requirements into modern data pipeline solutions Create centralized documentation and diagrams; build a data catalog for metadata Design and implement monitoring, backup, and disaster recovery for data systems Maintain a customer-focused, science/research-driven service mindset Ensure data integrity and security across all storage and architectures Collaborate with IT and adhere to IRB and HIPAA policies Assist in standards development, document procedures, and provide training Demonstrate flexibility with multiple technologies/languages and continuous learning Mentor junior Data Engineers and participate in hiring/performance input Perform other duties as assigned

Key requirements: Bachelor’s degree in Computer Science or related discipline 5+ years of relevant Data Engineering experience Strong knowledge of Azure (Data Factory, Databricks) and cloud architecture SQL and NoSQL expertise (Oracle, PostgreSQL/MySQL, MongoDB or similar) Proficiency in at least two programming languages among Scala, Python, Java RESTful service development experience (Node.js, Django, PHP) Experience with microservices/SOA; CI/CD and Observability tools; Git Familiarity with Hadoop, Spark, Kafka, and other big data/streaming stacks Healthcare data knowledge; HL7 and Mirth a plus Agile methodology experience; JIRA is a plus Open source technologies and diverse tool usage Cloud experience on Azure or AWS; serverless concepts, VMs, cloud security customer-focused service mindset flexible and adaptable attitude strong collaboration and communication Azure Data Factory Databricks Oracle