ace stackCharlotte, NC
Senior Developer Hadoop
Senior Developer Hadoop
Apply for this role (opens in a new tab)Senior Developer
Location: Charlotte, NCFull Time – Permanent
Job Description
Must Have Technical/Functional Skills:
Primary Skill: Data Engineering, Platform Engineering or architecture roles. Deep Expertise in Pyspark.
Roles & Responsibilities:
- Bachelor’s or master’s degree in computer science or related field.
- Deep Expertise in PySpark, including performance tuning and optimization
- Strong python development experience in large-scale distributed environment
- Solid knowledge of Hadoop ecosystem (HDFS, Hive/Impala, YARN)
- Proven experience designing and governing enterprise, regulatory facing data platforms.
- Expertise in designing data lakes, ELT/ETL pipelines, batch and real time data processing solution
- Proficiency in programming languages such as Java, Scala and SQLStrong understanding of non-functional requirements and production support models
- Clear written and verbal communication skills with ability to influence across organizations
- Preferred Skills / Experience
- Financial services experience, particularly in Market Surveillance, AML, Fraud, Or Risk Technology
- Experience supporting regulatory or audit facing platforms
- Kafka and Spark Structured streaming exposure
- Familiarity with Orchestration tools(Airflow, Control-M, Oozie)
- Knowledge of data governance, lineage, and data quality controls
- Daily Responsibilities/Priorities
- Enterprise & Surveillance Architecture
- Define target state architecture and strategic roadmap for surveillance data processing platforms leveraging Hadoop, Spark, Pyspark and Python
- Establish standard architectural patterns for alert generation, enrichment, aggregation and reporting pipelines.
- Ensure architecture aligns with enterprise technology standards and Surveillance control expectation
- Solution Design and Delivery Support
- Translate surveillance business requirements(e.g, market misconduct detection, regulatory coverage) into scalable technical designs
- Review and approve detailed technical designs, ensuring alignment with functional intent, regulatory requirements, and architectural standards.
Also on the board Same function, level within a rung
Level
Lead
Location
Charlotte, NC
Occupation
Software Developers
Industry
Computer Systems Design Services
Posted
10 days ago