variteCharlotte, NC
Technology Architect | Analytics - Packages | Python - Big Data
$52.70 - 54.92/hr
Apply (opens in a new tab)Technology Architect | Analytics - Packages | Python - Big Data
Apply for this role (opens in a new tab)Job Description: Job Description
Pay Rate Range: $52.70 - 54.92/hr.
Job Description:
At least 10 years of experience in IT industry. We are seeking a Python-based platform engineer to design and build a containerized API layer that abstracts and governs interactions with Apache Spark through a well-defined API contract. This role focuses on building platform capabilities, not simply consuming existing data tools enabling consistent, secure, and scalable access to Spark-based data pipelines. The ideal candidate has strong experience developing production-grade APIs in Python that interface with data frameworks or pipeline orchestration systems, packaging services using containers (Docker/Kubernetes), and operating them as reusable platform services. A proven background in CI/CD automation using GitHub Actions is required, along with solid software engineering practices around testing, versioning, and deployment. Should have good hands-on experience in GCP skills. Should be able to interact, coordinate with the client. Should be able to manage offshore resources also. Should be able to work with other onsite team members and client. READ BEFORE SUBMITTING:UPDATED CONTACT NUMBER and EMAIL ID is a MANDATORY REQUEST from our client for all the submissions We prioritize endorsing those with complete and accurate information Avoid submitting duplicate profiles. We will Reject/Disqualify immediately. Make sure that candidate's interview schedules are updated. Please inform the candidate to keep their lines open. Please submit profiles within the max proposed rate*Please make sure to TAG the profiles correctly if the candidate has WORKED FOR * as a SUBCON or FTE.MANDATORY: Please include in the resume the candidate's complete & updated contact information (Phone number, Email address and Skype ID) as well as a set of 5 interview timeslots over a 72-hour period after submitting the profile when the hiring managers could potentially reach to them. PROFILES WITHOUT THE REQUIRED DETAILS and TIME SLOTS will be REJECTED.Must Have Skills: Python PysparkAPIMicroservices CI/CDGCPETLNice to Have Skills: ETLTech SkillsPythonPysparkExperience building control planes Design patternso Modular containerized serviceso Asynchronous processingo Job-based work queue executiono Immutability and idempotencyo Metadata managemento Policy enforcemento Semantic modelingo Observability and telemetryo Side effect capability injectionGCPTestingFunctional testing Behavioral testing LanguagesPythonFrameworks and Platforms FastAPIARQKubernetes" Pytest Minimum Years of Experience:10 years Certifications Needed: NoneTop 3 responsibilities you would expect the Subcon to shoulder and execute: Should have good expertise in delivery coordination Should be able to manage complex software application development and support projects Should be able to manage offshore resources also.
Interview Process: (Is face to face required?)Virtual
Also on the board Same function, level within a rung
Level
Senior
Salary
$52.70 - 54.92/hr
Location
Charlotte, NC
Occupation
Computer Systems Engineers/Architects
Industry
Computer Systems Design Services
Posted
today