samprasoftCharlotte, NC
AWS Big Data Engineer
Data EngineerData Storage: Manage and optimize data storage solutions, including Amazon S3, Redshift, and other AWS storage services.
Data Processing: Utilize AWS services like AWS Glue, Amazon EMR, and AWS Lambda to process and analyze large datasets.
Data Monitoring and Optimization: Continuously monitor and optimize data pipelines and infrastructure for performance, cost-efficiency, and scalability.
Integration: Collaborate with data scientists, analysts, and other stakeholders to integrate AWS-based solutions into data analytics and reporting platforms.
Documentation: Maintain thorough documentation of data engineering processes, data flows, and system configurations.
Scalability: Design AWS-based solutions that can scale to accommodate growing data volumes and changing business requirements.
Must Have:
Experience with AWS services on big data platforms.
Python experience in building Dash application in AWS
Spark
Shell scripting and Linux knowledge
Nice to have: Looking for candidates who have worked in Marketing Technology
Qualifications
Educational Background:
A bachelor's degree in computer science, information technology, or a related field is typically required.
Communication Skills:
Effective communication and collaboration skills to work with cross-functional teams.
Also on the board Same function, level within a rung
Level
Senior
Location
Charlotte, NC
Occupation
Data Warehousing Specialists
Industry
Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services
Posted
3 days ago