3m consultancyDenver, CO
Databricks Developer (Java & Apache Spark) with IRS MBI Clearance required
Databricks Developer (Java & Apache Spark) with IRS MBI Clearance required
Apply for this role (opens in a new tab)Databricks Developer (Java & Apache Spark) This is a remote position.
Job Title: Databricks Developer (Java & Apache Spark)
Location:
Remote Duration: Full-Time NEED IRS MBI Clearance. We are looking for a Databricks Developer who can design, build, and support large-scale data processing solutions. This role focuses on working with complex, high-volume data in a secure environment. You should be comfortable writing clean Java code, building Spark jobs, and improving performance in distributed systems. You'll work closely with engineers, analysts, and business teams to deliver reliable data pipelines that scale well and meet security and compliance requirements.
What You'll Do:
- Build and maintain data pipelines using Apache Spark on Databricks
- Write clean and efficient Java (Java 8 or higher) following best coding practices
- Work with large structured and semi-structured data sets
- Tune Spark jobs to improve performance, stability, and cost
- Partner with other teams to understand requirements and deliver solutions
- Make sure data handling follows security and governance standards
- Investigate and fix issues in production environments
What We're Looking For:
Active federal background clearance (client-issued laptop is a plus) Bachelor's degree in Computer Science or a related field 8+ years of hands-on experience in data engineering or big data development
Technical Skills:
- Data & Systems Experience working with large enterprise or government data systems
- Good understanding of data structures, security, and compliance
- Java Strong experience with Java 8 or newer
- Comfortable with Streams, Lambdas, and object-oriented design
- Apache Spark Hands-on experience with Spark Core, Spark SQL, and DataFramesUnderstanding of RDDs and when to use them
- Experience with batch processing and streaming
- Strong skills in Spark performance tuning
- Able to debug jobs using Spark UI and logs
- Big Data Tools Experience with tools like HDFS, Hive, or HBaseFamiliar with Kafka, S3, or cloud-based data lakes
- Experience with Parquet, Avro, or ORC formatsETL & Data Processing Experience building batch and real-time ETL pipelines
- Skilled in data cleansing, transformation, and enrichment
- DevOps & Deployment Experience running Spark on YARN, Kubernetes, or cloud platforms
- Familiar with CI/CD tools like Jenkins or GitHub Actions
- Experience with monitoring tools and production logs
- Testing & Code Quality Unit testing using JUnit or TestNGExperience with Mockito or similar tools
- Comfortable validating data and testing Spark jobs
- Ways You'll Succeed:
- You're used to working in Agile teams
- You document your work clearly
- You stay calm and focused when troubleshooting production issues
Nice to Have:
- Experience with Scala or Python in SparkHands-on experience with Databricks or Google Dataproc
- Knowledge of Delta Lake or Apache Iceberg
- Background in data modeling and performance design
Also on the board Same function, level within a rung
Level
Senior
Location
Denver, CO
Occupation
Software Developers
Industry
Custom Computer Programming Services
Posted
today