Lead Databricks Developer/Big Data Engineer

Judge Group, Inc. Logo
Judge Group, Inc.
Austin, TX, United States (Remote)
  • Logistics
  • Applications have closed

Location: Austin, TX

Salary: $55.00 USD Hourly – $57.00 USD Hourly

Description:

Position: Lead Databricks Developer/ Dig Data Engineer

Location: Fully Remote but must be located in Austin, TX

Duration: 6 month
Minimum Qualifications

  • 8 years of experience in ETL/ELT workflows, CI/CD automation, and cross-functional collaboration.
  • Strong expertise in data modeling, data lakes (Azure Data Lake Storage), and data warehouses.
  • Proven ability to implement data validation, governance, lineage, and cataloging.
  • Hands-on experience with data security measures including encryption, access controls, and auditing.
  • Proficiency in Python, R, and SQL for data manipulation and analysis.
  • Solid experience with the Azure cloud platform, DevOps practices, and version control systems.
  • Background in Agile environments, with strong troubleshooting and debugging skills.
  • 5 years of experience designing pipelines and optimizing Spark jobs on Databricks.
  • Deep understanding of Apache Spark architecture, RDDs, DataFrames, and Spark SQL.
  • Hands-on experience with Databricks notebooks, clusters, jobs, and Delta Lake.

Preferred Qualifications

  • Knowledge of ML libraries such as MLflow, Scikit-learn, or TensorFlow.
  • Databricks Certified Associate Developer for Apache Spark.
  • Azure Data Engineer Associate certification.

Thanks & Regards.

Prakash Dwivedi

E: I

By providing your phone number, you consent to: (1) receive automated text messages and calls from the Judge Group, Inc. and its affiliates (collectively “Judge”) to such phone number regarding job opportunities, your job application, and for other related purposes. Message & data rates apply and message frequency may vary. Consistent with Judge’s Privacy Policy, information obtained from your consent will not be shared with third parties for marketing/promotional purposes. Reply STOP to opt out of receiving telephone calls and text messages from Judge and HELP for help.

Contact:

This job and many more are available through The Judge Group. Please apply with us today!

Apply for job