DATABRICKS CONSULTANT

Location: Palo Alto, CA

Salary: $65.00 USD Hourly – $75.00 USD Hourly

Description: Our client is currently seeking a DATABRICKS CONSULTANT

Job Title: Azure/Databricks Engineer

Location: Hybrid – Onsite in Stanford, CA (2-3 days/week initially), with flexibility for remote work over time

Contract Type: Contract-to-Hire (6 months)

Position Overview

We’re seeking a mid-level Azure/Databricks Engineer with 3-5 years of enterprise experience to support the design, implementation, and management of a secure, scalable cloud data platform. This role is ideal for someone with a strong foundation in Azure, Databricks, and DevOps practices, who thrives in collaborative environments and is passionate about automation and data operations.

The position will begin with a hybrid schedule (onsite in Stanford, CA a few days per week) and transition to more remote flexibility over time. Local candidates are strongly preferred.

Key Responsibilities

• Cloud Data Platform Development:

Design and manage enterprise data lake environments on Azure using Databricks and other cloud technologies.

• Sandbox Environment Creation:

Build secure sandbox/enclave environments for innovation and research without impacting production systems.

• Infrastructure-as-Code (IaC):

Automate cloud resource provisioning using Terraform, ARM templates, or Bicep.

• Data Pipeline & ETL Development:

Build scalable data pipelines and optimize ETL processes for high-quality data ingestion from diverse sources (e.g., Epic, Workday, HL7, FHIR, RTLS).

• Data Integration & Modeling:

Collaborate with teams to integrate data into conformed models (OMOP, Master Data, custom models).

• Security & Compliance:

Implement best practices for cloud security and ensure compliance with audit and FinOps requirements.

• Cross-Functional Collaboration:

Work closely with data scientists, developers, and product managers to deliver tailored solutions. Lead meetings on platform enhancements and compliance.

• Documentation & Training:

Create clear documentation and conduct training sessions on platform usage and security protocols.

Required Skills & Experience

• 3-5 years of enterprise experience in cloud engineering or data operations
• Strong hands-on experience with Azure services: Databricks, Data Factory, Azure SQL, Azure Storage
• Proficiency in infrastructure-as-code tools: Terraform, ARM templates, Bicep
• Experience with ETL processes, data pipeline development, and cloud database services
• Familiarity with DevOps tools: Azure DevOps, Git
• Solid understanding of CI/CD pipelines and production deployment workflows
• Knowledge of data security best practices and compliance standards
• Strong communication skills for technical presentations and stakeholder engagement
• Programming proficiency in Python, PySpark, SQL, R, or Scala

Let me know if you’d like a version tailored for a job board, internal HR system, or formatted for LinkedIn!

By providing your phone number, you consent to: (1) receive automated text messages and calls from the Judge Group, Inc. and its affiliates (collectively “Judge”) to such phone number regarding job opportunities, your job application, and for other related purposes. Message & data rates apply and message frequency may vary. Consistent with Judge’s Privacy Policy, information obtained from your consent will not be shared with third parties for marketing/promotional purposes. Reply STOP to opt out of receiving telephone calls and text messages from Judge and HELP for help.

Contact:

This job and many more are available through The Judge Group. Please apply with us today!