Senior Data Engineer
Job Title: Senior Data Engineer — Databricks Specialist
Location: Remote
Department: Technology / Data Engineering
Employment Type: Full-Time
About the Role
We are seeking a highly skilled and motivated Senior Data Engineer with deep expertise in Databricks to join our growing data team. In this role, you will design, build, and optimize scalable data pipelines and analytics solutions using Databricks and other modern data technologies. You’ll collaborate closely with data scientists, analysts, and business stakeholders to drive data-driven decision-making across the organization.
Key Responsibilities
- Design and implement robust data pipelines using Apache Spark on Databricks.
- Develop and maintain ETL/ELT workflows for structured and unstructured data.
- Optimize performance and scalability of data processing jobs.
- Collaborate with cross-functional teams to understand data requirements and deliver solutions.
- Ensure data quality, governance, and security best practices are followed.
- Monitor and troubleshoot production data pipelines and workflows.
- Contribute to architectural decisions and technology evaluations.
Required Qualifications
- Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
- 5+ years of experience in data engineering or software development.
- 2+ years of hands-on experience with Databricks and Apache Spark.
- Proficiency in Python , SQL, and data modeling.
- Experience with cloud platforms (e.g., Azure , AWS , or GCP).
- Familiarity with Delta Lake, MLflow, and other Databricks ecosystem tools.
- Strong problem-solving skills and attention to detail.
Preferred Qualifications
- Experience with CI/CD pipelines and DevOps practices.
- Knowledge of data governance frameworks and compliance standards.
- Certifications in Databricks or cloud platforms are a plus.
- Experience working in Agile environments.