Data Engineer

We’re hiring on behalf of a Haystack partner!

The Role

• Build and support highly available data pipelines across batch/distributed and real-time processing for analytics at scale.

• Translate strategic needs into working solutions by partnering across teams to define requirements, implement data governance and retention practices, and improve standards and reliability.

• Drive operational excellence through automation, monitoring, documentation, performance analysis, and root-cause resolution.

• Design, develop, test, and support data pipelines enabling continuous data processing for exploration, preparation, and real-time business analytics.

What You’ll Need

• Bachelor’s degree in Computer Science, Management Information Systems, or related discipline.

• 2+ years of professional industry experience with software development.

• 5+ years working with SQL platforms and 2+ years with NoSQL platforms.

• 5+ years working with Spark and/or the Hadoop ecosystem.

• Proficiency in Java, Scala, or C#, with strong debugging and performance tuning skills.

• Experience with CI/CD tools and practices.

What’s On Offer

• Competitive salary.

• Comprehensive benefits package including medical, dental, vision, and retirement plans.

• Opportunities for professional development, including educational assistance for a bachelor’s degree.

• Access to the latest big data technologies and cloud platforms (Azure/AWS).

Apply via Haystack today!