Data Engineer

Haystack Logo
Haystack
Washington, DC, United States
  • IT
  • FullTime
  • Applications have closed

Data Engineer

We’re working with a premier national security innovator and mission-critical technology partner on this exciting opportunity.

Are you ready to architect the backbone of high-stakes intelligence operations? We are seeking a high-caliber Data Engineer to design and optimize massive Big Data ingest systems using Python, Java, and SQL within a secure, high-impact environment. You will bridge the gap between raw data and actionable intelligence, crafting the robust pipelines that power modern AI/ML workflows.

The Role

• Lead the design, implementation, and optimization of large-scale data extraction, transformation, and loading (ETL) systems in complex Big Data environments.

• Develop custom high-performance code to exploit new data sources, implementing advanced data profiling, deduping, and matching logic for deep-dive analysis.

• Collaborate directly with Data Scientists to build sophisticated data pipelines that serve as the foundation for cutting-edge AI and Machine Learning models.

• Architect and maintain the Data Layer documentation to ensure seamless integration across multidisciplinary teams of service providers and vendors.

• Navigate the full data lifecycle—from initial planning and Linux-based ingest to final visualization and BI dashboard display.

What You’ll Need

• An active TS/SCI with Polygraph clearance (Required).

• 4+ years of hardware-hitting experience in Data Engineering, Software Development, or Programming.

• Mastery of Python and Java, coupled with expert-level SQL skills for complex database manipulation.

• Hands-on proficiency with the Java ecosystem (JDK, J2EE, JDBC, Spring) and building/consuming RESTful APIs.

• Proven experience with orchestration tools like Apache Airflow and performing large-scale ETL tasks within Linux environments.

What’s On Offer

• High-impact work supporting critical national security missions in a technologically advanced environment.

• Opportunity to work at the intersection of Big Data and AI/ML, deploying systems that utilize the latest industry breakthroughs.

• A career-oriented culture focused on long-term growth, professional development, and technical excellence.

• Professional environment in Chantilly, VA, working alongside the industry’s top intelligence and tech experts.

Apply via Haystack today!

Apply for job