BigData Platform Admin & Strategist

Judge Group, Inc. Logo
Judge Group, Inc.
Irving, TEXAS, United States
  • Construction

Location: Irving, TX

Description:

Job Title: Big Data Platform Administrator & Strategist

Overview

We are seeking an experienced and forward-thinking Big Data Platform Administrator & Strategist to serve as a key link between the Hadoop platform administration team and various application development groups. This role focuses on platform oversight, strategic planning, and cross-team collaboration rather than daily operational administration. The ideal candidate will help ensure the platform’s performance, stability, scalability, and long-term readiness while promoting best practices and guiding technical decision-making across teams.

Key Responsibilities

1. Stakeholder Coordination

  • Act as the primary point of contact for all platform-related discussions.
  • Bridge communication between Hadoop administrators and application development teams.
  • Ensure consistent alignment and understanding across all stakeholders.

2. Platform Upgrade & Release Management

  • Review upcoming Hadoop platform releases, including new features, patches, and library updates.
  • Conduct impact assessments for existing applications and services.
  • Identify potential risks, opportunities, and necessary remediations.
  • Coordinate and communicate upgrade timelines and technical requirements across teams.

3. Technical Evaluation & Adoption

  • Assess new features and libraries within the Hadoop ecosystem that may enhance platform performance or developer productivity.
  • Recommend adoption of relevant technologies and methodologies.
  • Support the evolution and modernization of the big data environment.

4. Cluster Health & Optimization

  • Monitor cluster health, performance metrics, and resource utilization.
  • Recommend and guide optimization initiatives to improve efficiency, scalability, and cost-effectiveness.
  • Collaborate with administrators to resolve complex platform-level issues.

5. Resource Governance & Housekeeping

  • Oversee resource allocation across applications, tenants, and workloads.
  • Define and enforce policies related to resource quotas, data lifecycle management, and storage optimization.
  • Implement housekeeping strategies to maintain a clean, sustainable, and high-performing cluster environment.

6. Best Practices & Operational Excellence

  • Document and promote best practices for development, deployment, and operational use of the Hadoop platform.
  • Support initiatives to enhance platform stability, resilience, and uptime.
  • Contribute to disaster recovery and business continuity planning.

7. Solution Design & Innovation

  • Research emerging technologies and architectural approaches relevant to big data ecosystems.
  • Recommend solutions for performance challenges, new business requirements, and evolving workloads.
  • Stay updated on industry trends and opportunities for continuous improvement.

Qualifications

Education

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.

Experience

  • 5 years of experience in large-scale big data environments, with strong exposure to Hadoop.
  • Demonstrated technical leadership or architect-level experience working across operations and development teams.
  • Experience with distributed systems, data processing frameworks (e.g., Spark, Hive), and data warehousing concepts.
  • Familiarity with cloud platforms (AWS, Azure, Google Cloud Platform) and containerization technologies (e.g., Docker, Kubernetes) is a plus.

Technical Skills

  • Strong expertise in Hadoop ecosystem components (HDFS, YARN, MapReduce, Hive, Spark, Kafka, etc.).
  • Solid understanding of Spark architecture and core concepts.
  • Proficiency in Linux-based systems and scripting for automation.
  • Working knowledge of Python or Scala.
  • Experience with monitoring and logging tools (e.g., Grafana, Prometheus).
  • Understanding of data engineering tools and consumption patterns.
  • Awareness of security best practices in big data environments.

By providing your phone number, you consent to: (1) receive automated text messages and calls from the Judge Group, Inc. and its affiliates (collectively “Judge”) to such phone number regarding job opportunities, your job application, and for other related purposes. Message & data rates apply and message frequency may vary. Consistent with Judge’s Privacy Policy, information obtained from your consent will not be shared with third parties for marketing/promotional purposes. Reply STOP to opt out of receiving telephone calls and text messages from Judge and HELP for help.

Contact:

This job and many more are available through The Judge Group. Please apply with us today!

Apply for job