Google Cloud Platform Lead Data Engineer

VDart, Inc. Logo
VDart, Inc.
Atlanta, GA, United States
  • Construction
  • Applications have closed

Job Title: Google Cloud Platform Lead Data Engineer

Location:Atlanta, GA

Duration: / Term:08 months

Job Description:

Experience Desired: 10 Years.

Key required skills

  • Design, architect, and implement scalable and secure data pipelines on Google Cloud Platform, utilizing services like Dataflow, Pub/Sub, and Cloud Storage.
  • Develop and maintain data models, ensuring data quality, consistency, and accessibility for various internal stakeholders.
  • Automate data processes and workflows using scripting languages like Python, leveraging technologies like Spark and Airflow.
  • Monitor and troubleshoot data pipelines, identifying and resolving performance issues
  • proactively.
  • Stay up to date with the latest trends and advancements in Google Cloud Platform and related technologies, actively proposing and evaluating new solutions.
  • Implement data governance best practices, including data security, access control, and lineage tracking.
  • Lead security initiatives, design and implement security architecture.
  • Lead data quality initiatives, design and implement monitoring dashboards.
  • Mentor and guide junior data engineers, sharing knowledge and best practices to foster a high-performing team.
  • Role requires a solid educational foundation and the ability to develop a strategic vision and roadmap for D&A’s transition to the cloud while balancing delivery of near-term results that are aligned with execution.

What experience you need

  • 8 years of experience as a data engineer or related role, with experience demonstrating leadership capabilities
  • Cloud certification strongly preferred
  • Expert level skills using programming languages such as Python or SQL and advanced level experience with scripting languages.
  • Demonstrated proficiency in all Google Cloud Services
  • Experience building and maintaining complex data pipelines, troubleshooting complex issues, transforming and entering data into a data pipeline in order for the content to be digested and usable for future projects; Proficiency in Airflow strongly desired
  • Experience designing and implementing advanced to complex data models and experience enabling advanced optimization to improve performance
  • Experience leading a team with Git expertise strongly preferred

Key Skills:

Google Cloud Platform, Python, SQL, Dataflow, Spark, Airflow.

Apply for job