Flink Engineer

VeridianTech Logo
  • Environmental
  • FlexTime

Job Title:Flink Engineer

Location:Mountain View/ San Diego, CA

Duration:12+ months

Must have:

  • Expertise in Apache Flink
  • Strong programming skills in Java or Scala and SQL
  • Knowledge of stream processing and batch processing
  • Experience working with Apache Kafka.
  • Proven experience with projects in Apache Flink production Java or Scala
  • Knowledge of relational databases.
  • Knowledge of MPP like AWS Athena
  • Knowledge of HIVE
  • Experience of AWS cloud services

What You’ll Do:

  • Work on writing new data pipelines.
  • Debug and optimize existing data pipelines.
  • Analyze pipelines consuming high resources or having high execution time and optimize as needed
  • Implementation for automating pipeline management and metrics setup for observability
  • Gather requirements, work on high level design, implement (code) and deliver efficient and scalable DW solutions in high data growth environment
  • Oversee team activities related to coding, unit testing, system testing, resolve defect originating during system test and deploy the fixes for the defects when needed