Hadoop Admin (CANADA BASED CANDIDATES ONLY)
- Install, configure, and maintain Hadoop clusters (HDFS, YARN, Hive, HBase, Spark, etc.)
- Experience with Java and frameworks like Spring
- Experience developing multi-threaded applications and developing Micro Services using modern technology stack
- Monitor cluster performance and troubleshoot issues related to hardware, software, and network
- Implement and manage data security and access controls
- Perform capacity planning and cluster scaling
- Automate routine tasks using scripting (Shell, Python, etc.)
- Collaborate with development teams to integrate Java-based applications with Hadoop
- Optimize MapReduce, Spark, and other data processing jobs
- Ensure data backup, recovery, and disaster recovery planning
- Maintain documentation for configurations, procedures, and troubleshooting