Data Platform Engineer
Dev S.RemoteSENIORPosted 12d ago
HBaseEMRSparkAWSAmazon EMRHadoopApache SparkS3ScalaApache PhoenixHivePrestoIcebergKerberosAWS KMS
About the Role
We are looking for an experienced Data Platform Engineer to support a large-scale data platform modernisation and migration programme. This role requires strong hands-on production experience in HBase, Amazon EMR, Hadoop, and Spark.
Key Responsibilities
• Support a large-scale data platform modernisation and migration programme
• Work on real-world Big Data platform migrations, cluster-level troubleshooting, production cutovers, and data integrity validation
• Collaborate with the team to ensure smooth data migration and platform modernisation
Requirements
• 5+ years of experience in Data Engineering / Big Data Engineering
• Strong hands-on production experience with HBase and Amazon EMR
• Solid expertise in Apache Spark, Hadoop ecosystem, and Scala and/or Spark programming
• Experience with AWS data platforms and Amazon S3
• Proven experience in HBase/EMR migration or platform modernisation
• Hands-on experience with production data migration, cutover, rollback, and post-migration validation
• Strong troubleshooting skills across distributed data platforms
Good to Have
• Experience with HBase 1.x / 2.x and EMR 5.x / 7.x
• Knowledge of HBase Snapshot, ExportSnapshot, HFiles, and Coprocessors
• Familiarity with Apache Phoenix, Hive, Presto, or Iceberg
• Experience with Kerberos, AWS KMS, encryption, and checksum-based data validation
• Large-scale enterprise data platform modernisation experience