Loading...
Mid LevelFull-timePyTorchAIML
Salary Range
$61,200 - $82,800 /year
This salary is estimated based on similar roles. The actual salary may vary.
About the Role
We are looking for a Data Engineer to join the Foundational team at Harmattan AI, a defense prime building autonomous systems. You will build and maintain high-performance data infrastructure to support deep learning models, managing terabytes of video data.
Key Responsibilities
- →Build ETL/ELT pipelines for Electro-Optical (EO) and Infrared (IR) video data
- →Develop algorithms for sensor synchronisation and alignment
- →Architect storage-to-GPU pipelines for multi-node training clusters
- →Write distributed data processing jobs using tools like Apache Spark
- →Implement automated quality checks and data versioning
- →Assess and implement advanced storage solutions
Requirements
- ✓BS or MS in Computer Science, Software Engineering, or Distributed Systems
- ✓5-6+ years of experience with terabyte-scale data pipelines
- ✓Proven track record of optimising multi-node GPU utilisation
- ✓Strong command of distributed computing tools (Spark, Ray, Beam)
- ✓Experience with ML data versioning tools (DVC, Apache Iceberg, Pachyderm)
Free to sign up. Takes 30 seconds.
