Loading...
SeniorFull-timePythonAWSGitAIAPI
Salary Range
€39,545 - €62,142 /year
About the Role
We are seeking a Data Engineer to join our team at Sword Health, a company revolutionizing healthcare through AI. You will play a key role in architecting a scalable lakehouse by migrating workloads to Apache Iceberg, developing a Jobs API, and building Spark/Flink pipelines.
Key Responsibilities
- →Spearhead the migration of existing workloads to the Iceberg format, establishing and maturing the foundational lakehouse architecture.
- →Architect and construct robust batch and streaming data pipelines utilizing Spark and Flink technologies.
- →Collaborate closely with the Backend Engineering team on API integrations and the establishment of formal data contracts.
- →Contribute to the development of a unified lineage and governance framework utilizing DataHub.
- →Provide comprehensive support to the Core Team in the successful adoption of new data platform capabilities.
Requirements
- ✓Demonstrated proficiency with Python and PySpark.
- ✓Hands-on experience with data lake formats (e.g., Iceberg, Delta Lake, or Hudi).
- ✓Solid understanding of Kafka and event-driven architectures.
- ✓Experience in building and orchestrating data pipelines at scale.
- ✓Strong SQL proficiency and comprehensive data modeling knowledge.
- ✓Familiarity with workflow orchestration tools (e.g., Airflow, Dagster, or similar).
- ✓Platform-oriented mindset: developing solutions for broad organizational use, not solely individual purposes.
- ✓Ownership mentality: committed to seeing problems through to resolution.
- ✓Clear communication skills: ability to articulate complex technical concepts to non-technical stakeholders.
- ✓Highly collaborative: excels in working alongside backend engineers, data engineers, and analysts.
- ✓Pragmatic approach: adept at balancing ideal solutions with practical delivery timelines.
Benefits
- ★A stimulating, fast-paced environment with lots of room for creativity.
- ★A bright future at a promising high-tech startup company.
- ★Career development and growth, with a competitive salary.
- ★The opportunity to work with a talented team and to add real value to an innovative solution with the potential to change the future of healthcare.
- ★A flexible environment where you can control your hours (remotely) with unlimited vacation.
- ★Access to our health and well-being program (digital therapist sessions).
- ★Remote or Hybrid work policy.
