Senior Data Platform Engineer at 10xgenomics

About the Role Join our Data Platform team at 10x Genomics to architect and implement our strategic Unified Data Platform (UDP). This pivotal role is focused on modernizing our data infrastructure, transitioning to a scalable Event-Driven Architecture (EDA), and building the foundation for next-generation AI/ML and self-service analytics. • Lead the architecture and delivery of the Single Source of Truth (SSOT) for the 10x Intelligent Data Ecosystem. • Apply advanced software engineering practices to data systems for scalability and reliability. • Provide hands-on Senior Data Engineering leadership in developing scalable and maintainable ETL/ELT solutions and data systems in a cloud-native environment. • Drive the systematic reduction of critical technical debt by retiring fragile legacy middleware (e.g., Boomi). • Partner with engineering and business teams to enable advanced AI capabilities and democratize data access via Natural Language Querying (NLQ). What you will be doing • Architect and implement the canonical data layer and Event-Driven Architecture (EDA) using technologies like Apache Iceberg and Kafka to decouple applications and ensure real-time data flow. • Design, build, and optimize high-volume, code-first data pipelines (real-time and batch) across a large application landscape (e.g., Salesforce, Oracle, Workday). • Establish Amazon S3 as the Single Source of Truth (SSOT) and govern data using principles like the Medallion Architecture (Silver and Gold layers) and schema evolution. • Develop, test, and maintain robust and scalable ELT pipelines and data models in Snowflake, including leveraging advanced features like Snowpipes, Streams, and Stored Procedures. • Develop the data presentation layer for self-service analytics, including the Natural Language Query (NLQ) interface integrated with Generative AI (e.g., Bedrock). • Lead technical efforts to migrate key business domains off legacy middleware and onto the new platform, eliminating the "Integration Bottleneck". • Define and enforce data governance, quality, and security standards across the Unified Data Platform. • Collaborate with the Architecture Review Board (ARB) to promote modern approaches such as serverless computing and Domain-Driven Design. • Take ownership of the full development lifecycle, from prototyping and design through deployment, monitoring, and operational excellence. Minimum Requirements • Bachelor’s degree in Computer Science, Information Management, or a related field, or equivalent experience. • 5+ years of hands-on experience in software engineering focused on data platform development, distributed systems, or enterprise integrations. • Proven experience designing and implementing highly scalable data platforms on major cloud environments (e.g., AWS, GCP, or Azure). • Deep proficiency in one or more general-purpose programming languages (e.g., Python, Java, or similar). • Strong foundation in computer science fundamentals, including data structures, algorithms, and system design. Preferred Skills and Experience • Expertise in message queues and event streaming platforms (e.g., Kafka, RabbitMQ, Pub/Sub) and implementing Event-Driven Architecture. • Experience with building data lakes/lakehouses using open formats like Apache Iceberg on cloud storage (e.g., Amazon S3). • Expertise in modern ELT development, data modeling for OLAP/data warehousing using tools like dbt, and advanced Snowflake features (e.g., Snowpipes, Streams, Stored Procedures). • Familiarity with containerization (Docker, Kubernetes) and Infrastructure-as-Code (IaC) principles. • Prior experience in migrating an organization off a traditional iPaaS platform or eliminating legacy middleware. • Experience with Generative AI integration for data access (e.g., NLQ, feature stores). Core Technologies • Snowflake • Python (or Java/Scala) • Event Streaming (Kafka or similar) • AWS (or other major cloud platform) • Apache Iceberg / Amazon S3 • Advanced SQL (including stored procedures, UDFs/UDTFs) • Modern Orchestration tools (e.g., Airflow) Below is the base pay range for this full-time position. The actual base pay will depend on several factors unique to each candidate, including one’s skills, qualifications, and experience. At 10x, base pay is also just one component of the Company’s total compensation package. This role is also eligible for 10x’s equity grants, its comprehensive health and retirement benefit programs, and its annual bonus program or sales incentive program. During the hiring process, your 10x recruiter can share more about the Company’s total compensation package. Pay Range$168,200—$227,600 USDAbout 10x Genomics At 10x Genomics, accelerating our understanding of biology is more than a mission for us. It is a commitment. This is the century of biology, and the breakthroughs we make now have the potential to change the world. We enable scientists to advance their research, allowing them to address scientific questions they did not even know they could ask. Our tools have enabled fundamental discoveries across biology including cancer, immunology, and neuroscience. Our teams are empowered and encouraged to follow their passions, pursue new ideas, and perform at their best in an inclusive and dynamic environment. We know that behind every scientific breakthrough, there is a deep infrastructure of talented people driving the life sciences industry and making it possible for scientists and clinicians to make new strides. We are dedicated to finding the very best person for every aspect of our work because the innovations and discoveries that we enable together will lead to better technologies, better treatments, and a better future. Find out how you can make a 10x difference. Individuals seeking employment at 10x Genomics are considered without regards to race, color, religion, national origin, age, sex, marital status, ancestry, physical or mental disability, veteran status, gender identity, or sexual orientation, or any other characteristic protected by applicable law. 10x does not accept unsolicited applicants submitted by third-party recruiters or agencies. Any resume or application submitted to 10x without a vendor agreement in place will be considered unsolicited and property of 10x, and 10x will not pay a placement fee. Please be aware of recruitment scams impersonating 10x Genomics. All recruiting communication will come from email addresses @10xgenomics.com. We also want to encourage you to apply to 10x Genomics positions directly on our careers site, Careers.10xgenomics.com or from reputable third party sites, such as LinkedIn or Indeed. We will never request payment or sensitive personal information during the recruiting process.