Senior Data Engineer at Lambda

Lambda, The Superintelligence Cloud, is a leader in AI cloud infrastructure serving tens of thousands of customers. Our customers range from AI researchers to enterprises and hyperscalers. Lambda's mission is to make compute as ubiquitous as electricity and give everyone the power of superintelligence. One person, one GPU. If you'd like to build the world's best AI cloud, join us. *Note: This position requires presence in our San Francisco or San Jose office location 4 days per week; Lambda’s designated work from home day is currently Tuesday. About the Job Join our team as a Senior Data Engineer, where you will collaborate with a small high-performing team of Analytics Engineers and Data Engineers to design data pipelines, a data warehouse, an automated data catalog and internal tools. Your output will directly power product analytics, marketing, supply chain, investor relations, and many more. You will have the opportunity to design and implement best practices while working directly with stakeholders. This position reports to the Data Platform Manager. What You’ll Do - Data Pipeline Development: Design, build, and maintain scalable, robust, and efficient data pipelines (ELT) to process large volumes of structured and unstructured data from multiple sources. - Support Business Teams: Use your familiarity with areas such as GTM (Salesforce, Marketing, CRM), Finance and Product to support stakeholder requests and design internal tools that support business processes - Data Architecture: You’ll work with product engineers and system admins to design, document, and build data flows and infrastructure. You will also be a technical subject matter expert and recommend patterns to fix data gaps and ensure data quality - Data Warehousing: Design and manage data warehouses and data lakes, ensuring optimal storage, governance, cataloging, data lifecycle and retrieval performance. - Data Quality & Reliability: Ensure the accuracy and consistency of data across multiple systems, performing regular data quality assessments. Implement testing, CICD and IT General Controls to ensure security and reliability of data flows. - Collaboration: Work closely with business leaders, analysts, and other stakeholders to understand data requirements and deliver appropriate solutions. This will include participating early in product-design discussions, and staying involved with teams across the company. - Automation & Optimization: Automate manual data processes and continuously optimize data workflows for performance, cost efficiency, and scalability. - Technology Evaluation: Stay up-to-date with the latest industry trends, tools, and technologies to improve data engineering practices and infrastructure. - Mentorship: Provide technical leadership and mentorship to junior data engineers, analysts, and business users, sharing best practices and fostering a collaborative team environment. You - Have a technical bachelor’s degree (computer science, information technology, analytics, or similar) that equips you to intersect business intuition with technical skills - Have 5+ years of experience in Data Engineer, Software Engineer, Analytics Engineer or Sr Data Analyst roles - Are interested in being part of a small super-versatile data team that does data engineering, data analysis, and data science at executive, system and project levels - Are willing to roll up your sleeves and do architecture or data janitorial work that can have significant business impact - Are highly proficient in SQL and experience working with large-scale relational databases (e.g., PostgreSQL, MySQL, etc.). - Have extensive experience with cloud data platforms (AWS, GCP, Azure) and related services such as S3, IAM, Redshift, BigQuery, etc. - Have intermediate to advanced experience in Python or similar programming languages. - Have experience with data orchestration tools like Apache Airflow, Prefect, or similar. - Are knowledgeable in data modeling, database design, and performance optimization techniques. - Have a working understanding of data security, privacy, and compliance requirements. - Show a proven ability to work in a fast-paced, agile environment and manage multiple projects simultaneously. - Experience with data modeling in DBT (Data Build Tool) - Knowledge of data visualization tools and BI platforms (e.g., Tableau, Looker, Power BI). - Experience with CICD build tools (gitlab CICD, github actions, jenkins or similar) - General cloud computing proficiency, such as knowledge of compute resources, databases, disk, networking, logging, alerting etc as it pertains to clouds, such as AWS and GCP - Experience in iPaaS tools (e.g. Workato, Zapier, Celigo or similar) Nice to Have - Master’s degree in a technical or analytical discipline or business discipline that supplements a technical undergraduate degree - Experience with Master Data Management (MDM) practices - Experience with IaC tools (Terraform, or similar) - Experience with containerization and orchestration tools (Docker, Kubernetes). - Familiarity with bash. Ability to navigate, and perform basic functions within a Unix shell such as terminal Salary Range Information The annual salary range for this position has been set based on market data and other factors. However, a salary higher or lower than this range may be appropriate for a candidate whose qualifications differ meaningfully from those listed in the job description. About Lambda - Founded in 2012, with 500+ employees, and growing fast - Our investors notably include TWG Global, US Innovative Technology Fund (USIT), Andra Capital, SGW, Andrej Karpathy, ARK Invest, Fincadia Advisors, G Squared, In-Q-Tel (IQT), KHK & Partners, NVIDIA, Pegatron, Supermicro, Wistron, Wiwynn, Gradient Ventures, Mercato Partners, SVB, 1517, and Crescent Cove - We have research papers accepted at top machine learning and graphics conferences, including NeurIPS, ICCV, SIGGRAPH, and TOG - Our values are publicly available: [Upgrade to PRO to see link] - We offer generous cash & equity compensation - Health, dental, and vision coverage for you and your dependents - Wellness and commuter stipends for select roles - 401k Plan with 2% company match (USA employees) - Flexible paid time off plan that we all actually use A Final Note: You do not need to match all of the listed expectations to apply for this position. We are committed to building a team with a variety of backgrounds, experiences, and skills. Equal Opportunity Employer Lambda is an Equal Opportunity employer. Applicants are considered without regard to race, color, religion, creed, national origin, age, sex, gender, marital status, sexual orientation and identity, genetic information, veteran status, citizenship, or any other factors prohibited by local, state, or federal law.