Senior Staff Software Engineer - Data at Deepintent

DeepIntent is leading the healthcare advertising industry with data-driven solutions built for the future. From day one, our mission has been to improve patient outcomes through the artful use of advertising, data science, and real-world clinical data. For more information visit, www.DeepIntent.com. What You’ll Do: In this role, you will take the lead in designing, building, and optimizing data pipelines, ensuring high-quality data integration and real-time analytics. As a Senior Staff Engineer, you will mentor and guide a team of data engineers, collaborate with cross-functional teams, and drive best practices for data architecture and engineering. • Leadership & Mentorship: • Lead and mentor a team of engineers, ensuring technical excellence and continuous improvement. • Provide guidance on complex technical issues, and foster a culture of collaboration and innovation. • Develop and maintain data engineering processes, practices, and standards across the team. • Data Architecture & Engineering: • Design and develop robust, scalable, and efficient data pipelines for ETL (Extract, Transform, Load) processes. • Architect data solutions and ensure seamless integration of data from diverse sources, both on-premise and in the cloud. • Optimize data storage, retrieval, and processing for performance and scalability. • Collaboration & Stakeholder Management: • Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet business needs. • Collaborate with the software engineering team to ensure smooth integration of data pipelines into applications. • Data Quality & Governance: • Ensure data integrity, quality, and consistency across systems. • Implement and enforce data governance policies and best practices, ensuring compliance with data privacy regulations. • Continuous Improvement: • Stay updated with the latest trends in data engineering, big data technologies, and cloud platforms. • Drive automation, testing, and optimisation within data pipelines to improve overall efficiency. • Technology Stack: • Lead the selection and implementation of appropriate technologies for data storage, processing, and retrieval (e.g., Hadoop, Spark, Kafka, Airflow). • Experience working with public clouds like GCP/AWS. • Proficient with SQL, Java, Spring boot, Python or at least one Object oriented language, Bash. • Experience with any of Apache open source projects such as Spark, Druid, Beam, Airflow etc. and big data databases like BigQuery, Clickhouse, etc. Who You Are: • Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or a related field (or equivalent work experience). • 8+ years of experience in data engineering or related roles, with at least 2 years in a leadership or senior technical position. • Extensive experience with data warehousing, ETL pipelines, data modeling, and data architecture. • Strong experience working with large-scale data processing frameworks (e.g., Hadoop, Apache Spark, Kafka). • Proficient in SQL, Python, Java, or other relevant programming languages. • Hands-on experience with cloud-based platforms (AWS, GCP, Azure). • Familiarity with data orchestration tools like Apache Airflow or similar. • Strong knowledge of databases (SQL and NoSQL) and data storage technologies. • Excellent problem-solving and analytical skills. • Strong communication and interpersonal skills, with the ability to work effectively with both technical and non-technical teams. We believe great work starts with great support. That’s why DeepIntent offers a competitive, holistic benefits package designed to empower you both professionally and personally. Here’s what you can expect when you join our team based in the US: Competitive base salary plus performance based bonus or commission, comprehensive medical, dental, and vision insurance, 401K match program, Unlimited PTO policy and paid holidays, remote friendly culture with flexible work options, career development and advanced education support, WFH and internet stipends, plus many more perks and benefits! Here’s what you can expect when you join our team based in India: Competitive base salary plus performance based bonus, comprehensive medical insurance, and paid holidays. Hybrid-friendly culture with flexible work options, professional development reimbursement, WiFi reimbursement and health and wellness allowance plus many more perks and benefits! Here's what you can expect when you join our team based in Europe: Competitive base salary plus performance-based bonus, comprehensive medical insurance, and flexible PTO. Hybrid-friendly culture with flexible work options, professional development reimbursement, WiFi reimbursement, and parental leave plus many more perks and benefits! DeepIntent is committed to bringing together individuals from different backgrounds and perspectives. We strive to create an inclusive environment where everyone can thrive, feel a sense of belonging, and do great work together. DeepIntent is an Equal Opportunity Employer, providing equal employment and advancement opportunities to all individuals. We recruit, hire and promote into all job levels the most qualified applicants without regard to race, color, creed, national origin, religion, sex (including pregnancy, childbirth and related medical conditions), parental status, age, disability, genetic information, citizenship status, veteran status, gender identity or expression, transgender status, sexual orientation, marital, family or partnership status, political affiliation or activities, military service, immigration status, or any other status protected under applicable federal, state and local laws. If you have a disability or special need that requires accommodation, please let us know in advance. DeepIntent’s commitment to providing equal employment opportunities extends to all aspects of employment, including job assignment, compensation, discipline and access to benefits and training. CCPA Notice: If you are a California resident applying for a role at DeepIntent, we may collect personal information as part of the application process in accordance with the California Consumer Privacy Act (CCPA). To learn more about the categories of information we collect and your rights, please contact [Upgrade to PRO to see contact] to see our full Applicant Privacy Notice.