Data Engineer at Minerva

About Minerva: Minerva is building the next-gen demand generation platform for consumer brands. We provide companies with a centralized view of the consumer as well as tooling to simplify their existing sales, marketing and customer success infrastructure. Leveraging our proprietary consumer data asset and ontology, we create an observable, wholistic profile of the consumer through time. With this profile as the foundation, we use our decisioning models to power optimal activation throughout the funnel, which drives revenue and commercial efficiency for brands. Minerva creates high ROI outcomes for high-equity brands across industries (e.g. Ramp, JuiceBox, NBA, Miami Dolphins, Wander, Luxury Presence, Trust & Will, Base Power, Shef) and has large-scale distribution agreements with partners such as Experian and Clay. We help these partners sell more product to consumers in less time. Minerva was founded by successful quantitative researchers from Citadel and Bridgewater, and our products / models were built by people from MIT, Stanford, Berkeley and Cambridge as well as engineers / operators from Uber, Samsung Research, Third Point and Lazard. Our Vision and Products: We're not just about data; we're about making data meaningful. Our platform offers enrichment and person search / segmentation tools, first-party & third-party data unification, audience generation, marketing creative analysis, and many more components. AI Agents orchestrate most of these features. We service businesses in two ways: 1) we help them better understand their existing customers and 2) we help them find net-new customers. In practice, we provide our customers with ground truth data and modeled attributes / behaviors about their customers and custom built targeting models. Why Minerva? - Pioneering Technology: Our tech stack is designed to handle complex and diverse datasets, offering a unique blend of robustness and novel utilization. As we continue to evolve, our engineers have the exciting opportunity to work on AI-driven products that are shaping the future - Differentiation Through Data: In a world where reasoning is cheap & the Frontier Labs are absorbing the capabilities of companies, proprietary data stands out yielding more impactful outcomes combined with AI - Revenue and Growth: Minerva has several revenue streams from large institutional contracts as well products tailored to the long tail of customers across verticals - We are Innovating: We’re solving the challenging problem of learning individuals’ behaviors through time For those intrigued by the fusion of AI, people data and real-world applications, Minerva offers an opportunity to be at the forefront of technological innovation. We're building the future of consumer predictive analytics, and we invite you to be a part of this exciting journey. THE ROLE At Minerva, we are a data-first company. We’re looking for a rockstar Data Engineer who’s ready to evolve to the next level - you’ve gotten your hands dirty before and built out a strong foundation but you’re now looking to use your ingenuity to build from scratch and take our data product of 260m+ consumers to the next level. This role is tailor-made for someone who isn’t afraid of constant challenge and change. When a company’s success starts with the data it has, the Data Engineer role inherently has unlimited impact on the business. You’ll work closely with a team of engineers who recognize and appreciate this about Minerva and are working to make success a reality. WHAT YOU’LL DO - Build - Architect and build scalable & robust distributed infrastructure: enabling Spark, Lakehouse, ML, etc. - across a variety of datasets ranging from website visit feeds, professional & property data, identity graph and more - Improve our existing orchestration architecture: we’ve outgrown our SQLMesh/DBT transformation infra and are looking to expand our footprint into higher throughput / scalable solutions. - Data movement: keeping our Snowflake warehouse & Lakehouse in sync with our Postgres, Elasticsearch and other product backend destinations - Build systems to expose our data product to internal and external AI agents (think: MCP, vector DB) - Innovate and Get Creative - The data team at Minerva is constantly inventing new ways to construct various parts of our “data lake” - You will have a great opportunity to innovate on: - How we extract value out of 100+ TB datasets in an unsupervised manner - How we can systematize our pipelines within an ever-growing transformation layer - How we build the right access patterns to leverage data and meet our modeling and product goals - How we can directly monetize our data - Create Value Through Data - Minerva’s data, both derived and modeled, is of tremendous and immediate value for our business. One of your core goals will entail enabling new ways to realize this value and ensuring our existing revenue streams stay in good standing. You’ll often be embedded with other engineering teammates solving various problems around our core data asset or within Minerva’s platform. - Learn more about our modeling processes and assist the Data Science team with feature engineering & ML training infrastructure - Example Projects: - Productionize a multi-faceted pipeline of web traffic data touching LLMs, ML models, Identity Resolution, and Vector Search - Orchestrate large-scale data gathering of publicly available data in a near real-time fashion via web scraping - Build a field- and row-level lineage graph across our data platform, then use it to power a reactive propagation system — when upstream data changes, affected downstream transformations are automatically identified and re-executed in real-time. WHAT YOU’LL NEED - Must-Haves - 2-4+ years working as a data engineer or software engineer in a data-heavy context - simply put, you live and breathe data - Highly proficient at Python and SQL - Strong intuition of data engineering principles, especially those around data cleaning/ingestion and data modeling. We prefer for these core skills to be second-nature to free up thinking for architecting and executing large-scale data initiatives, especially given the advancement of AI coding tools - Willingness to work in office in NYC (we provide a relocation package) - Flexibility and open to wearing several hats - we are lean and things are always changing - Eagerness to learn and grow with the company and your coworkers - Nice-to-Haves - Exposure to different data sources (e.g. APIs, S3, SFTP, WWW, etc.) - Experience with Lakehouse architectures & comfort handling XX+ TB datasets - Experience working with orchestration tools like DBT, SQLMesh and Airflow - Experience working with both transactional databases (e.g. Postgres, MySQL) and analytical databases (e.g. Snowflake, Redshift), with a bias towards the latter. - Familiarity to backend & ML/AI engineering is a plus - Experience working with AI coding tools, e.g. Cursor, Claude Code, OpenCode - Prior work at a startup Note: We encourage candidates who meet most, but not necessarily all, criteria to apply. We believe in the strength of diverse perspectives and are committed to inclusivity. BENEFITS (FOR U.S.-BASED FULL-TIME EMPLOYEES) - 100% medical, dental & vision insurance coverage and more - Unlimited PTO - Parental leave - Relocation support - 1-2 team retreats / year