Data Engineer (Cyber Security)
Rahul DandriyalUnited StatesSENIORPosted 13d ago
CybersecurityCRIBLVectorDatadogSplunkJavaScriptPythonGroovyOpen Cybersecurity Schema Framework (OCSF)SnowflakeADXLog AnalyticsAnvilogicKafkaHTTPEvent HubsBlob StorageSSL/TLSclient authenticationinput validation
About the Role
We are seeking Senior Data Engineers to lead efforts in orchestrating and transforming complex security telemetry data flows. This role focuses on high-level architecture and ensuring secure and reliable movement of data between systems, particularly for legacy and non-standard log sources.
Key Responsibilities
• Lead the architecture, design, and implementation of scalable, modular, and reusable data flow pipelines using Cribl, Vector, and other open-source platforms
• Develop platform-agnostic ingestion frameworks and template-driven architectures to enable reusable ingestion patterns
• Spearhead the adoption of a schema normalization strategy, leveraging the Open Cybersecurity Schema Framework (OCSF)
• Design and implement custom data transformations and enrichments using scripting languages
• Ensure full end-to-end traceability and lineage of data across the ingestion, transformation, and storage lifecycle
• Collaborate with observability and platform teams to integrate pipeline-level health monitoring
• Oversee and validate data integration efforts, ensuring high-fidelity delivery into downstream analytics platforms
• Lead technical working sessions to evaluate and recommend best-fit technologies for managing security telemetry data
Requirements
• 8+ Years of experience working in Cybersecurity
• 5+ Years of experience on CRIBL/Vector/Datadog/Splunk or other data pipeline platforms
• 5+ Years of experience on JavaScript, Python, or other scripting language