Data Engineer
Tejaswini GangulaRemoteMIDPosted 13d ago
SQLPythonPySparkAWS S3AWS GlueAthenaLake FormationAWS Step FunctionsAWS LambdaLarge-scale data processingPipeline developmentAPIBatch data ingestionData quality checksData reconciliationData modellingPartitioningMetadata managementLineage trackingIdentity mapping
About the Role
NexziByte Solutions is seeking an experienced Data Engineer for a remote client-side opportunity. This role involves building and maintaining scalable data pipelines and preparing reliable datasets for analytics and machine learning.
Key Responsibilities
• Build and maintain scalable data pipelines
• Implement data ingestion, validation and reconciliation processes
• Manage data quality, metadata, lineage and modelling
• Prepare reliable datasets for analytics and machine learning use cases
Requirements
• 5–7 years of experience
• AWS certification through the official AWS platform
• SQL, Python and PySpark
• AWS S3, Glue, Athena and Lake Formation
• AWS Step Functions and Lambda
• Large-scale data processing and pipeline development
• API and batch data ingestion
• Data quality checks, reconciliation and data modelling
• Partitioning, metadata management and lineage tracking
• Identity mapping and preparing data for analytics/ML consumption