Python Developer
Ashish KumarUnited StatesSENIORPosted 2h ago
PythonPySparkApache SparkSQLData IngestionData TransformationBatch ProcessingStreaming Data ProcessingData QualityTestingError HandlingRetry MechanismsCI/CDAzure DevOpsJenkinsGitDebuggingSecure CodingSpark Performance Tuning
About the Role
We are looking for a Python Developer to join our team in Jersey City, NJ. This role focuses on developing and maintaining data processing systems using Python and related technologies.
Key Responsibilities
• Develop and maintain Python applications for data processing
• Work with PySpark and Apache Spark for big data processing
• Implement data ingestion and transformation solutions
• Ensure data quality through testing and error handling
• Implement CI/CD pipelines using Azure DevOps or Jenkins
• Perform Spark performance tuning
Requirements
• 10+ years of Python development experience
• Strong expertise in Python, PySpark, Apache Spark, and SQL
• Hands-on experience with data ingestion and transformation
• Experience with batch and streaming data processing
• Knowledge of data quality, testing, error handling, and retry mechanisms
• CI/CD experience with Azure DevOps or Jenkins
• Strong Git, debugging, and secure coding skills