Platform Engineer
Raja KathatUnited StatesMIDPosted 2h ago
AWSLambdaStep FunctionsSQSSNSEventBridgeAPI GatewaySSM Parameter StoreSecrets ManagerECS FargateAWS BatchcontainersAmazon S3S3-compatible APIsrclonePythonboto3DynamoDBVPCDirect ConnectTransit GatewayIAMSTSprivate subnetsS3 Gateway EndpointsCloudWatchGitLabCI/CD pipelines
About the Role
Vantage Point Consulting Inc. is seeking a Platform Engineer to design, build, and operate a secure, scalable migration platform for transferring large volumes of object data from OBSv2 and other S3-compatible storage platforms to Amazon S3.
Key Responsibilities
• Build end-to-end migration workflows using AWS services and rclone
• Develop migration orchestration with AWS Step Functions, Lambda, ECS Fargate, AWS Batch, DynamoDB, and SQS
• Implement batching, sharding, retries, checksum validation, bandwidth controls, and dynamic throttling
• Develop Python-based automation using boto3, JSON processing, and API integrations
• Configure CloudWatch dashboards, logs, metrics, alarms, and migration progress reporting
• Implement secure multi-account deployments, IAM controls, networking, and production cutovers
• Maintain CI/CD pipelines, deployment automation, operational runbooks, and technical documentation
Requirements
• AWS: Lambda, Step Functions, SQS, SNS, EventBridge, API Gateway, SSM Parameter Store, and Secrets Manager
• Compute: ECS Fargate, AWS Batch, containers, and task configuration
• Storage Migration: Amazon S3, S3-compatible APIs, object metadata, and large-scale data migration
• rclone: High-volume transfers, retries, checksums, logging, statistics, and bandwidth limiting
• Python: boto3, exception handling, structured logging, JSON processing, and API integration
• DynamoDB: Data modeling, indexes, batch writes, and migration state management
• Networking & Security: VPC, Direct Connect, Transit Gateway, IAM, STS, private subnets, and S3 Gateway Endpoints
• Monitoring & CI/CD: CloudWatch, GitLab, CI/CD pipelines, and infrastructure deployment
Preferred Experience
• Dell ECS, OBSv2, or other enterprise S3-compatible storage platforms
• Enterprise-scale data migrations in production environments
• Multi-account AWS architectures and hub-and-spoke operating models
• Migration performance optimization, validation, and operational reporting