Title: Data Engineering-AWS
Long Description
Position Title: Data Engineer (AWS DMS / Python / Oracle PL/SQL)
Job Summary:
We are seeking an experienced Data Engineer with strong expertise in AWS Database Migration Service (DMS), Python, and Oracle PL/SQL. The ideal candidate will be responsible for designing, developing, and supporting large-scale data migration, transformation, and integration solutions across cloud.
Key Responsibilities
AWS DMS (Primary Skill)
• Design, configure, and manage AWS DMS replication tasks for full-load and CDC.
• Troubleshoot migration issues including latency, table mapping, LOB handling, and replication instance tuning.
• Fine-tune DMS task parameters and validate data consistency post migration.
• Automate monitoring and alerting DMS using CloudWatch, SNS, or Lambda.
Python
• Develop Python scripts for:
o Data validation and reconciliation
o Migration automation workflows
o API integrations and utility tools
• Build ETL/ELT orchestration using Python frameworks or AWS services (Lambda, Glue, Step Functions).
• Write modular, scalable, production-ready code following best practices.
Oracle PL/SQL
• Develop and optimize complex PL/SQL procedures, functions, triggers, and packages.
• Analyze and optimize SQL queries for performance tuning.
• Work closely with DBAs on schema design, indexing, and performance optimization.
• Understanding of Oracle partitioning, materialized views, and transaction management.
General Responsibilities
• Prepare technical documentation including design specs, runbooks, and migration plans.
• Participate in code reviews and ensure adherence to engineering standards.
• Ensure data security, quality, and compliance throughout the migration lifecycle.
Required Skills & Qualifications
• Strong hands-on experience with AWS DMS .
• Proficiency in Python for data engineering & automation.
• Advanced skills in Oracle SQL/PLSQL development.
• Experience with AWS services such as:
o EC2, S3, IAM, RDS, CloudWatch, Lambda.
• Good understanding of ETL/ELT concepts and data modeling.
• Familiarity with Agile/Scrum practices.
Preferred Skills
• Knowledge of Redshift / Aurora / PostgreSQL.
• Exposure to DevOps tools (Git, Jenkins, CI/CD).
• Experience with performance tuning during large-scale migrations.
• Familiarity with Unix shell scripting.
o Mandatory skills
o Practice: Next Generation
o Primary Skill: AWS DMS, Python & Oracle PL/SQL
o Experience: 4-6+ Years of Relevance Experience
o Primary Location: Hyderabad (1), Bangalore (2), Hyderabad (2), Noida (3)
Area(s) of responsibility