Data Engineer - ETL Migration & Pipeline Development
Remote
Only USC
We are seeking a Data Engineer contractor (100% remote) to support and execute the migration of ETL pipelines from Matillion to Apache Airflow. This role focuses on rebuilding pipelines, improving reliability, and enabling scalable, code-based data workflows.
This is a hands-on role requiring someone who can ramp quickly, work with existing ETL logic, and contribute within the first 1–2 weeks.
Responsibilities:
· Migrate existing ETL pipelines from Matillion to Apache Airflow while preserving logic and dependencies
· Develop and maintain Airflow DAGs with proper scheduling, retries, and failure handling
· Reverse engineer existing Matillion jobs and translate them into Python-based workflows
· Build and optimize data pipelines across systems such as S3, Snowflake, and relational databases
· Perform data validation and reconciliation between source and target systems
· Write and optimize SQL transformations for large-scale datasets
· Implement monitoring, alerting, and error handling for pipelines
· Collaborate with data, platform, and analytics teams to ensure smooth migration and deployment
· Document pipelines, workflows, and operational processes
Required Qualifications:
· 8+ years of experience in Data Engineering or ETL development
· Strong hands-on experience with Apache Airflow or similar orchestration tools
· Proficiency in Python for building data pipelines and workflows
· Strong SQL skills and experience working with large datasets
· Experience with cloud platforms (AWS preferred: S3, RDS/Aurora, IAM)
· Experience with cloud data warehouses (Snowflake preferred or similar)
· Experience building and maintaining ETL/ELT pipelines
· Familiarity with Git and CI/CD workflows
Preferred Qualifications:
· Experience migrating ETL workflows from tools like Matillion, Informatica, Talend, or SSIS to Airflow
· Experience with Airflow in containerized environments (Docker, Kubernetes/EKS)
· Familiarity with data validation, reconciliation, and pipeline testing strategies
· Experience with monitoring tools such as Datadog or CloudWatch
· Understanding of data modeling or medallion architecture
--You received this message because you are subscribed to the Google Groups "Daily C2C distribution list" group.
To unsubscribe from this group and stop receiving emails from it, send an email to daily-c2c-distribution-list+unsubscribe@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/daily-c2c-distribution-list/cf0d40eb-596a-48ac-9548-091219f9014cn%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
