Data Engineer

Employment Details

• Position: Senior Data Engineer
• Employment Type: TEMP-FTE
• Experience Required: 3-5 Years

Job Summary

We are seeking a highly skilled Senior Data Engineer to design, build, and maintain scalable data pipelines and cloud-based data solutions. The ideal candidate will have strong experience with Azure Data Factory, Databricks, ETL processes, and CI/CD practices to support enterprise data integration and analytics initiatives.

Key Responsibilities

• Architect and implement high-performance ETL/ELT pipelines using Azure Data Factory.
• Optimize data workflows for cost, speed, and scalability.
• Ensure data quality, lineage, and security across systems.
• Establish CI/CD, monitoring, and documentation standards for data engineering.

Must-Have Skills

• Azure Data Factory (ADF).
• Experience building and maintaining scalable data pipelines.
• Strong experience with Cloud Data Services, especially Databricks.
• Experience with ETL/ELT tools.
• Experience implementing and managing CI/CD pipelines.

Good-to-Have Skills

• Strong SQL and Python and/or Scala programming skills.
• Experience with Snowflake, Synapse Analytics, Redshift, or BigQuery.
• Experience with Airflow, dbt, Glue, Talend, or Fivetran.
• Knowledge of Kafka or Kinesis.
• Experience with Git, data quality, data lineage, and data governance practices.
• Knowledge of partitioning, performance tuning, and incremental loading.
• Experience with Azure DevOps, Docker, Kubernetes, or Terraform.
• Exposure to Data Lake and Lakehouse architectures.

Education

• Minimum bachelor's degree in computer science, Information Technology, Software Engineering, Data Science, Computer Engineering, or a related discipline.