Data Engineer
Datamatics Technologies
Location: UAE-based (Travel required)
Duration: 6-month assignment
Summary (Data Engineer)
Timely, reliable data pipelines are what turn a platform design into business value. The Data Engineer builds and operates the pipelines that move data from source systems into the lakehouse and on to analytics and AI consumers, ensuring that the pipelines are automated, performant, secure and governed. The role works alongside the data architect, data quality engineer, business analysts and AI engineers, delivering production-grade pipelines on Azure / Microsoft Fabric, with metadata and lineage captured in Microsoft Purview.
Responsibilities
- Build batch, incremental, CDC and streaming ingestion pipelines from source systems into the Bronze layer, using Azure Data Factory and Fabric pipelines.
- Develop Silver- and Gold-layer transformations in SQL, PySpark and Spark notebooks, including cleansing, conformance, enrichment and business-rule logic.
- Implement dimensional models, SCDs, surrogate keys and data marts according to the architect's designs.
- Integrate DQ checks, validation, quarantine and reconciliation into pipelines in partnership with the Senior Data Quality Engineer.
- Ensure that pipelines publish metadata and lineage to Microsoft Purview.
- Implement scheduling, dependency management, parameterization, error handling and alerting.
- Optimize pipelines, partitioning, file formats (Delta/Parquet) and compute usage for performance and cost efficiency.
- Apply access controls, masking, encryption and secure credential management in line with UAE PDPL, the Dubai Data Law and DESC ISR.
- Maintain code in source control and deploy through CI/CD pipelines, with automated tests and environment promotion.
- Support production operations, incident resolution and runbooks, and coach counterparts so that the pipelines can be sustained after handover.
Must Have
- 4+ years in data engineering, preferably within UAE government or regulated-sector environments.
- Advanced SQL, Python and PySpark/Spark skills.
- Hands-on experience with Azure Data Factory, Microsoft Fabric, Databricks or Synapse.
- Strong understanding of Lakehouse/Medallion architecture, Delta/Parquet formats and dimensional modelling, including SCDs and surrogate keys.
- Experience with CI/CD (Azure DevOps or GitHub), source control and DataOps practices.
- Familiarity with Microsoft Purview metadata and lineage, and with DQ tooling.
- Awareness of UAE data regulation, including UAE PDPL, the Dubai Data Law and DESC ISR.
- Excellent English communication and documentation skills.
Good to Have
- Arabic proficiency is an advantage.
- ...DeepLight AI is a specialist AI and data consultancy dedicated to transforming the regional corporate landscape through bespoke, high... ...-impact intelligent systems. We combine deep expertise in data engineering, cloud architecture, AI/ML platforms, and systems integration...
- ...world’s largest private investment firms, which is building its data team in Abu Dhabi. This seat sits upstream of everything: if... ...happens. You’ll be the person researchers, investment teams and AI engineers trust to tell them the data is right, and to tell them when it...
- ...About the Role We are looking for a Senior Data Engineer to join our growing data team and take ownership of our financial data warehouse, real-time data platform and data governance initiatives. You will work across DWH architecture, real-time streaming, data quality...
- ...Summary Location: UAE (Abu Dhabi) Contract: 6 months DQ Engineer The organization's analytics, reporting and AI ambitions depend on data that decisionmakers can trust, and the Senior Data Quality Engineer is accountable for making that trust measurable. They...
- ...Deeplight is a specialist AI and data consultancy dedicated to transforming the regional corporate landscape through bespoke, high-impact... ...expertise, cutting-edge cloud architecture, and modern MLOps to engineer secure, scalable, and resilient platforms designed to power...
- ...have the opportunity to work on the core of cutting-edge foundation model training, alongside world-class researchers, data scientists, and engineers, tackling the most fundamental and impactful challenges in AI development. You will participate in the development of groundbreaking...
- ...Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical... ...belong and thrive. Your day at NTT DATA The Network & Security Engineer supports the availability, performance and security of clients’...
- ...Only applications submitted through the portal will be considered. Thank you. About AgentixLake AgentixLake GmbH is a Data and AI engineering consultancy based in Hamburg, Germany. We design, build and operate production-grade data platforms and AI systems in our...Remote job
- ...are seeking a highly skilled and motivated Databricks Platform Engineer to join its core Lakehouse Platform team. This role focuses on... ...automation frameworks, and enterprise integrations that enable ADIA’s Data & AI ecosystem at scale. While the platform supports data...
- ...We're looking for a Senior Data Engineer to join our team in Abu Dhabi, United Arab Emirates in an onsite working mode. This role involves working on a large-scale data platform migration using modern data technologies and building production-ready pipelines in a dynamic...
- ...Position: Data Classification Engineer Location: Abu Dhabi (Onsite) Required Experience: 6+ years Salary Range: AED 15,000-16,000 Summary: We are looking for a Data Classification Engineer to help manage how we organize and secure our data. In this role,...
- ...have the opportunity to work on the core of cutting-edge foundation model training, alongside world-class researchers, data scientists, and engineers, tackling the most fundamental and impactful challenges in AI development. You will participate in the development of groundbreaking...
- We’re looking for an experienced, hands-on Data Engineer who is capable of designing, building, and operating data pipelines and models that power analytics and applications across investment teams and Middle/Back office. The ideal candidate has financial markets familiarity...
- ...DeepLight AI is a specialist AI and data consultancy dedicated to transforming the regional corporate landscape through bespoke, high... ...conform to global and regional banking standards. Drive Engineering Excellence: Write clean, modular, and well-documented Python code...
- ...GW by 2030. To support the development of analytics, AI, and data products while building foundational capabilities, as part of... ...Qualifications: ~ Bachelor’s degree in Computer Science, Data Science, Engineering, or a related field; UAE National (National Talent programme)....
- ...DeepLight AI is a specialist AI and data consultancy with extensive experience implementing intelligent enterprise systems across... ...designed for an expert who can bridge the gap between low-level data engineering and high-level decision intelligence. Your primary objective...
- ...Sr Director – AI Data Leader Field Details Location Dubai Language Preference Arabic ,English Role Summary and Overview... ..., Databricks, GCP and Informatica. Review and validate data engineering pipelines, cloud architecture designs, data platform builds and...
- ...We are building a fast-growing Databricks practice delivering enterprise data and AI solutions across APAC. As Lead Solution Architect – Data Engineering, you will be the technical anchor of the practice: leading solution design on client engagements, owning and defending...
- ...DeepLight AI is a specialist AI and data consultancy dedicated to transforming the regional corporate landscape through bespoke, high... ...expertise, cutting-edge cloud architecture, and modern MLOps to engineer secure, scalable, and resilient data foundations designed to power...
AED17000 - 20000 per month
...Urgent requirement for Senior Data Engineer with experience in Redshift Spectrum & ( Retail Banking ,Corporate Banking & SME Banking) in banking domain is required for our banking clients in Abu Dhabi ,UAE Design and develop enterprise data warehouses, data marts, and...- ...We are seeking a Junior Commissioning Engineer (Mechanical) to support the commissioning of a 200MW data center project. This role assists in the verification, testing, and documentation of mechanical systems to confirm they are designed, installed, and performing in...
- ...JOB PURPOSE As an AVP– Data Science, you will design, build, and productionize advanced analytics and AI solutions that drive... ...classification, clustering, NLP, forecasting). Collaborate with engineering and platform teams to productionize AI models through...
- ...JOB PURPOSE Own the data backbone of the Group: the platforms through which data is ingested, stored, modeled, governed and made... .... Establish end-to-end accountability from data platform engineering to operations, building AI-ready foundations and a self-service...
- About Us Established in 2018, Bybit is one of the world’s leading cryptocurrency exchanges and digital financial platforms, serving over 80 million users across more than 200 countries and regions. Powered by world-class technology and a user-first mindset, Bybit delivers...
- ...We're looking for a Lead Data Scientist to join our team in Abu Dhabi, UAE in an onsite working mode. In this role, you will lead... ...and monitoring Mentor and review the code of data scientists and engineers Present technical direction and solution architecture to...
- ...and P2P partner performance — conversion, cost, failure reasons, settlement reconciliation — and support commercial negotiations with data Deliver data support for regional entities and regulatory requirements, where accuracy standards are externally auditable...
- ...Planning Department to provide advice on required platform stock levels and assessment reports of balance on hand. • Review inventory data and advise the Technical Supply Department of optimal line item stock levels for the main stores. • Facilitate the establishment...
- ...at the forefront of industrial digitalization, building AI and data solutions that solve the world’s hardest, highest-impact problems... ...You will be a part of cross-functional teams that include data engineers, solution architects, and project managers. Together, your...
AED22000 - 25000 per month
...Urgent requirement for Data Architect – Advanced Analytics & Data Intelligence with experience in Redshift Spectrum in Retail, Corporate... .... Business & Analytics Enablement Partner with Data Engineers, Data Scientists, AI/ML teams, and business stakeholders to translate...- The Integration Developer will be responsible for the design, build, testing, deployment and support of market data connectors feeding the Pricing Engine, with a primary focus on Bloomberg B-PIPE and LSEG Real-Time Market Data System (RTMDS). The scope covers real-time...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
