Senior Databricks Data Engineer: Lakehouse Pipelines
Luxoft
A leading technology firm is seeking a Senior Data Engineer in Abu Dhabi to develop and optimize scalable data pipelines for investment analytics. The candidate will utilize expertise in Databricks and PySpark while working with financial datasets, enhancing data availability for portfolio management. This role requires advanced skills in cloud platforms and SQL for efficient data handling. Join a dynamic team to drive efficient data solutions aligned with financial industry standards.
#J-18808-Ljbffr
Vacancy posted 21 hours ago
Similar jobs that could be interesting for youBased on the Senior Databricks Data Engineer: Lakehouse Pipelines in Abu Dhabi vacancy
- We are seeking a Senior Data Engineer with strong hands-on expertise in Databricks, PySpark, and cloud-based data platforms to support the development, migration... ...on building and maintaining scalable data pipelines and lakehouse data models that support investment analytics...
- ...are seeking an experienced Senior Data Engineer with 8–10+ years of... ...modern data platforms, data pipelines, and cloud-based analytics... ...lake, data warehouse, and lakehouse architectures to support analytics... ...workloads. Experience with Databricks , Delta Lake, and...
- ...Position Overview As a Data Engineer, you will play a crucial role... ...and efficiency of our data pipelines, enabling our organization to... ...a leadership position as a Senior Data Engineer or similar, with... ...Logic Apps, Azure Functions, Databricks Jobs, Airflow etc.)...
- ...DataOps Consultant - Lakehouse Support. The... ...management for Lakehouse data platforms in an... ...across data pipelines, coordinates with platform engineering, Data Engineers and... ...work with DeltaLake, Databricks environment. Proven... ...Seniority Senior...
- ...Services is hiring Azure Data bricks - Lead (Airline Project... ...and manage a team of Data Engineers, providing technical... ...optimize large-scale data pipelines using Azure Databricks and PySpark. Architect... ...implement modern data lake and lakehouse solutions using Azure Data...
- ...JOB PURPOSE As a Senior Associate – Data Scientist, you will design,... ...). Collaborate with engineering and platform teams to productionize... ...through reproducible pipelines and CI/CD workflows.... ...Experience working in Databricks or equivalent data and ML...
- ...We are seeking a Data Engineer (Innovation) with 6+ years of experience to design, develop and maintain data pipelines to support AI initiatives. Requirements: Collaborate with data scientists to understand requirements and ensure data availability and quality....
- ...foundation model training, alongside world-class researchers, data scientists, and engineers, tackling the most fundamental and impactful challenges... ..., LLM-generated content refinement, and robust data pipelines, primarily leveraging Python and related technologies....
- The Senior Engineer - Data Governance & Platform Lead (IB&M) is a hands-on senior technical role responsible for defining, implementing... ...Drive governance capabilities across the Lakehouse architecture (ADLS, Databricks, Delta Lake) Define platform...
- ...Title: Specialist Pipeline Engineer - Offshore FEED Project Belong, Connect, Grow, with KBR! The KBR team of teams delivers future... ...Evaluate seabed conditions, route surveys, and geotechnical data. Documentation & Reporting Review pipeline design basis...
- ...team and help transform complex military data into actionable insights that support... ...You will work at the intersection of data engineering, Artificial Intelligence (AI) including... ...unified workflows Data Transformation & Pipelines: Design and manage pipelines using low/...
- ...across all scales. The foundation of this vision begins today as we engineer the virtual cell to model and simulate the fundamental unit of... ...Alto, with satellite offices in Paris and Abu Dhabi. As our data ingestion needs grow, we are looking for a Bioinformatics Data...
- ...applications. As part of our engineering team, you will operate at the... ...scale. The Role As a Senior MLOps Engineer , you will design... ..., inference, and deployment pipelines. You will take ownership of the model lifecycle — from data ingestion to real-time serving...
- ...foundation model training, alongside world-class researchers, data scientists, and engineers, tackling the most fundamental and impactful challenges in... ...the next generation of AI pioneers. The Role The Senior Fullstack Engineer will play a central role in developing...
- ...DESCRIPTION Wood is currently recruiting for an experienced Senior Commissioning Engineer to be based at site for ADNOC Onshore client to join us... ...Experience in gas processing plants, gathering systems, pipelines, utilities, and associated facilities. ~ Strong...
- ...contractor for more than a half century in the Engineering, Procurement and Construction (EPC)... ...constantly growing and are currently looking for Senior Welding QC Engineer to join a top... ...analysis and evaluation of test data related to Welding activities. Prepares...
- ...are seeking a highly skilled Data & Analytics Specialist to... ...degree in Computer Science, Engineering, Applications, or a related field... ...sources like SQL Server and Lakehouse. ~ At least 3 years of hands... ...with Azure services like Databricks, DevOps, Data Lake, and Storage...
- ...foundation model training, alongside world-class researchers, data scientists, and engineers, tackling the most fundamental and impactful challenges in... ...the next generation of AI pioneers. The Role As a Senior Quality Assurance Engineer , you will play a critical...
- ...become part of a global team of over 50,000 planners, designers, engineers, scientists, digital innovators, program and construction... ...Description AECOM is seeking a highly skilled and experienced Senior Mechanical Engineer to join our Buildings & Places (B&P)...
- Senior Project Engineer Working Location: Abu Dhabi, UAE Contract Type: Permanent Key Responsibilities - Assist the project to meet its... ...performance indicators (KPIs). - Establish systems to collect data and measure the project's metrics and key performance...
- ...Senior DevOps Engineer Location: Onsite – Abu Dhabi, UAE Job Overview We are seeking a highly experienced and motivated Senior DevOps... ...● Design, implement, and maintain robust CI/CD pipelines using Azure DevOps for enterprise-scale applications. ● Manage...
- ...Qualification Requirement Having a total experience of min. 5 years in the Oil & Gas industry (In Pipeline). Knowledge of API 1104 and CRA Welding is mandatory. Engineering / Diploma in Mechanical. CSWIP 3.1 or AWS-CWI; Min 2yrs after certification. Good...
- ...benchmarks in construction and project delivery. Job Description We are seeking an experienced Materials & Procurement Engineer to join our head office in Abu Dhabi. As part of the Procurement Department, this role is responsible for sourcing, evaluating,...
- ...We are seeking an AI Engineer (Innovation) with 6+ years of experience... .... Develop scalable AI pipelines and integrate AI models with... ...platforms. Collaborate with Data Engineers, Data Scientists, Product... ...Azure AI Services, Azure Databricks, Azure Machine Learning,...
- ...we set new benchmarks in construction and project delivery. Job Description Role Overview We are seeking a Senior Planning Engineer with strong experience in both Contracting and PMC/Consultancy environments to manage and oversee project planning, controls...
- ...benchmarks in construction and project delivery. Job Description Role Overview We are seeking a highly experienced Senior Planning Engineer to lead planning, scheduling, and progress control activities across construction projects. The role requires strong...
- ...become part of a global team of over 50,000 planners, designers, engineers, scientists, digital innovators, program and construction... ...Description We are seeking a highly skilled and experienced Senior Resident Engineer to join our dynamic team in Abu Dhabi, United...
- ...Job Purpose The Asset Data & Reliability Engineering Specialist is responsible for the integrity, coordination, and governance of data across all... ...Any other duties that may be assigned by the reporting Senior Data Intelligence Manager. Qualifications & Experience...
- ...We are looking for a Senior PVV Engineer for one of our clients with the following details: Start: July 2026 Duration: 12 months, renewable Location: Based Abu Dhabi with mission in Iraq Scheme: Residential Qualifications & Experience Required ~ In PVV...
- ...development of analytics, AI, and data products while building... ...of analytical models and data pipelines across key use cases Assist... ...models under guidance from senior team members Perform data... ...Computer Science, Data Science, Engineering, or a related field; UAE...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Databricks Data Engineer: Lakehouse Pipelines. Be the first to apply!
