Data Engineer
KBC Technologies
Location: Dubai, UAE Notice Period: Immediate to Max 30 Days
Experience: 5+ Years Key Responsibilities:
– Build and maintain scalable ETL pipelines using PySpark on Cloudera Data Platform (CDP)
– Ingest data from RDBMS, APIs, and file systems into CDP
– Cleanse and transform large datasets to support business needs
– Optimize performance of PySpark jobs and Cloudera components
– Automate workflows with Apache Oozie / Airflow
– Collaborate with analysts, PMs, and engineering teams
– Ensure data quality, validation, and thorough documentation Must-Have Skills:
– Strong hands-on expertise in PySpark (RDDs, DataFrames, optimization)
– Experience with Cloudera Manager, Hive, Impala, HDFS, HBase
– Proficiency in SQL, ETL processes, and big data tech
– Knowledge of orchestration tools like Oozie/Airflow
– Solid scripting in Linux Looking for someone analytical, detail-oriented, and collaborative.
If you’re passionate about data and ready for your next challenge, we want to hear from you!
Experience: 5+ Years Key Responsibilities:
– Build and maintain scalable ETL pipelines using PySpark on Cloudera Data Platform (CDP)
– Ingest data from RDBMS, APIs, and file systems into CDP
– Cleanse and transform large datasets to support business needs
– Optimize performance of PySpark jobs and Cloudera components
– Automate workflows with Apache Oozie / Airflow
– Collaborate with analysts, PMs, and engineering teams
– Ensure data quality, validation, and thorough documentation Must-Have Skills:
– Strong hands-on expertise in PySpark (RDDs, DataFrames, optimization)
– Experience with Cloudera Manager, Hive, Impala, HDFS, HBase
– Proficiency in SQL, ETL processes, and big data tech
– Knowledge of orchestration tools like Oozie/Airflow
– Solid scripting in Linux Looking for someone analytical, detail-oriented, and collaborative.
If you’re passionate about data and ready for your next challenge, we want to hear from you!
Vacancy posted 18 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in United Arab Emirates vacancy
- Job Title: Data Scientist Engineer Location: Kuwait Client: IoT Vendor Job Summary: We are seeking a highly skilled Data Scientist Engineer with over 5 years of experience in data science or machine learning engineering. The successful candidate will be responsible...
- ...about people who create bold things, make a difference, have fun, and love their work. Big Data & Analytics Center of Excellence is a data consulting and data engineering branch at SoftServe. Starting as a group of three enthusiasts back in 2013, hundreds of Data Engineers...
- ...instrumental in designing, building, and maintaining high-performance data pipelines and infrastructure specifically tailored for AI and... ...* Collaborate closely with AI Scientists and Machine Learning Engineers to understand their data needs, optimising data formats,...
- ...4 May 2025 Location: Sri lanka, AE Company: Information Systems Associates - Sri Lanka (ISSL) Job Purpose As a Data Science Engineer, you will be at the forefront of leveraging advanced analytics and engineering solutions to drive data-driven insights within...
- ...seeking your next big opportunity, we are committed to making the connection that drives success. The Role ???? We're Hiring: Data Engineer – Join Luxe Vision Consulting! ???? Are you a skilled Data Engineer looking to work with top US companies Luxe Vision...
- ...exceptional service and quality products to its clients worldwide. We are leveraging data and AI to revolutionize the way aviation parts are sourced, sold, and managed. Position: AI & Data Engineer Are you a technically brilliant and self-directed developer with a...
- ...the world. And we're proud of it. It's our driving force — our engine. From building a new financial backend to creating an innovative... ...the world. At Revolut, we pride ourselves on how truly data-driven every department of the company is. Data platform engineers...
- ...Are you an expert in Engineering Engineering Expert AI Data Trainer Join the team powering the next generation of AI language models. Why This Matters Large‑scale Language Models Are No Longer Just Clever Chatbots—they're Becoming Powerful Engines For Mathematical...
- ...Job description / Role Job description The AI/Data Consultant will provide expert guidance on the design, development, and deployment... ...applications. This role requires hands-on expertise in data engineering, AI/ML model development, and healthcare interoperability...
- Requirements: Proven experience as a Data Entry Clerk or in a similar role Experience working with ERP systems (preferably construction-related) Strong attention to detail and high level of accuracy Proficient in MS Office Suite, especially Excel
- Job Position – Data Center Administrator Company Name – EEMC With 12+ years in managing server infrastructure, virtualization, monitoring tools, and network security. Must be skilled in Linux and Windows Server, disaster recovery, and ensuring system uptime.
- ...Job description / Role Job description The Director - Data & AI will lead the strategic vision and execution of data and artificial... ...Mentor and guide teams in adopting best practices for data engineering, AI development, and DevOps processes. Develop and maintain...
- ...Job Description GEMS Wellington Academy, Al Khail are looking for an experienced Data Manager to join the Primary team. This role offers a key opportunity to shape and support data strategy within FS and Primary at GEMS Wellington Academy – Al Khail. As Data Manager...
- ...Role You will be instrumental in establishing and leading the Data Science function from the ground up, driving the end-to-end strategy... ...predictive modelling, customer segmentation, recommendation engines, pricing optimisation, and fraud detection. * Apply advanced machine...
- ...$3.3 billion. We are seeking a highly skilled and motivated Data Scientist to join our Data Science stream in Risk Department... ...2 years of experience in roles such as Data Scientist , ML Engineer , or Risk Analyst , with a proven track record of impactful contributions...
- Data Analyst Job Location : UAE Job Details : • Experience in employee recruitment and selection • Understanding of sourcing strategies and recruitment tools • Excellent communication skills and interview abilities • Knowledgeable in MS Office and HR Administration...
- ...basis you will be responsible for: Apply industry best practices and innovative methods to identify financial crime risks using data driven analysis on a risk based approach to identify and mitigate financial crime risks Collect and analyze intelligence from internal...
- ...Job description / Role • Maintain Laverae’s data source inventory and ensure accurate data model mapping. • Data transformation logic and data quality rules. • Document data mapping, including dictionaries, ER diagrams, and metadata. • Collaborate with Data Architects...
- Key Responsibilities: – Data Analysis – Collect and analyze structured and unstructured data from various sources (e.g., CRM, ERP... ..., and logic. – Collaborate with data architect and Data Engineers to align data pipelines and data modeling for the overall data...
- ...libraries (e.g., scikit-learn, Pandas, NumPy, TensorFlow) for data modeling and experimentation • Collaborate with stakeholders to... ...to both technical and non-technical audiences • Work with data engineers to optimize data pipelines and ensure model deployment readiness...
- Data Migration Developer - Dynamics 365 CRM Job Location : United Arab Emirates Job Details : • 5+ years of experience in SQL Server development environment • Design, build, and deploy effective data migration frameworks • Knowledge of SQL coding standards,...
- ...Analyze large and complex datasets to uncover trends, insights, and business opportunities • Write efficient and scalable SQL queries for data extraction, transformation, and reporting • Utilize Python (e.g., Pandas, NumPy, matplotlib) for data cleaning, exploration, and...
- ...The Main Event: What you'll do We are seeking an innovative Data Scientist to join our advanced AI team. In this role, you will... ...Collaboration & Communication: Work closely with data engineers, software developers, and business stakeholders to ensure seamless...
- ...models that drive predictive analytics, workforce forecasting, and data-driven policy-making. Your expertise in machine learning, deep... ...& Financial Services Procurement Property & Construction Engineering & Supply Chain Oil & Gas Technical and Engineering Human Resources...
- **Must be able to start immediately Our client is looking for a Data Scientist with experience in AI-based pricing, revenue management, and commercial pricing models. You'll develop and optimize data-driven pricing strategies to drive revenue and profitability....
- ...technical departments and projects. Collaborate closely with discipline engineers, subject matter experts, and other stakeholders to produce adaptive AI systems capable of evolving with additional data. Lead brainstorming sessions and technical workshops to identify...
- ...Job description / Role Purpose of the job The senior data scientist will play a key role in advancing and operationalizing the... ...~ Bachelor's or master's degree in data science, petroleum engineering, computer science, or a related discipline. ~5-7 years of relevant...
- DATA ENTRY DATA ENTRY , DOCUMENTATION, IT COMPUTER SKILL
- Location: Dubai Salary: AED 12,000 – 14,000 Are you a data wizard with a passion for education and systems optimization? Join team and help streamline data systems across schools for better insights and decision-making! What You’ll Do: -Manage and enhance School...
- ...Job Description As Data Executive you will play a key role in managing promoting good attendance and punctuality across the school. You will monitor and track student attendance daily, follow up on absences, liaise with parents and staff, and ensure accurate records...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
