Senior Python Engineer: Web Crawling & Data Pipelines
Remotedxb
Tekmetric is seeking a senior data engineer to design and build large-scale crawling bots and data pipelines. You will extract data from web pages, documents, PDFs, and APIs, unify diverse documents into a coherent schema, and expose structured data via Elasticsearch/OpenSearch.
Collaborate with ML/NLP teams to preprocess data for classification, use LLMs to find precise answers in OEM repair procedures, and deploy solutions with Airflow, Kubernetes on AWS, and Spark on EMR.
#J-18808-LjbffrVacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Python Engineer: Web Crawling & Data Pipelines in Dubai vacancy
- ...Data Scientist (Data Quality & Pipelines) Experience: 7+ years Location: Dubai, UAE... ...Our client is seeking a senior Data Scientist to design... ...transformation pipelines (Python, SQL, Azure Data Factory)... ...Responsibilities: - Data Pipelines & Engineering: Build and maintain...
- ...will design, develop, and apply advanced data science, statistical, and machine learning... .... Working closely with customers, engineers, and product teams, you will build production... ...Applied AI with excellent proficiency in Python and SQL. Experience with machine learning...
- ...achieve their financial goals. Role Overview We are seeking a Senior Data Analyst to join our Quantitative Dealing team and take... ...issues and implement sustainable long-term solutions. Use Python and SQL to extract, transform, validate, and analyze large datasets...
- ...Job Title – Python Backend Developer Location: Dubai, UAE... ...practices . Experience working with data-intensive platforms, product... ...code following software engineering best practices.... ...Cloud . Support CI/CD pipelines and automated deployment processes...
AED15 - 18 per month
...has partnered with TalentOne to find a Data Engineer (Software Engineer, Data) to join their... ...and maintain batch and streaming data pipelines that power fraud detection, recommendation... ..., Spark (Data bricks), Airflow, and Python to deliver scalable, production-ready data...- ...Position: Senior Full Stack Web Developer Department: Development Department... .... Own and manage CI/CD pipelines, including automated... ....js, Express, or NestJS Python or PHP/Laravel experience is... ...needed. A modern, AI-forward engineering culture. Opportunity to...
- ...control enterprises require. Sitting above data platforms, cloud infrastructure, and AI... ...and run it as a true business performance engine delivering measurable value. For more,... ...the visual tools, our team primarily uses Python and SQL, with occasional work in other languages...
- We're not hiring a security engineer to keep up with threats. We're hiring... ...challenging week is a scoped web app pentest with a checklist,... ..., Kubernetes, and CI/CD pipelines, identifying misconfigurations... ...your own tooling and implants in Python, Go, or Rust. Not just running...
- ...will design, develop, and apply advanced data science, statistical, and machine learning... .... Working closely with customers, engineers, and product teams, you will build production... ...Applied AI with excellent proficiency in Python and SQL. ~ Experience with machine learning...
- ...Role Summary The Senior Manager, Data Protection and ESG is accountable for the design, implementation and continued effectiveness of the Group... ...an Enterprise-wide Consent Management (ECM) system covering web, mobile, branch, call centre and third-party channels....
- ...deterministic and classical ML pipelines (and increasingly, AI... ...a team of roughly 5–7 engineers and QAs, growing them... ...and AI work — turning data scientists'... ...Deep technical command of Python and asynchronous programming... ...Experience with Python web frameworks, particularly...
- ...trade execution and API functionalities. Required Skills: Proven experience in Node.js or Python development. Strong understanding of SQL databases and Redis for data management. Experience with decentralized exchange systems and cross-chain protocols is a...
- ...Position: Data Classification Specialist Location: Abu Dhabi (Onsite) Required Experience: 7-8 years Summary: We are looking for a Data Classification Specialist to help manage how we organize and secure our data. In this role, you will make sure that our data...
- ...sits within Careem's Data Science organization and... ...Careem. As one of the senior technical leads on... ...building knowledge graph pipelines that power candidate generation... ..., Mathematics, Engineering, or Computer Science.... ...experience in Python, SQL, Spark, and Hive....
- ...About the Role We're looking for a Senior Software Engineer to join the team building the services... ...observability, and iteration based on production data. Build new services and features... ...managers, designers, and mobile/web engineers to translate requirements into...
- ...Web Content Coordinator A reputable company is seeking a detail-oriented Web Content Coordinator to manage website content, update digital information, and support online operations. Freshers are welcome to apply. Responsibilities Update website content and pages...
- ...A reputable company is seeking a dedicated Web Developer to design, develop, and maintain responsive websites and web applications. Candidates with knowledge of modern web technologies are preferred. Responsibilities Develop and maintain company websites Write...
- ...architecture and implementation across data pipelines, feature stores, training workflows, model... ...AI controls. You’ll mentor other engineers and turn best practices into reusable patterns... ...expert-level programming skills in Python, along with strong software engineering...
- ...forward About the Role As a Senior Software Engineer , your mission is to own real problems... ...(CRM, ERP, core banking), and the data flows that feed our AI agents - where... ..., GCP, Azure) Knowledge of CI/CD pipelines and automated testing Previous...
- ...Chrome Extension, and Web App. Google recently named... ...frontend and backend engineers, AI research scientists... ...looking to hire for our Data side of our AI team at... ...it into our ingestion pipeline Operate and extend the... ...Proficiency with bash/Python scripting in Linux environments...
- ## Job Summary The Senior QA Engineer is responsible for ensuring the quality, reliability, and... ...automation coverage and optimize CI/CD testing pipelines. * Promote QA best practices and... ...standards. * Enhance the employee data generator by adding additional fields,...
- ...We are seeking an experienced QA Engineer to join our team in Dubai. The ideal candidate is... ...testing, and has a strong background in testing web and mobile applications. You will play a... .... Prepare test environments and test data required for execution. Execute...
- ...mission and contribute meaningfully to our data-driven journey. Your Mission... ...related field at a leading business school or engineering school. You bring A strong analytical... ...(advanced) and ideally in Power BI, Python, or SQL A genuine interest in the...
- ...a detail-oriented and highly motivated Senior Quantity Surveyor to provide full-lifecycle... ...management support for a large-scale data center project in Dubai, United Arab Emirates... ...close coordination with design, engineering, procurement, contracts, planning, cost control...
- ...Position: Data Engineer Date Posted: July 7, 2026 Industry: Information Technology /... ...building, and maintaining scalable data pipelines and ETL solutions in enterprise environments... ...tools, database technologies, and Python-based data engineering solutions. You will...
$80000 - $120000 per month
...generative models, and turns data into decisions clients can... ...forecasting ~ Partner with engineering to move models from notebook... ...Build and maintain the data pipelines that feed AI models ~... ...equivalent experience ~ Strong Python (pandas, scikit-learn) and...- ...become part of a global team of over 50,000 planners, designers, engineers, scientists, digital innovators, program and construction... ...Management and Controls procedures, including proper documentation and data integrity. Provide mentorship and support to junior planners...
- ...WEB DESIGNER A creative and detail-oriented organization is seeking a talented Web Designer to create engaging, user-friendly, and visually appealing websites. This is an excellent opportunity for individuals who enjoy combining creativity with technology and want to...
- ...will design, develop, and apply advanced data science, statistical, and machine learning... .... Working closely with customers, engineers, and product teams, you will build production... ...Applied AI with excellent proficiency in Python and SQL. ~ Experience with machine learning...
- ...GSS Tech Group is seeking an experienced Senior DevOps Engineer to join its Technology Engineering team in Dubai. This role is ideal for a skilled... ...delivery solutions. • Build and maintain CI/CD pipelines to streamline software deployment. • Implement Infrastructure...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Python Engineer: Web Crawling & Data Pipelines. Be the first to apply!
