Get new jobs by email
- ...Apache Iceberg with Databricks as the primary compute layer, and build batch and streaming data pipelines using PySpark, AWS Glue, and Kafka Architect and implement a feature store with online and offline stores, point-in-time joins, and feature versioning Own cloud...
- ...developing and maintaining CI/CD pipelines. Data Tech Awareness Familiarity with big data technologies (e.g., Hadoop, Spark, Kafka) and data warehousing concepts. Scripting Prowess Proficiency in scripting and programming languages commonly used in data engineering...
- ...Anthropic, Gemini, DeepSeek) ~ LangChain or AI agent frameworks ~ Celery and background task processing ~ RabbitMQ, Kafka, or message queues and Typesense. ~ WebSockets and real-time communication ~ Elasticsearch ~ Kubernetes...
- ...for our Android app. Next.js, React and Typescript for our web applications. GraphQL Federation for our client-facing APIs and Kafka for our inter-service communication. PostgresSQL for consistent and durable storage, Redis for quick fetching, Elasticsearch for...
- ...stack (OS, network, application) – Apply a solid understanding of distributed systems and technologies, including RPC protocols, Kafka, and Event-Driven Systems, to design scalable solutions – Collaborate effectively with product teams to gather requirements and constraints...
- ...for our Android app. Next.js, React and Typescript for our web applications. GraphQL Federation for our client-facing APIs and Kafka for our inter-service communication. PostgresSQL for consistent and durable storage, Redis for quick fetching, Elasticsearch for...
$80 - $90 per hour
...a collaborative software delivery environment Preferred qualifications Experience with AWS, Azure, or GCP Experience with Kafka, messaging, or event-driven architecture Experience with CI/CD, DevOps, or production operations Experience with batch processing...$65 - $75 per hour
...experience with AWS, Azure, or GCP Experience with CI/CD, automated testing, or DevOps practices Experience with NoSQL databases, Kafka, or event-driven systems Financial services, healthcare, telecom, or other regulated-domain experience Experience with Python,...- ...developing software ~ Experience working on systems that handle money ~ Experience with Node.js, GraphQL, Postgres, ElasticSearch, or Kafka ~ Experience shipping and maintaining complex backends Our tech stack We’ve built a modular architecture with the...
- ...(Data Engineer Associate or Professional) or Microsoft Azure Data Engineer Associate (DP-203). Experience with streaming data (Kafka, Event Hubs, Spark Structured Streaming). Experience with Unity Catalog, Microsoft Purview or Microsoft Fabric. Infrastructure...
- ...Graylog, ELK, or equivalent. You know what to monitor, what to alert on, and what "healthy" looks like • High-concurrency experience — Kafka, message queues, or event streams at real scale. When throughput spikes you know what breaks — consumer lag, backpressure, hot...
- ...Experience with HA deployments for modern scale-out databases and data processing solutions (Cassandra, PostgreSQL, MySQL, MongoDB, Kafka, Elasticsearch) Cloud or Portworx-related certifications (e.g., AWS Certified DevOps Engineer, Pure Certified Portworx Enterprise...
- ...Delta Lake, Apache Iceberg, S3-based Lakehouse, Metabase, OpenMetadata, Segment, Amplitude, Adjust, Firebase, MoEngage, JourneyFi, Kafka, RabbitMQ Why Join Us? Work with one of the world’s leading financial derivatives institutions. Competitive salary plus performance...
- ...with big data technologies including Scala, Hadoop, Spark, Hive, Shell Scripting, EMR, Step Functions, Lambda, Glue, Sqoop, and Flume/Kafka. • Strong knowledge of Amazon Redshift, Oracle, and Microsoft SQL Server. • Valid passport is mandatory. • Willingness to...
- ...knowledge of MLOps and modern data infrastructure, including experiment tracking, model versioning, CI/CD, and tools such as Spark, Kafka, Airflow, and feature stores You have experience operating ML systems in production, including monitoring for drift, latency, accuracy...
- ...driven systems, Low-latency system design and optimization. Experience with: Messaging frameworks (e.g., Kafka, Solace, JMS), REST / WebSocket APIs for real-time streaming, Strong Linux/Unix development environment experience...
- ...Experience building high-throughput, fault-tolerant data pipelines using messaging or streaming technologies (MQ, Kafka, or equivalent) Good understanding of market data content and pricing inputs across FX, IRD, FI and MM...
- ...initiatives through enterprise data architecture ~ Experience working with distributed processing and storage platforms ~ Spark, Kafka, Iceberg, Airflow, NiFi, Trino, Flink, HDFS, Ozone, MinIO, Cloudera, and Stackable ~ PostgreSQL, Oracle, SQL Server,...
- ...concepts and ETL/ELT processes. • Familiarity with Git and data quality best practices. • Knowledge of dbt, Airflow, ClickHouse, Kafka, Power BI, Microsoft Fabric, or Odoo is an advantage. • DP-600 or DP-700 certifications are considered a plus. • Native Arabic...
$100000 - $140000 per year
...• Experience with cloud platforms including AWS, Microsoft Azure, or OCI is preferred. • Knowledge of queuing services such as Kafka, Event Hubs, or ActiveMQ is an advantage. • Experience with Data Lakes or Big Data technologies is preferred. • Excellent written...AED30000 - 45000 per month
..., and Python. • Experience with Microservices, REST APIs, and Event-Driven Architecture. • Hands-on experience with PostgreSQL, Kafka, and IBM MQ. • Proficiency in Docker, Kubernetes/OpenShift, and GitHub Actions. • Knowledge of OAuth2/OIDC, Secure Coding, and OWASP...- ...interceptors (W3C context) into code and configure KEDA (Kubernetes Event-driven Autoscaling) rules mapped to queue depths (RabbitMQ/Kafka) for scale-to-zero capabilities. Skills Must have 8-12 years of working...
- ...schemas and indexing strategies for trade logs, risk events, and position data Implement reliable event-driven architectures using Kafka, RabbitMQ, Redis Streams, or similar technologies Squad Leadership & Stakeholder Management Lead engineering standards, code...
- ...Helm, Terraform, Jenkins, GitHub Actions, ArgoCD. Development: Java, Spring Boot/Spring Cloud, REST, GraphQL, gRPC. Messaging: Kafka, RabbitMQ. Databases: PostgreSQL, Oracle, SQL Server, MongoDB, Redis. Monitoring: Prometheus, Grafana, ELK, Splunk....