Get new jobs by email
- ...and retraining as a coherent, maintainable production system Design the data lakehouse architecture on AWS using Delta Lake or Apache Iceberg with Databricks as the primary compute layer, and build batch and streaming data pipelines using PySpark, AWS Glue, and Kafka...
- ...Experience in data engineering, system integration, or similar roles Familiarity with data integration tools (e.g., Node-RED, Apache NiFi) Experience with APIs, JSON/XML, and data processing Exposure to cloud platforms (AWS/Azure) Understanding of AI/ML services...
- ...Azure Data Engineering ecosystem. Expert-level proficiency in Azure Databricks. Strong hands-on experience with PySpark and Apache Spark. Experience with Azure Data Lake Storage (ADLS Gen2). Expertise in designing and implementing streaming data solutions...
- ...analytics and reporting Optimize cloud data warehouses — Snowflake, Amazon Redshift, or BigQuery Implement real-time streaming using Apache Kafka or Flink Support AI/ML pipelines, including vector databases (Pinecone, pgvector) Drive data governance, security, and...
- ...of up to 30 days. • Strong experience with Java 17 and Spring Boot. • Hands-on experience with Microservices Architecture and Apache Kafka. • Strong understanding of system design, design patterns, and architecture patterns. • Expertise in Java Streams and advanced...
- ...Python, Java, Scala, and R. Data management & databases : Oracle, SAP, SQL, NoSQL, Data Warehousing Big data technologies : Apache Hadoop, Spark, Kafka, etc. Cloud platforms: Experience with Microsoft Fabric, Azure (Synapse Analytics, Databricks, Machine...
- ...Cloud: AWS (SageMaker, EKS, S3, Lambda), Azure ML, Azure Databricks, GCP Data Stack: Databricks, Spark, PySpark, Delta Lake, Apache Iceberg, Lakehouse architectures Why Join Us? Work with one of the world’s leading financial derivatives institutions. Competitive...
- ...HTML, CSS, XML, XSLT, and JavaScript will be part of your job. You must be familiar with working in a Linux environment, working with Apache, and MySQL or PostgreSQL. Are you experienced in a fast-paced, project-oriented working environment? Then do not wait and send us...
- ...on building scalable, governed, and metadata-driven data solutions using Microsoft Fabric , with deep expertise in OneLake , Apache Spark, and medallion architecture. The ideal candidate will design and implement DIAB-compliant, metadata-driven pipelines ensuring...
- ...Services (JAXRS) SOAP JSON. Build Tool: Maven. Version Control : Bit Bucket. Development Tools: Eclipse STS Jira Tibco Jasper Report. Application Server: WebLogic Application server Apache Tomcat Testing: Junit. Remote Work : No Employment Type : Fulltime...
- ...gateways Data Loss Prevention) Python Shell scripting Basic database knowledge (MSSQL and Oracle) Regex knowledge Apache NIFI exposure Preferred Education and Experience Technical or programmatic certifications preferred Previous Forcepoint...
- ...validation routines to ensure data accuracy and reliability throughout the and Orchestration: Automate data workflows using tools like Apache Oozie Airflow or similar orchestration tools within the Cloudera and Maintenance: Monitor pipeline performance troubleshoot issues...
$80000 per year
...Required Experience : Senior-level experience in Data Warehousing and Lakehouse Architecture.Deep, hands-on expertise with Databricks (Apache Spark, Delta Lake, Lakehouse patterns). Strong experience designing cloud-native data platforms on AWS, Azure, or GCP. Solid...- ...Must have Skills : Node JS React (Capable) Microservices architecture (MSA) (Strong) Good To Have Skills : MongoDB Apache Kafka Job Description : Experience Minimum 5 years of development and design experience in Spring Boot and Microservices architecture...
- ...prioritize tasks in a dynamic work environment. Technical Skills: o Strong data querying and processing skills using SQL Oracle Apache Spark or similar language o Data Visualization tools Power BI Business Objects Crystal or similar tool o Data Warehousing and...
- ...NOT Sev2 or Sev3QualificationsBE or degree in Computer Science or a related technical field.7 years of experience in Confluent Kafka/Apache Kafka cluster installation and admin experience in Linux and distributed cluster Experience in Ansible and DevOps for Admin...
- ...practices MuleSoft Developer Certification is desired Experience with other integration platforms such as Dell Boomi or Apache Camel is a plus Benefits About Us Zone IT Solutions is Australia based Recruitment Company. We specialize in Digital ERP...
- ...of Integration Gateway Monitoring tools Observability platforms like Grafana . Excellent Knowledge of ElasticSearch Redis MongoDb Apache Kafka Infrastructure knowledge including RESTful APIs Single Sign On OAuth LDAP Search Technologies Expertise with Docker & Kubernetes...
AED10000 - 13000 per month
...environments. - Aviation or airline domain experience is strongly preferred. - Experience with Amazon Redshift, Hadoop, Hive, and Apache Spark frameworks is a significant advantage. - Familiarity with AWS Cloud services and cloud-first data architecture patterns...- ...Data Bricks Engineer Banking 58 years of experience designing and building data pipelines using Apache Spark Databricks or equivalent bigdata frameworks. Hands on expertise with streaming and messaging systems such as Apache Kafka (publish subscribe architecture...
- ...Must have Skills : TypeScript Microservices architecture (MSA) (Strong) Good To Have Skills : MongoDB Apache Kafka Job Description : Experience - Minimum 7-8 years of coding experience in NodeJS JavaScript and Databases. - At least 1 year hands-on in TypeScript...
- ...Proficiency : Expertise in AWS services: S3 Glue Lambda Redshift Athena and Kinesis. Proficiency in ETL frameworks like AWS Glue or Apache NiFi. Strong knowledge of SAP data structures and integration methodologies. Advanced skills in Python SQL and other...
- ...prioritize tasks in a dynamic work environment. Technical Skills: o Strong data querying and processing skills using SQL Oracle Apache Spark or similar language o Data Visualization tools Power BI Business Objects Crystal or similar tool o Data Warehousing and...
- ...Sev2 or Sev3 Qualifications BE or degree in Computer Science or a related technical field. 7 years of experience in Confluent Kafka/Apache Kafka cluster installation and maintenance. Expert admin experience in Linux and distributed cluster environments. Good Experience...
- ...technical and non-technical stakeholders. Preferred: Experience with Databricks or other distributed computing frameworks such as Apache Spark. Familiarity with cloud-based data platforms like Azure Synapse Snowflake Big Query or Redshift. Working knowledge of...
- ...Flow Logs. Hands-on experience with open-source security and penetration testing tools. Working knowledge of: Web servers: Apache Gunicorn Nginx Databases: MySQL Percona MongoDB DevOps tools: Git Redis Celery Elasticsearch AWS services: S3 CloudFront...
- ...organizations with hands on automation knowledge. Banking or Financial Background is a plus. Application Server experience (Jboss Tomcat Apache etc.) who can deep-dive Knowledge on Security areas such as SSL worked on VA/Compliance WRT OS and knowledge on GPOs. Strong...
- ...Preferred Qualifications Cloud Infrastructure: Experience with GCP (Vertex AI) or AWS (SageMaker) and orchestration tools like Apache Airflow. MLOps: Strong background in automated retraining version control and model monitoring pipelines. Experimentation: Expertise...
- ...integration and transformation. 4. Big Data Processing Develop data transformation workflows using: PySpark / Apache Spark Optimize pipelines using: Partitioning caching and efficient joins ~ Work on both batch and streaming data processing...
- ...is at risk or not working Ownership starts early and increases with capability. What You Will Build Data pipelines using Apache Spark (PySpark preferred) Bronze and Silver layer transformations in a lakehouse architecture SQL-based transformations and aggregations...
