Sr. Technology Engineer (Hadoop)

Job Purpose:

The Sr. Technology Engineer (STE) works towards moving the Data Platform to the advanced level of full automation security and high availability. Works closely with other Data Leads Delivery Leads and Chapter head and help drive the Data Management and Analytics vision and strategy to deliver common and consistent data capabilities across the Group.

The primary task is to drive and transform the data capabilities by enabling 100% automated deployments and containerization of the platform. Work with other architects and platform teams to ensure data is managed as an asset in a centralized standardized and consistent manner in order to maintain consistency and quality using mature technologies and emerging data practices.

A highly skilled Senior Technology with extensive experience in DevOps CI/CD Kubernetes OpenShift Jenkins and GitOps. The ideal candidate should also have a strong understanding of Big Data and Distributed Data Architecture. This role involves designing implementing and maintaining scalable and efficient infrastructure and data solutions to support our business objectives..

Job Content (Describe the key results delivered by the job holder how they are measured and the tasks performed to achieve the results)

Key Results

Performance Measures

Main Tasks

Key Responsibilities:

• DevOps and CI/CD: Design implement and manage CI/CD pipelines using tools like Jenkins and GitOps to automate and streamline the software development lifecycle.
• Containerization and Orchestration: Deploy and manage containerized applications using Kubernetes and OpenShift ensuring high availability and scalability.
• Infrastructure Management: Develop and maintain infrastructure as code (IaC) using tools like Terraform or Ansible.
• Big Data Solutions :Architect and implement big data solutions using technologies such as Hadoop Spark and Kafka.
• Distributed Systems: Design and manage distributed data architectures to ensure efficient data processing and storage.
• Collaboration: Work closely with development operations and data teams to understand requirements and deliver robust solutions.
• Monitoring and Optimization: Implement monitoring solutions and optimize system performance reliability and scalability.
• Security and Compliance: Ensure infrastructure and data solutions adhere to security best practices and regulatory requirements.

Qualifications:

• Education: Bachelors or Masters degree in Computer Science Engineering or a related field.
• Experience: Minimum of 5 years of experience in big data engineering or a related role.
• Technical Skills:
  • Proficiency in CI/CD tools such as Jenkins and GitOps.
  • Strong experience with containerization and orchestration tools like Kubernetes and OpenShift.
  • Knowledge of big data technologies such as Hadoop Spark ETLs.
  • Proficiency in scripting languages such as Python Bash or Groovy.
  • Familiarity with infrastructure as code (IaC) tools like Terraform or Ansible.

• Soft Skills:
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration abilities.
  • Ability to work in a fast-paced dynamic environment.

Preferred Qualifications:

• Certifications in DevOps cloud platforms or big data technologies.
• Experience with monitoring and logging tools such as Prometheus Grafana or ELK Stack.
• Knowledge of security best practices in DevOps and data engineering.
• Familiarity with agile methodologies and continuous integration/continuous deployment (CI/CD) practices.

Desired or Essential

A. Education

General

Professional

Master or Bachelors degree in computer science information systems management or related field.

Essential

B. Experiences

(Years & Type)

Industry

Regional

Functional

• More than 8 years of experience in information technology with 3 years spent in data engineering architecture and technology solutions definitions and implementations.
• Extensive experience in banking and financial services domain

C. Knowledge & Skills

Technical

Managerial

Up-to-date knowledge of CDP versions including latest releases through 7.1.7 through 7.1.9

In-depth knowledge of Cloudera manager for deploying configuring and monitoring CDP services

Strong understanding of security mechanisms like Kerberos LDAP/AD integration and Transport Layer Security (TLS)

Collaborate with supporting teams (database network security system teams) and conduct root cause analysis of production issues and provide corrective actions

Strong command over Linux CLI as its the foundation for managing CDP environments

Skills in automating repetitive tasks using scripting languages like Bash or Python

Ability to set up and manage monitoring solutions for CDP clusters to increase observability

Expertise in Data Architecture Data Strategy and Roadmap for large and complex organization and systems and implemented large scale end-to-end Data Management & Analytics solutions

Experience in transforming traditional Data Warehousing approaches to Big Data based approaches and proven track record of managing risks and data security

Expertise with DW Dimensional modeling techniques Star & Snowflake schemas modeling slowly changing dimensions and role playing dimensions dimensional hierarchies and data classification

Experiences in cloud native principals designs and deployments.

Extensive experience working with and enhancing Continuous Integration (CI) and Continuous Development (CD) environments

Expertise in Data Quality Data Profiling Data Governance Data Security Metadata Management and Data Archival

Define workload migration strategies using appropriate tools

Drive delivery in a matrixed environment working with various internal IT partners

Demonstrated ability to work in a fast paced and changing environment with short deadlines interruptions and multiple tasks/projects occurring simultaneously

Must be able to work independently and have skills in planning strategy estimation scheduling

Strong problem solving influencing communication and presentation skills self-starter

Experience with data processing frameworks and platforms (Informatica Hadoop Presto Tez Hive Spark etc.)

Hands-on experience with related/complementary open source software platforms and languages (e.g. Java Linux Python GIT Jenkins)

Exposure to BI tools and reporting software (e.g. MS PowerBI and Tableau)

D. Behavioral Competencies

• Business Acumens
• Organization leadership skills
• Coaching and mentoring
• Excellent analytical skills
• Demonstrate critical and systems of thinking ability.
• Ability to negotiate and influence
• Disciplined organized
• Flexibility / Adaptability
• Visionary
• Performance driven

S YNECHRONS DIVERSITY & INCLUSION STATEMENT

Diversity & Inclusion are fundamental to our culture and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity Equity and Inclusion (DEI) initiative Same Difference is committed to fostering an inclusive culture promoting equality diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger successful businesses as a global company. We encourage applicants from across diverse backgrounds race ethnicities religion age marital status gender sexual orientations or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements mentoring internal mobility learning and development programs and more.

All employment decisions at Synechron are based on business needs job requirements and individual qualifications without regard to the applicants gender gender identity sexual orientation race ethnicity disabled or veteran status or any other characteristic protected by law .

Required Experience:

Senior IC