Senior NLP Scientist - Transformers & RAG for Scalable AI

We are looking for a Senior Data Scientist, with a demonstrated experience in natural language processing (NLP) and transformer models. Zendy.io , a product of Knowledge E, is a massive online library created to provide individuals with affordable access to a wealth of information in the form of journals, e-books, magazines and other content mediums.

Responsibilities

• Conducting thorough evaluations of machine learning models, particularly focusing on their performance, accuracy, and reliability
• Designing and implementing metrics for tracking and improving model performance
• Investigating and analysing large language models from open-source repositories, assessing their applicability and performance in various tasks and recommending improvements or adoption strategies.
• Developing and implementing NLP solutions, leveraging expertise in transformer models
• Utilising RAG techniques to enhance the performance of language models, ensuring high-quality results in information retrieval and generation tasks
• Employing advanced methods for training and fine-tuning large language models.

You are:

An experienced professional with a proven track record of working on large-scale machine-learning projects and deploying models in production environments. You have no trouble collaboratingwith cross-functional teams, including data engineers, software developers, and domain experts.

Minimum Job Qualifications

• Bachelor’s degree in Computer Science, Data Science, Machine Learning, or a related field
• A minimum of 3-5 years of professional experience in data science or a related field
• Demonstrated experience in natural language processing (NLP) and transformer models
• Proficiency in machine learning frameworks: Huggingface, PyTorch, TensorFlow, and scikit-learn
• Strong understanding of evaluation metrics and their application in model performance analysis
• Experience with retrieval-augmented generation (RAG) techniques
• Familiarity with methods for training and fine-tuning large language models
• Excellent analytical and problem-solving skills
• Ability to work in a collaborative, fast-paced environment
• Excellent written and verbal communication skills

Desired Extras

• A master’s degree or Ph.D. is highly preferred.
• Knowledge of big data technologies such as Hadoop and Spark is a plus