ML Engineer (LLM, RAG)

Andersen is looking for a ML Engineer for a FinTech project with a bank in Kazakhstan. The role involves working on AI-driven enhancements to improve banking services and support digital transformation.

The customer is a leading retail bank in Kazakhstan, operating nationwide with a strong focus on consumer lending and digital financial services. As part of an international financial group, the organization offers innovative banking solutions including loans, credit and debit cards, and a high-performing mobile app. It has earned national recognition for excellence in digital transformation, financial inclusion, and corporate social responsibility.

The project is focused on developing AI solutions with a priority on large language models (LLMs). It includes building multi-channel chat systems, applying RAG techniques, and creating Agentic AI for database interaction.

Responsibilities:

• Integrating AI into banking processes to automate and improve internal operations efficiency.
• Adapting models to meet the bank’s specific business needs.
• Developing and optimizing LLM-based solutions.
• Working with vector databases and implementing advanced RAG approaches.
• Developing chatbot systems and supporting multiple communication channels (webhooks, WhatsApp, Telegram, etc.).
• Developing and implementing Agentic AI (agents interacting with databases and providing responses).
• Optimizing models using quantization and pruning to reduce size and improve performance.
• Creating and maintaining asynchronous REST API services.
• Containerizing and deploying applications.

Must-haves:

• Experience as a ML Engineer working with LLM and RAG for 3+ years.
• Strong proficiency in Python.
• Experience designing MCP servers for enterprise services and systems.
• Expertise in multi-agent system architecture and workflows using LangGraph.
• Experience optimizing LLMs (quantization, distributed inference, GPU optimization).
• Hands-on experience with PyTorch (distributed training, model fine-tuning).
• Knowledge of MLOps: full ML pipeline lifecycle, model monitoring.
• Experience developing high-load ML APIs and batch processing solutions.
• Proficiency in advanced RAG (multi-modal RAG, query routing, advanced retrieval strategies).
• Experience working with microservices architecture.
• Experience using FastAPI + asyncio for building asynchronous REST API services.
• Experience containerizing applications with Docker/docker-compose.
• Familiarity with CI/CD: deployment and testing automation.
• Advanced knowledge of working with SQL/NoSQL databases: Oracle PL/SQL, PostgreSQL, MongoDB; query optimization.
• Experience using Redis for caching.
• Experience working with RabbitMQ as a message broker.
• Experience with load balancing (nginx, traefik).
• Level of English – from Intermediate and above.

Nice-to-haves:

• Higher technical education or specialized AI/ML training.

Reasons why this job would be interesting to you:

• Experience in teamwork with leaders in FinTech, Healthcare, Retail, Telecom, and others. Andersen cooperates with such businesses as Samsung, Siemens, Johnson & Johnson, BNP Paribas, Ryanair, Mercedes, TUI, Verivox, Allianz, T-Systems, etc.
• The opportunity to change the project and/or develop expertise in an interesting business domain.
• Job conditions – you can work both fully remotely and from the office or can choose a hybrid variant.
• Guarantee of professional, financial, and career growth! The company has introduced systems of mentoring and adaptation for each new employee.
• The opportunity to earn up to an additional 1,000 USD per month, depending on the level of expertise, which will be included in the annual bonus, by participating in the company's activities.
• Access to the corporate training portal, where the entire knowledge base of the company is collected and which is constantly updated.
• Bright corporate life (parties / pizza days / PlayStation / fruits / coffee / snacks / movies).
• Certification compensation (AWS, PMP, etc).
• Referral program.
• English courses.
• Private health insurance and compensation for sports activities.

Join us!