Senior QA Engineer - AI-Native Platform

SL KG

Senior QA Engineer - AI-Native Platform

Описание вакансии

We are a global OSINT company headquartered in the US, empowering investigators and security professionals with cutting-edge AI-powered products. Our technology collects and analyzes massive volumes of data from open sources, including social media, messengers, and the dark web, to create a comprehensive picture for data-driven investigations and decision-making.

Our customers include S&P 500 companies and law enforcement agencies in 80+ countries worldwide. Social Links is scaling rapidly, growing 2x annually, with the ambition of becoming a unicorn valued at $1B+.

We are looking for a hands-on Senior QA Engineer building test infrastructure and evaluation frameworks from scratch for a distributed AI platform. Primary focus: testing non-deterministic AI agent outputs, RAG pipeline quality, multi-tenant data isolation, and cross-service integration.

Your Tasks Will Be:

  • Build and maintain AI evaluation framework
  • Test RAG pipeline quality and retrieval relevance
  • Design testing approaches for non-deterministic LLM outputs
  • Build multi-tenant isolation test suite, including AI layer isolation
  • Write cross-service integration and contract tests
  • Test Temporal workflows, event-driven flows, and YAML DSL validation
  • Build and maintain automated regression suites

Our Ideal Candidate Has:

  • 3+ years in QA automation / SDET
  • Hands-on experience testing AI/ML systems
  • Strong Python (pytest, async testing)
  • Experience building test infrastructure from scratch
  • Experience testing distributed or event-driven systems
  • Experience testing multi-tenant applications
  • Autonomous work style
  • English – B1 level or higher

Nice To Haves:

  • RAG / vector search quality evaluation
  • LangGraph, LangChain, or similar agent frameworks
  • Go test automation
  • BentoML / MLflow or equivalent MLOps tooling
  • Security testing: prompt injection, context leakage
  • Performance / load testing for ML inference endpoints
  • Data pipeline testing (Delta Lake, Great Expectations, Dagster)
  • Russian – advanced level or higher

What We Offer:

  • Remote-first setup: work from anywhere in the world
  • Work on a greenfield, technically challenging product (distributed system at scale)
  • Direct collaboration with senior technical stakeholders (engineering leadership, product)
  • Ownership and impact: influence QA strategy, tooling, and quality gates from the early stage of the product
  • Fast iteration environment: work closely with engineering to improve reliability and release confidence

We are an equal-opportunity employer and are committed to fostering a diverse and inclusive environment for all candidates.

Навыки
  • LLM Testing
  • Python
  • Pytest
  • asyncio
  • QA automation
  • Backend Testing
  • API Testing
  • Integration Testing
  • Microservices
  • RAG
  • Multi-tenant
  • GitLab CI
  • Kafka
Посмотреть контакты работодателя

Похожие вакансии

Negotiations Expert

Manual QA Engineer (Mid-Level)

Negotiations Expert

  • Тбилиси

  • до 1540 USD

Рекомендуем
Jaxel
  • Тбилиси

  • до 1540 USD

Рекомендуем
  • Тбилиси

  • до 1540 USD

Рекомендуем
Social Discovery Group
  • Тбилиси

  • до 1540 USD

Senior Data Scientist

Genesis Group AG

  • Тбилиси

  • до 1540 USD

Сумма АйТи

Senior AI Engineer

Сумма АйТи

  • Тбилиси

  • от 4000 USD

Hdcart PTE
  • Тбилиси

  • до 5 USD

TRIBE (LTD STARTRIBE)

Team Lead

TRIBE (LTD STARTRIBE)

  • Тбилиси

  • до 5 USD

TOOLS FOR BROKERS
  • Тбилиси

  • до 1700 USD

ОнТаргет ЛАБС
  • Тбилиси

  • до 1700 USD

КвантумСофт
  • Тбилиси

  • до 6000 USD

AppMagic
  • Тбилиси

  • до 6000 USD

AI/ML Engineer (iGaming)

AYITO Tech Korlátolt Felelősségű Társaság

  • Тбилиси

  • до 6000 USD

Social Discovery Group

Senior System Administrator

Social Discovery Group

  • Тбилиси

  • до 4500 USD

Senior Recruiter

Genesis Group AG

  • Тбилиси

  • от 1300 USD

TRIBE (LTD STARTRIBE)

Senior ML Engineer (NLP, Production)

TRIBE (LTD STARTRIBE)

  • Тбилиси

  • от 1300 USD

the_covert
  • Тбилиси

  • от 1300 USD

TRIBE (LTD STARTRIBE)

Senior Product Analyst

TRIBE (LTD STARTRIBE)

  • Тбилиси

  • от 1300 USD

Хотите оставить вакансию?

Заполните форму и найдите сотрудника всего за несколько минут.
Оставить вакансию