All roles at Test Company
AI Engineer
Full-timeJaipur, India345 USD · Per weekPosted 2 days ago
About the role
About the Role We are looking for an AI Engineer to design, build, and deploy machine learning and large language model systems that solve concrete product problems for our customers. You will work closely with product, data, and platform teams to move models from prototype to production, with a focus on reliability, latency, and measurable business outcomes. This role suits an engineer who can bridge research ideas and production software and who takes ownership of systems after they ship. Your work will directly shape how our product understands language, documents, and user intent.
Responsibilities
- Design and implement LLM-based features, including retrieval-augmented generation pipelines, prompt workflows, and evaluation harnesses.
- Train, fine-tune, and evaluate machine learning models, documenting data requirements, metrics, and known failure modes.
- Build and maintain production inference services with defined targets for latency, throughput, and cost per request.
- Establish offline and online evaluation frameworks to measure model quality and catch regressions and safety issues before release.
- Collaborate with data engineers to define feature pipelines, labeling standards, and dataset versioning.
- Monitor deployed models for drift, performance degradation, and unexpected outputs, and lead remediation work when issues arise.
Required Qualifications
- 3+ years of professional software engineering experience, including at least 2 years building machine learning systems in production.
- Strong Python skills and experience with PyTorch or TensorFlow.
- Hands-on experience with transformer-based models, including fine-tuning and prompt engineering with commercial or open-source LLMs.
- Experience deploying models as APIs or services using containers and a major cloud platform (AWS, GCP, or Azure).
- Solid understanding of statistics, experimental design, and model evaluation metrics.
- Working knowledge of Git, automated testing, and CI/CD practices.
Nice to Have
- Experience with vector databases and embedding-based retrieval at scale.
- Familiarity with model serving frameworks such as vLLM, NVIDIA Triton Inference Server, or TorchServe.
- Background in MLOps tooling, such as MLflow, Kubeflow, or Weights & Biases.
- Experience with GPU optimization, model quantization, or distributed training.
- Contributions to open-source ML projects or published research.
- Knowledge of AI safety, red-teaming, or responsible AI practices.
What we're looking for
- 3+ years of professional software engineering experience, including at least 2 years building machine learning systems in production
- Strong Python skills with PyTorch or TensorFlow
- Hands-on experience fine-tuning transformer-based models and prompt engineering with commercial or open-source LLMs
- Experience deploying models as APIs or services using containers on AWS, GCP, or Azure
- Solid understanding of statistics, experimental design, and model evaluation metrics
- Working knowledge of Git, automated testing, and CI/CD practices
Apply for this role
Upload your CV (PDF or Word) — we'll take it from there.