LLM Engineer (Generative AI & Large Language Models)

This role requires the candidate to work on-site in Tokyo, Japan.

Client Overview

Our client is a global technology consulting company specializing in Artificial Intelligence (AI), Generative AI, Machine Learning, and Digital Transformation (DX). The organization partners with leading financial institutions and enterprise clients to develop advanced AI-powered solutions that enhance business performance, automate operations, and accelerate digital innovation.

As enterprise adoption of Large Language Models (LLMs) continues to grow, the company is expanding its AI Engineering team to develop production-ready Generative AI applications, Retrieval-Augmented Generation (RAG) solutions, AI Agents, and enterprise LLM platforms that deliver measurable business value across the financial services industry.

Job Role

The LLM Engineer will design, develop, and deploy enterprise Generative AI solutions powered by Large Language Models (LLMs). Working alongside senior AI scientists, Data Engineers, AI Consultants, and cross-functional teams, this role supports the full AI implementation lifecycle—from solution design and proof of concept (PoC) to production deployment, optimization, and MLOps.

This position offers the opportunity to work on cutting-edge Generative AI technologies while helping enterprise clients transform business processes through intelligent automation and AI-driven innovation.

Key Responsibilities

• Develop enterprise applications using Large Language Models (LLMs), prompt engineering, API integration, and parameter optimization.
• Design and implement Generative AI solutions, including Retrieval-Augmented Generation (RAG), AI Agents, and Proof of Concept (PoC) initiatives.
• Collaborate with AI Consultants, Data Engineers, and technical teams to translate business requirements into scalable AI applications.
• Build, test, deploy, and optimize LLM-powered solutions for production environments.
• Support AI application deployment, monitoring, and continuous improvement using LLMOps and MLOps best practices.
• Conduct technical validation, performance optimization, and quality assurance for AI deliverables.
• Contribute to reusable AI frameworks, development standards, and internal technical knowledge sharing.
• Stay current with emerging developments in Generative AI, LLM architectures, and enterprise AI technologies.

Candidate Requirements

• Bachelor's degree or above in Computer Science, Artificial Intelligence, Data Science, Information Technology, Engineering, Mathematics, or a related discipline.
• Minimum 1 year of practical experience in AI, Machine Learning, Data Science, or Generative AI development.
• Hands-on experience building applications using Large Language Models (LLMs) and cloud-based LLM APIs.
• Experience with Prompt Engineering, Retrieval-Augmented Generation (RAG), AI Agents, or related Generative AI technologies is highly preferred.
• Strong programming skills in Python (experience with R is an advantage).
• Familiarity with LLMOps, MLOps, cloud AI platforms, and enterprise AI deployment practices.
• Experience with data platforms such as Snowflake, Databricks, BigQuery, or similar technologies is advantageous.
• Strong analytical thinking, problem-solving ability, and collaboration skills within multidisciplinary teams.
• Business-level Japanese proficiency is mandatory.
• Professional English communication skills are preferred.
• Foreign candidates should hold (or be eligible for) an appropriate Japanese working visa, including Permanent Resident, Highly Skilled Professional, or Engineer/Specialist in Humanities/International Services.