AI Application Testing Engineer (Agent Direction) AI应用测试工程师（Agent方向）

Description

About us Bitget is one of the world's leading digital assets ecosystems. With over 120 million registered users, Bitget has one of the most comprehensive suites of blockchain products and services available via bitget.com. Our mission is to support the growth of the digital assets industry and we believe it represents the future of finance. What we do empowers the future of finance by ensuring secure, efficient and smart digital transactions. We are one of the fastest growing companies in the digital asset sector. If you are looking for cutting-edge work, where you will have opportunities to develop your career among peers who are experts in their field, and you believe in the future of digital currency, then look no further than Bitget! What you'll do Conduct functional testing for AI products, including testing LLM, RAG, Agent and other AI-based products, and be responsible for building an automated testing system. Agent capability testing: Design Agent test cases, covering multi-turn dialogue, Tool Use, context management, and Agent behavior consistency testing. AI testing tools: Utilize LLM to assist in generating test cases and automating defect analysis, building an Agent autonomous testing system. MCP ecosystem testing: Conduct MCP service and Skill integration testing, ensuring consistency between services, with particular focus on cross-service interaction issues. Security and compliance testing: Design Prompt Injection, adversarial input security assessment pla

Responsibilities

• Conduct functional testing for AI products, including testing LLM, RAG, Agent and other AI-based products, and be responsible for building an automated testing system.
• Agent capability testing: Design Agent test cases, covering multi-turn dialogue, Tool Use, context management, and Agent behavior consistency testing.
• AI testing tools: Utilize LLM to assist in generating test cases and automating defect analysis, building an Agent autonomous testing system.
• MCP ecosystem testing: Conduct MCP service and Skill integration testing, ensuring consistency between services, with particular focus on cross-service interaction issues.
• Security and compliance testing: Design Prompt Injection, adversarial input security assessment plans, output compliance and risk control.

Requirements

• 3+ years of testing experience, solid computer science background, familiar with Python/TypeScript/Java, with automation development capabilities.
• Experience with LLM application testing, familiar with RAG, Agent workflows (LangChain/LangGraph), and AI application testing methodologies.
• Familiar with interface testing, CI/CD and pytest/Playwright testing frameworks; familiar with Linux and performance testing.
• Familiar with MCP protocol and Skill integration testing; familiar with automation testing tools (such as AI-assisted test generation) — preferred.
• Experience evaluating Ragas/DeepEval for LLM performance testing; familiar with Agent framework (AutoGen/MetaGPT) testing practices; familiar with computing/GPU performance testing and optimization — preferred.