Job Responsibilities
1. Quality Assurance Testing
Perform manual and automated testing for Android AI system features, applications, services, and both in-market and pre-release builds.
Create detailed test plans, write and execute test cases, and deliver test reports for new and existing functionalities.
Ensure comprehensive functional and non-functional test coverage, including device resource validation (memory, CPU, battery).
Add, update, maintain, and execute regression test suites and feature-based test cases.
Maintain test scripts, documentation, and continuously improve test coverage and quality.
2. Build Test Management
Monitor automated and manual build and test executions, including follow-through on failures or unexpected behaviors.
Perform and monitor manual/automated release processes for software builds, AI models, datasets, and configuration updates.
Review test code and configuration changes, and update test logic to accommodate new scenarios or feature updates.
3. Issue Triage Escalation
Conduct first-level triage for new issues and analyze logs, behavior mismatches, and failure patterns.
Provide daily updates on outstanding bugs, next steps, and clear recommendations for engineering teams.
Track, validate, and verify defects for each release cycle.
Escalate unresolved build errors, test harness failures, or complex issues when required.
4. AI Model Quality Analysis
Receive and distribute new model/data files for internal experimentation and development.
Perform essential model soundness checks (e.g., perplexity-based tests, basic validation).
Execute performance and accuracy benchmark tests (e.g., XSum, COCO-Text) and generate structured reports.
Monitor automated on-device AI model tests and triage or escalate unexpected output discrepancies.
Produce performance evaluation reports based on defined guidelines.
5. Test Resource Device Management
Maintain test devices and lab resources, including re-installing, configuring, and preparing devices for test execution.
Provide regular device-specific health and test result summaries to support system quality evaluation.
3 years of experience required
No management responsibility