Overview
Join our team to work on a modern AI-powered observability platform that helps organizations monitor, analyze, and understand the value generated by AI systems and AI agents.
The platform collects telemetry and tracing data from AI workflows and transforms it into actionable business insights for both technical and non-technical stakeholders. It helps organizations understand AI performance, operational costs, business impact, reliability, and quality across AI-driven processes.
As a Senior Manual QA Engineer, you will play a critical role in ensuring the accuracy, reliability, and trustworthiness of the platform. Product quality is essential, as incorrect calculations, reporting issues, or workflow inconsistencies can directly impact customer confidence and business decisions.
This is an opportunity to join an early-stage product, work closely with the founding team, and help establish quality practices in a fast-moving, AI-focused environment.
Purpose of the Role
We are looking for a Senior Manual QA Engineer who can take ownership of quality assurance activities across the product and operate with a high level of independence.
This role goes beyond executing test cases. We are looking for someone who can think critically, challenge assumptions, investigate complex workflows, identify risks, and help build a strong quality culture from an early stage.
You will work closely with Product Managers, Engineers, and company leadership to validate business logic, AI-related workflows, reporting accuracy, integrations, and overall product reliability.
Duties & Responsibilities
- Analyze requirements, user stories, and technical designs to identify testing needs and quality risks.
- Design, document, and execute manual test cases for functional, regression, exploratory, integration, and end-to-end testing.
- Validate complex business workflows, calculations, dashboards, reporting systems, and data flows.
- Investigate issues, reproduce defects, and work closely with engineers to support resolution.
- Perform exploratory testing to identify edge cases, unexpected behaviors, and potential product risks.
- Verify AI-related workflows, outputs, scoring systems, and reporting accuracy.
- Test APIs, integrations, and data consistency across multiple services and systems.
- Participate in product discussions and contribute to quality-focused decision-making.
- Help establish and improve QA processes, release validation practices, and testing standards.
- Leverage AI tools to improve testing efficiency, analysis, documentation, and investigation activities.
- Ensure consistent quality across new features, enhancements, and platform releases.
- Act as a quality advocate across the organization.
Required Experience & Knowledge
- Minimum of 5 years of professional experience in Software Quality Assurance.
- Strong experience in Manual QA for complex web-based products.
- Experience working independently and taking ownership of quality processes.
- Strong understanding of software testing methodologies, including:
- Functional Testing
- Regression Testing
- Exploratory Testing
- Integration Testing
- End-to-End Testing
- Experience creating detailed test cases and test plans based on requirements.
- Experience with API testing using Postman or similar tools.
- Experience validating business logic, reporting, calculations, or data-heavy workflows.
- Strong defect investigation and root-cause analysis skills.
- Familiarity with issue tracking and project management tools such as Jira or similar.
- Experience working within Agile/Scrum environments.
- Experience using AI-assisted tools such as Claude, ChatGPT, Cursor, GitHub Copilot, or similar solutions as part of daily work.
- Strong communication skills and ability to collaborate with technical and non-technical stakeholders.
- Experience working in startup environments or fast-changing product organizations is considered a strong advantage.
Skills and Attributes
- Excellent attention to detail and analytical thinking.
- Strong problem-solving and investigation skills.
- High level of ownership and accountability.
- Ability to work independently with minimal supervision.
- Curiosity and willingness to challenge assumptions.
- Strong communication and collaboration skills.
- Comfortable working in ambiguous and evolving environments.
- Passion for quality, continuous improvement, and emerging AI technologies.
- Ability to balance quality, speed, and business priorities.
Required Education & Qualifications
- Fluency in English (both written and spoken) is a must.
- Bachelor’s degree in Computer Science, Information Technology, Software Engineering, or a related field (or equivalent practical experience).
- Experience testing AI-powered products, AI workflows, LLM applications, or AI agent systems is considered a strong advantage.
- Experience with SQL, data validation, or analytics platforms is a plus.
- Experience with automation testing tools or frameworks is a plus.
- Experience working with distributed international teams is a plus.
