Purpose of the Role
We are looking for a Quality Engineer to join a fast-growing startup building an AI observability and analytics platform.
The product helps organizations understand how AI-powered systems perform by transforming complex telemetry, usage, and operational data into actionable business insights. By collecting and analyzing signals from modern AI applications, agent-based workflows, and data integrations, the platform enables business and operations teams to measure cost, performance, efficiency, and business impact.
In this role, you will take ownership of quality across the entire platform, ensuring that data is processed correctly, calculations remain accurate, and new features can be released with confidence.
As one of the first dedicated quality professionals on the team, you will help define testing practices, build automation frameworks, establish release quality standards, and collaborate closely with engineering and product teams in a highly autonomous environment.
This position is ideal for someone who enjoys solving complex quality challenges, working with data-intensive systems, and helping shape quality processes from the ground up.
Duties & Responsibilities
- Design, implement, and maintain automated test coverage across backend services, APIs, integrations, and data-processing workflows.
- Validate the accuracy and consistency of platform calculations, metrics, and reporting outputs.
- Create testing strategies for complex data pipelines, event processing systems, and AI-related workflows.
- Identify, reproduce, and document defects with clear and actionable information for engineering teams.
- Build validation mechanisms that detect silent data inconsistencies, regressions, and unexpected behavioral changes.
- Define and maintain release quality gates to ensure safe and reliable product deployments.
- Collaborate closely with software engineers, product managers, and leadership to proactively identify quality risks.
- Develop test datasets, test environments, and monitoring approaches that improve confidence in production releases.
- Participate in root-cause analysis and support continuous improvement initiatives.
- Contribute to CI/CD quality practices and automated validation processes.
Required Skills & Experience
- 5+ years in software engineering, SDET, or QA automation roles, with hands-on coding
- Strong experience with API testing and test automation.
- Experience building test frameworks, harnesses, internal developer tooling, test-data generators, or service mocks/simulators from scratch.
- Contribute insights and code to improve testability, instrumentation, and observability of the product.
- Experience testing backend systems, integrations, microservices, or data-intensive applications.
- Solid SQL skills and experience validating data across systems.
- Experience analyzing logs, debugging issues, and investigating complex defects.
- Experience working with CI/CD pipelines and automated release processes.
- At least 1 year of hands-on experience using AI-assisted software development tools, specifically Claude Code.
- Experience working with AI, LLM, agent-based systems, or AI-powered applications.
- Strong understanding of how AI-assisted development impacts testing, quality assurance, and release confidence.
- Experience testing AI-powered products, LLM-based applications, AI agents, or intelligent workflows.
- Familiarity with the core technology stack:
- Python
- PostgreSQL
- React
- Rust
- Experience with observability, telemetry, monitoring, or event-driven architectures.
- Familiarity with OpenTelemetry, Datadog, Grafana, Prometheus, or similar tools.
- Experience validating billing, metering, reporting, financial, or business-critical calculations.
- Previous startup or early-stage company experience.
- Demonstrated curiosity, ownership, and the ability to proactively identify and solve problems with minimal supervision.
- Ability to work independently in a fast-moving startup environment.
- Professional-level English communication skills.
Personal Attributes
- Self-starter with a strong sense of ownership.
- Naturally curious and proactive in identifying risks before they become issues.
- Comfortable working in ambiguous and rapidly evolving environments.
- Strong attention to detail without losing sight of the bigger picture.
- Collaborative mindset with a practical, solution-oriented approach.
- Passion for quality, reliability, and continuous improvement.
What We Offer
- 100% remote work environment.
- Opportunity to join a rapidly growing product-focused team.
- Direct collaboration with experienced engineering and product leaders.
- High degree of ownership and impact.
- Exposure to cutting-edge AI technologies and modern software architectures.
- Flexible and autonomous working culture.
- Long-term collaboration in a fast-moving and innovative environment.
