We’re building an ecosystem of digital products and services that power everyday life across the Middle East—fast, scalable, and deeply customer‑centric. Our mission is to deliver to every door every day. We want to redefine what technology can do in this region, and we’re looking for an IT Network Engineer who can help us move even faster.
noon’s mission: Every door, every day.
Job Summary:
We are looking for a curious, thoughtful, and detail-oriented QA Analyst to join our team building AI-powered customer experiences for e-commerce. You will help improve our conversational AI chatbot, support its evolution into Voice AI, and test AI agents that automate customer-support tickets and workflows.
This is not a traditional QA role focused only on predictable software behavior. Alongside testing user interfaces, APIs, and integrations, you will explore how non-deterministic AI systems behave across different conversations, customer contexts, languages, and edge cases. You will design and execute test cases, evaluate agent responses in English and Arabic, investigate failures, and help ensure our AI applications meet the required quality, reliability, safety, and user-experience standards.
This opportunity is well suited to an early-career QA professional, fresh graduates and individuals with one to two years of experience, a solid foundation in software testing, and a genuine interest in AI and LLM-based applications. You do not need to be an expert in LLM evaluation already. We are looking for someone who is analytical, eager to learn, comfortable experimenting with emerging technologies, and motivated to help create high-quality AI products used by real customers.
Responsibilities:
- Contribute to test planning, effort estimation, test execution, and change‑impact analysis, including changes to prompts, models, tools, and agent workflows.
- Design and execute test cases across user interfaces, APIs, integrations, conversational flows, emerging voice experiences, and non‑deterministic AI behavior.
- Perform functional, system, integration, API, exploratory, regression, and smoke testing, as well as structured evaluation of agent responses.
- Evaluate AI responses for qualities such as relevance, accuracy, groundedness, safety, tone, consistency, context handling, and appropriate escalation to human support.
- Identify, reproduce, and clearly document defects, and help maintain effective bug‑reporting and triage workflows.
- Provide input on high‑level test scenarios, evaluation criteria and rubrics, risks, test data, resource needs, and effort estimates during planning.
- Collaborate with AI engineers, software engineers, product managers, designers, and operations teams to estimate and prioritize testing and evaluation activities.
- Troubleshoot quality issues and contribute to improving test procedures, regression suites, and evaluation datasets.
- Review product specifications, acceptance criteria, conversational designs, and agent evaluation rubrics to identify ambiguities, gaps, and potential quality risks.
- Help validate customer‑support journeys and workflows involving areas such as orders, refunds, deliveries, warranties, payments, and product queries.
Must haves:
- Knowledge or up to 1 year of hands‑on experience with functional, integration, system, or regression testing.
- An open‑minded, bias for action mindset, with the confidence to experiment, learn quickly from mistakes, continuously improve, and actively consider ideas and feedback from others.
- A sound understanding of software engineering fundamentals, SDLC, STLC, and core QA principles.
- Good time‑management and organizational skills, with the ability to work independently on multiple activities with overlapping timelines.
- The ability to learn quickly and work effectively both independently and as part of a cross‑functional team.
- A genuine interest in conversational AI, LLM‑based systems, and emerging approaches to testing AI applications.
- Strong analytical, conceptual, and problem‑solving abilities.
- Clear written and verbal communication skills and collaborate with team members located in multiple countries.
- A critical‑thinking mindset and close attention to detail.
- Hands‑on experience contributing to an automation framework and its reporting in at least one area, such as API, web, mobile, or LLM and agent evaluation automation.
- A working knowledge of SQL, databases, and data validation.
- Fluency in written and spoken English and Arabic, with the ability to assess the accuracy, clarity, tone, and overall quality of AI‑generated responses in both languages.
Good to have:
- A BE, BTech, MCA, bachelor’s degree, or equivalent practical background in Computer Science, Software Engineering, or a related field.
- Testing experience with e-commerce, logistics, customer‑support, or marketplace platforms.
- Experience using performance or load‑testing tools.
- Familiarity with LLM evaluation, experimentation, or observability tools.
- Experience testing voice interfaces, speech‑based applications, or contact‑center workflows.
- An ISTQB Foundation or Advanced certification, or the ISTQB Certified Tester AI Testing certification.
Who will excel -
- We’re looking for people with high standards, who understand that hard work matters.
- You need to be relentlessly resourceful and operate with a deep bias for action.
- We need people with the courage to be fiercely original.
- noon is not for everyone; readiness to adapt, pivot, and learn is essential.
#J-18808-Ljbffr