Quality Assurance has never been more critical or more complex. Web products now ship on weekly or even daily
cadences, and user journeys evolve just as fast. Traditional automation strategies, anchored in Selenium or
Playwright, face pain points such as:
- Manual script creation wastes valuable Dev/QA time on maintaining test code instead of
focusing on high-impact tasks.
- Redundant UI flow coverage slows down releases as every minor design change demands
time-consuming locator updates.
- Tedious triage and reporting undermine stakeholder confidence due to fragmented logs, flaky
tests, and unclear test outcomes.
GenAI offers solution with LLMs can reason over DOM structures, disambiguate dynamic locators, and even write
robust scripts in seconds.
Aress GenAI based QA service addresses exactly this gap. Packaged as a lightweight Chrome extension
plus a stateless GenAI backend, it lets any tester record, generate, execute, and report with
a single
click—no framework fluency required.
Key Architectural Pillars
1. Event-Based Interaction Recorder
- Captures real-time user interactions with any web application directly in the browser.
- Logs essential actions such as clicks, inputs, selections, and navigation in a structured
JSON format.
- Designed to operate lightweight and non-intrusively for accurate reproduction.
2. LLM-Driven XPath Enhancement Engine
- Leverages a Large Language Model to analyze raw event data and generate precise,
context-aware XPath locators.
- Ensures robust element identification by understanding visual and semantic cues in the DOM
structure.
- Replaces default or generic selectors with intelligent alternatives.
3. Natural Language Action Plan Generator
- Translate structured event logs into a human-readable NLP-based action plan.
- Facilitates transparency and review before script generation.
4. Script Generation Engine
- Convert the action plan into executable Selenium automation scripts in the user preferred
language (Java).
- Supports easy integration into CI/CD pipelines or existing test frameworks.
5. Reporting and Export Module
- 1.Utilizes automation libraries to generate comprehensive test reports post script
generation.
- Includes test step validations, success/failure statuses, screenshots, and execution time.
- Allow users to download the automation reports for external use.
6. User-Friendly Chrome Extension Interface
- Simplified interface enabling users to record, generate scripts, execute scripts, and
download reports without writing any code.
- Intuitive UX to support both technical and non-technical users in streamlining test
automation workflows.
Below is schematic representation of flow of script generation and test execution using scripts.
Script generation in detail as below:
1. Event Capture and Structuring
User interactions such as clicks, inputs, and navigations are recorded in real-time into a standardized JSON
format, capturing relevant metadata, element details, and timestamps.
2. Intelligent XPath Generation
The recorded JSON is processed by a Large Language Model (LLM) to generate highly accurate and resilient
XPath selectors. These intelligent locators replace generic selectors to ensure robustness across varying
DOM states.
3. Natural Language Action Plan
A human-readable action plan is derived from enriched event data, providing clear, step-by-step descriptions
of the user journey. This acts as a reviewable blueprint before script generation.
4. Script Generation
The action plan is passed to LLM to generate clean Selenium scripts in the preferred language (Java). The
scripts follow best practices including structured waits, error handling, and modular code organization.
5. Test Report Generation
Scripts can optionally be executed in a headless environment to produce detailed test reports containing
execution logs, pass/fail statuses, and screenshots.
6. Output and Export
The execution of test scripts report is available for preview and download, allowing seamless integration
into local test environments or CI/CD pipelines.
Business Benefits
-
Increased Efficiency: Automation of locator generation saves significant time and
effort compared to manual identification.
-
Improved Locator Reliability: GenAI generated locators are more robust and less
prone to breakage due to UI changes.
-
Enhanced Test Maintainability: ABy centralizing locators in a factory class, test
scripts become easier to maintain and modify.
-
Accelerated Test Development: With reliable locators in place, test script creation
is expedited, leading to faster time-to-market.
Conclusion
GenAI based QA service offered by Aress collapses the distance between observation, automation, and insight. For QA Leads who are tasked with scaling quality without scaling headcount, it offers a pragmatic way to secure, deterministic AI based testing.
Dilbagh is a hands-on leader in Generative AI, AI/ML engineering, Data Science and
software development. With over 20 years of International experience. He has developed
groundbreaking AI and Generative AI solutions for global customers that helped solve complex
business problems and optimize processes.
He had developed GenAI Accelerators for generating Sections of
SoW(Statement of Work) using innovative metadata-driven dynamic chunk
mapping. A US patent have been filed for the solution. Other GenAI
Solutions included Secure Private GPT, an Email processor for license
information, Recruitment tool for matching JD with resumes and chat.