bottest-ai changelog
Execute Suite Runs in the Cloud + Scheduling
We're excited to announce two powerful new features that give you more flexibility and control over your Test automation: Cloud Suite Runs and Scheduled Suite Runs.
Cloud Suite Runs
Leaving behind the limitations of browser-based testing, you can now execute your Test Suites directly in our cloud infrastructure. You can do so in the main Dashboard by simply pressing the "Run Suite" button, and selecting the Cloud option. This gives you the benefits of:
Freeing of your local device resources, as you no longer need to use our chrome extension to open tabs to execute Tests.
Ability to benchmark your chatbot's performance with accurate user load Testing. You can set how many parallel executions should happen at once, and ensure your chatbot can withstand a specific number of concurrent users. You can configure this option in the Suite Settings.
Improved stability and reliability. Oftentimes, the replaying process will fail due to one-off issues on your local device (such as your browser crashing, running out of memory, or generally not being able to handle the concurrent tests replaying all at once). Running Tests in the cloud will increase the stability and reliability of executions.
Scheduled Suite Runs
You can now schedule your Suite Runs to run on an automated schedule of your choosing, and customize each Suite + Environment combination to run on daily, weekly, and monthly schedules! These scheduled Suite Runs will be executed in the Cloud automatically, completely automated and hassle-free. You can configure this for your Suites in the Suite Runs Dashboard, clicking the "Schedule Suite Run" button.
Note that depending on whether your chatbot requires authentication to access, you will need to setup Auto-Login for Suite Runs in the cloud to work properly.
Coming soon, we are looking to add email/Slack/etc notifications upon the completion of a scheduled Suite Runs, along with an attatched PDF version of the generated report. If this is something that seems useful, help us prioritize this feature here!