History: Tiki Profiles Tester

            !! Executive Summary
Tiki Profiles Tester is a tool to automate the testing of ((doc:Profiles|Tiki Profiles)) for various Tiki versions. And thus, it helps the Tiki community detect issues, like [https://en.wikipedia.org/wiki/Smoke_testing_(software)|Smoke testing].

!! How to see in action
It catches profile validation errors and adds them as information on this dashboard: https://tikiwiki.gitlab.io/ci-helpers/tiki-profiles-tester/

!! Code
* https://gitlab.com/tikiwiki/ci-helpers/tiki-profiles-tester

!! Status
As of 2023-02-14, this is in beta. Please expect some refinements in coming months.

!! How to update
* --It runs-- it is planned that it will run once per week. It also runs anytime someone modifies the code. As of 2023-02-14, it takes about 30 minutes to run all tests.
* [https://gitlab.com/tikiwiki/ci-helpers/tiki-profiles-tester/-/blob/master/scripts/profiles.txt|profiles]
* [https://gitlab.com/tikiwiki/ci-helpers/tiki-profiles-tester/-/blob/master/.gitlab-ci.yml|Tiki versions]

!! Thank yous
* Thank you xavidp for the original idea and code: https://github.com/xavidp/TikiProfilesTester ([https://github.com/xavidp/TikiProfilesTester/blob/master/results/161122/results_15.x.csv|a sample report])
* Thank you xorti and [https://softstart.io/|SoftStart] for the modern and future-proof implementation
* Thank you GitLab for letting us use free CPU: https://gitlab.com/tikiwiki/ci-helpers/tiki-profiles-tester/-/blob/master/.gitlab-ci.yml

!! How and where to report bugs
As of 2023-02-14, you can reach out to Marc Laporte.

!! Questions
* What should be domain name for https://tikiwiki-ci.gitlab.io/tiki-profiles-tester/?
** profiles-tester.tiki.org ?
** tiki-profiles-tester.tiki.org ?
** something else?

!! Ideas for the future
* Run for each commit, as part of the CI
* Run other tests like ((doc:TikiTests))
* Visit wiki pages like the ones generated by http://profiles.tiki.org/Test_All_Plugins 
* Have a way to test a specific branch / merge request (will save time from developers who are reviewing merge requests)
* ((dev:System Features))
* Alert specific people of errors
* Connect to ((Dev:GlitchTip))

~tc~ (alias(Tiki Profile Tester)) ~/tc~
~tc~ (alias(Tiki Instance Tester)) ~/tc~