History: Tiki Profiles Tester

Executive Summary

Tiki Profiles Tester is a tool to automate the testing of Tiki Profiles for various Tiki versions. And thus, it helps the Tiki community detect issues, like Smoke testing.

Code

• https://gitlab.com/tikiwiki/ci-helpers/tiki-profiles-tester

Status

As of 2023-02-14, this is in beta. Please expect some refinements in coming months.

How to see in action

• It runs it is planned that it will run once per week
• It catches profile validation errors and adds them as information on this dashboard: https://tikiwiki.gitlab.io/ci-helpers/tiki-profiles-tester/

How to update

• profiles
• Tiki versions

Thank yous

• Thank you xavidp for the original idea and code: https://github.com/xavidp/TikiProfilesTester (a sample report)
• Thank you xorti and SoftStart for the modern and future-proof implementation
• Thank you GitLab for letting us use free CPU: https://gitlab.com/tikiwiki/ci-helpers/tiki-profiles-tester/-/blob/master/.gitlab-ci.yml

How and where to report bugs

Not yet. As of 2023-02-14, we already know of things to do. When we finish that, we'll open up for suggestions

Questions

• What should be domain name for https://tikiwiki-ci.gitlab.io/tiki-profiles-tester/?
  • profiles-tester.tiki.org ?
  • tiki-profiles-tester.tiki.org ?
  • something else?

Ideas for the future

• Run for each commit, as part of the CI
• Run other tests like TikiTests
• Visit wiki pages like the ones generated by http://profiles.tiki.org/Test_All_Plugins
• Have a way to test a specific branch / merge request (will save time from developers who are reviewing merge requests)
• System Features
• Alert specific people of errors