Integrated performance tests into the CI system

Issue/feature addressed

Implemented performance testing (!1614 (merged)) into the CI system. This merge request should be stacked with !1614 (merged).

Proposed solution

Average execution time has been added as a test metric that can be used. One performance test -- IncNavierStokesSolver_Perf_ChanFlow_3DH1D_pRef -- would become active in this solution.

This test would run 15 times on the relatively quiet runner 42 (stpancras) and fail if the average execution time was outside ~5% of the baseline.

Implementation

• New debian-bullseye-performance-build-env job -- based on default-build-env but with NEKTAR_BUILD_PERFORMANCE_TESTS_ON and other tests OFF. Runs on runner 42 (stpancras)
• New debian-bullseye-performance-build-and-test job
• When docker images are run, the hostname is now manually specified as CI_RUNNER_ID.CI_JOB_NAME (e.g. 42.debian-bullseye-performance-build-and-test). This ensures that performance tests will only run if they are on the right runner.

Tests

IncNavierStokesSolver_Perf_ChanFlow_3DH1D_pRef

Suggested reviewers

@ccantwel (UROP supervisor)

Notes

Please add any other information that could be useful for reviewers.

Checklist

• Functions and classes, or changes to them, are documented.
• User guide/documentation is updated.
• Changelog is updated.
• Suitable tests added for new functionality.
• Contributed code is correctly formatted. (See the contributing guidelines).
• License added to any new files.
• No extraneous files have been added (e.g. compiler output or test data files).

changed the description

marked the checklist item Contributed code is correctly formatted. (See the contributing guidelines). as completed

added 1 commit

• b8413653 - Updated CHANGELOG

Compare with previous version

marked the checklist item Changelog is updated. as completed

marked this merge request as ready

mentioned in merge request !1631 (merged)

@twg21 Can you rebase on master to resolve the merge conflicts? Then we can try and get this one in too.

changed milestone to %v5.4.0

added build system label

assigned to @ccantwel

added 37 commits

• b8413653...f0fc5d26 - 36 commits from branch nektar:master
• 919e7b5e - Merge branch 'master' into 'feature/CI-perf-monitoring'

Compare with previous version

added 1 commit

• 29d7ca57 - Updated Perf_ChanFlow test to match those in !1631 (merged)

Compare with previous version

This all looks good and the pipeline passes with the new test

approved this merge request

marked the checklist item User guide/documentation is updated. as completed

marked the checklist item User guide/documentation is updated. as incomplete

merged

mentioned in commit e0ea9a8c