QA:Test Cases
Every release undergoes numerous tests to validate a proper release of Rocky Linux. The 2026.10 update of release criteria is the latest coordination between Release Engineering and Testing Team.
Specific Testcases can/will be implemented in either openQA or Sparky/Sparrow. For further details, please see:-
- Testing's Meta Project repository
- os-autoinst-distri-rocky repository
- Sparky Rocky repository
For historical testing, please see the release channels in Mattermost chat.
For 9.9+, 10.3+ releases, please see TestRARC.
Icon guide:-
- ⬇️ - Low priority. It would be good to have this tested, but if it isn't or if it fails then it is inconsequential.
- ❗ - Important. It is best to have this tested, but if it isn't or if it fails then it won't block the release.
- ❌ - Release blocker. This must be tested and until it is, or if it fails, then the issue must be properly addressed.
The information below is intended to be for high level review. Details on which major release, architecture, and testing details are linked.
Community Testable Items¶
These are items which are easy for most to be able to test without having a requirement of specific hardware/software testing.
| Category | Requirement | Test Case | Status |
|---|---|---|---|
| ⬇️ | Physical Media Testing on CD/DVD/Bluray | To ensure a user can burn the ISO files to physical disc and boot/install from that disc. | Community, openQA |
| ❌ | Media Consistency Verification | To ensure that a user can write the ISO files to a thumbdrive and boot/install from that thumbdrive. | Community |
| ⬇️ | Boot Live Image | To ensure that each live environment can boot into the intended desktop. | Community |
| ❗ | FWUPD Secureboot | To ensure that secureboot and firmware updates function with the latest packages. | Community |
| ❗ | Test Upgrade | Ensure upgrades from previous versions work without issues. | Manual |
| ❗ | Test Torrents | Verify Torrents (when released). | Manual |
Initialization Requirements¶
| Category | Requirement | Test Case | Status |
|---|---|---|---|
| ❌ | Media Repoclosure | To ensure that there are no critical errors between release and upstream | Manual Script |
| ❌ | Media File Conflicts | To ensure that there are no critical errors between package streams. | Manual Script |
| ❗ | Repo Compare | To ensure packages in repositories match upstream. | Manual Script |
| ❌ | No Insights | To ensure Insights has been removed. | Manual Script |
| ❌ | No RHSM | To ensure RHSM has been removed. | Manual Script |
| ❌ | Debranding | Ensure all debranding has been applied properly. | Manual Script |
Installer Requirements¶
| Category | Requirement | Test Case | Status |
|---|---|---|---|
| ⬇️ | VNC Graphics Mode | EL9:- Ensure that systems with very basic graphics can install. | openQA |
| ⬇️ | Check RDP Graphics Mode | EL10:- Ensure that systems with very basic graphics can install. | openQA |
| ⬇️ | Packages and Installer Sources | Check all options for supported installation. | openQA |
| ❗ | Installation Interfaces | The installer must be able to complete an installation using all supported spokes. | openQA |
| ❗ | Minimal Installation | Ensure a minimal package set installation is functional. | openQA |
| ❗ | Kickstart Installation | Ensure kickstart installations are working. | openQA, Sparrow |
| ❗ | Disk Layouts | Test installs to a variety of partitions. | openQA |
| ❗ | Storage Volume Resize | Test resizing in the installation. | openQA |
| ❗ | Installer Help | Any element in the installer which contains a “help” text must display the appropriate help documentation when selected. | openQA |
| ❗ | Installer Translations | Test all translations available. | openQA |
Post-Installation Requirements¶
| Category | Requirement | Test Case | Status |
|---|---|---|---|
| ❌ | System Service SSHD | Ensure SSH works. | openQA, manual |
| ❌ | System Service FirewallD | Ensure FirewallD works. | openQA, manual |
| ❌ | System Service AuditD | Ensure AuditD works. | openQA, manual |
| ❌ | System Service ChronyD | Ensure ChronyD works. | openQA, manual |
| ❗ | Keyboard Layout | Test that keyboard matches layout. | openQA |
| ❗ | SELinux Errors on Server | Check for SELinux denials. | openQA |
| ❗ | SELinux Errors on Desktop | Check for SELinux denials. | openQA |
| ❗ | Application Functionality | Applications that can be launched within GNOME or on the command line must start successfully and withstand basic functionality tests. | openQA, manual |
| ❗ | GNOME UI Functionality | All elements of GNOME should function properly in regular use. | openQA, manual |
| ⬇️ | Multimonitor Setup | Computers using two monitors, the graphical output is correctly shown on both monitors. | manual |
| ⬇️ | Artwork and Assets | Proposed final artwork (such as wallpapers and other assets) must be included. A wallpaper from this package should show up as a default for GDM and GNOME. | manual |
| ⬇️ | Basic Package Installs | Packages (non-module) should be able to be installed without conflicts or dependencies on repositories outside of Rocky Linux. | openQA |
| ⬇️ | Module Stream Package Installs | Default modules (as listed in dnf module list) should be installed without requiring them to be enabled. Module streams should be able to be switched and those packages should be able to be installed without errors or unresolved dependencies. |
openQA |
| ⬇️ | Identity Management | It should be possible to setup a IdM server (FreeIPA), use it's functionality and connect clients. | openQA |
| ❗ | FIPS Mode | Verify FIPS mode is functional and working. | openQA |
Cloud Image Testing¶
| Category | Requirement | Test Case | Status |
|---|---|---|---|
| ❌ | Container Base | Verify Container Base is functional | manual |
| ❌ | Container Minimal | Verify Container Minimal is functional | manual |
| ❌ | Container UBI | Verify Container UBI is functional | manual |
| ❌ | GenericCloud | Verify GenericCloud is functional | manual |
| ❌ | Amazon EC2 | Verify Amazon EC2 image is functional | manual |
| ❌ | Azure | Verify Azure image is functional | manual |
| ❗ | Oracle | Verify Oracle image is functional | manual |
| ⬇️ | Vagrant - Libvirt | Verify Vagrant Libvirt image is functional | manual |
| ⬇️ | Vagrant - VirtualBox | Verify Vagrant VirtualBox image is functional | manual |
| ⬇️ | Vagrant - VMWare | Verify Vagrant VMWare image is functional | manual |
Sparrow/Sparky Testing¶
| Category | Requirement | Test Case | Status |
|---|---|---|---|
| Anacrond | Test documentation of Anacrond | Sparrow | |
| Bind | Test documentation of Bind | Sparrow | |
| Caddy | Test documentation of Caddy | Sparrow | |
| Chrony | Test documentation of Chrony | Sparrow | |
| Chyrp | Test documentation of Chyrp | Sparrow | |
| Cronie | Test documentation of Cronie | Sparrow | |
| DNF | Test documentation of DNF | Sparrow | |
| Knot | Test documentation of Knott | Sparrow | |
| Nvinx Multi Site | Test documentation of Nginx (Multi site) | Sparrow | |
| Nginx Single Site | Test documentation of Nginx (Single site) | Sparrow | |
| NFS | Test documentation of NFS | Sparrow | |
| NSD | Test documentation of NSD | Sparrow | |
| PHP | Test documentation of PHP | Sparrow | |
| Podman | Test documentation of Podman | Sparrow | |
| Python SSL | Test documentation of Python SSL | Sparrow | |
| Redis | Test documentation of Redis | Sparrow | |
| Slurm | Test documentation of Slurm | Sparrow | |
| Swap | Test documentation of Swap | Sparrow | |
| Tar | Test documentation of Tar | Sparrow | |
| Unbound | Test documentation of Unbound | Sparrow | |
| Wordpress LAMP | Test documentation of Wordpress LAMP | Sparrow | |
| XFS Recovery | Test documentation of XFS Recovery | Sparrow | |
| ZFS | Test documentation of ZFS | Sparrow |
SIG/AltArch¶
| Category | Requirement | Test Case | Status |
|---|---|---|---|
| ⬇️ | Raspberry Pi | Verify Raspberry Pi 3/3b/4/5 can be booted/upgraded | manual |
| ⬇️ | SiFive P550 | Verify P550 can be booted/upgraded | manual |
| ⬇️ | StarFive VisionFive2 | Verify VF2 can be booted/upgraded | manual |
Additional Information
If you have questions with respect to this content or to report concerns regarding the use or misuse content please do not hesitate to contact us at info@rockylinux.org.
Rocky Linux and the Rocky Enterprise Software Foundation (RESF) does not make any express or implied warranties, including but not limited to the warranties of non-infringement of any third party intellectual property rights. RESF does not warrant that any pending trademark applications for trademarks of RESF will result in any granted trademark protection. RESF shall not be liable for any claims relating to user's activities falling within the scope of the permission and user hereby agrees to indemnify, defend and hold RESF and its contributors harmless against any such claim.
This content is licensed under under Attribution-Share Alike 4.0 International license unless otherwise noted.
Author: Chris Stackpole
Contributors: Trevor Cooper, Bob Robison