feat: add support for Ubuntu 24.04

[Rico Lin (ricolin)]

Summary

Add support for Ubuntu 24.04-based Atmosphere deployments from main.

This branch has been rebuilt on main and no longer carries the PR #3842 stack.

Depends-On: vexxhost/ansible-collection-ceph#113
Depends-On: vexxhost/atmosphere.common#117

Changes

• bump the incompatible ansible.netcommon Galaxy collection pin for the current Ansible stack
• use ansible_facts[...] in Molecule AIO preparation for modern Ansible compatibility
• keep the existing Magnum _magnum_images catalog and use magnum_images: "{{ _magnum_images[-1:] }}" so Molecule uploads only the newest image
• render affected kubernetes.core.k8s templates explicitly through definition
• unwrap Ansible lazy template values before validating storage filter inputs
• replace endpoint key discovery via json_query('keys(endpoints)') with native Jinja key handling
• fix the Open vSwitch keepalived first-boot deadlock by waiting for the VIP interface to exist before assigning the VIP
• wait for Neutron network availability zones before provisioning configured networks
• keep Ceph fake-device compatibility in the dependent Ceph collection PR instead of adding local fake-device playbooks
• keep secretgen_controller template rendering in the dependent atmosphere.common PR
• add the Ubuntu 24.04 release note

Validation

Local main-based branch:

• git diff --check
• pre-commit run black --files plugins/filter/storage.py
• Python 3.12 pre-commit run --all-files: Black, flake8, and isort passed; local ansible-lint bootstrap reached repo linting but failed on unrelated galaxy[no-changelog] behavior not seen in GitHub Actions, where Ansible-lint passed
• Python 3.12 focused storage unit test: 6 passed
• reno report --output /tmp/atmosphere-pr4009-reno.rst
• ansible-playbook --syntax-check molecule/aio/prepare.yml
• ansible-playbook --syntax-check molecule/aio/converge.yml

The syntax checks used a temporary ANSIBLE_COLLECTIONS_PATH containing this PR plus dependency PR #113 and atmosphere.common PR #117.

Open vSwitch AIO on 38.108.68.141:

• initial OVS AIO deploy and Tempest verify completed successfully after adding the Neutron availability-zone wait
• Tempest smoke passed: Ran: 131, Passed: 129, Skipped: 2, Failed: 0
• main-based PR tree rerun on .141: 47bf111dd927cea496b5e2ad1c208230ca8f4d12
• current PR head after CI formatting fix: 42afbf63660a9b82562c79c2eebcc5dac2ab3b59
• current PR tree after CI formatting fix: 67d1eb9c1eca1164be6f1362013da6eb42c391b5
• rerun finished with no failed recaps
• Neutron wait executed before network creation, then Neutron completed:
  • Wait until network availability zones are ready
  • Create networks
  • ==> [neutron] Deployment complete
• Octavia and Magnum completed on the rerun:
  • ==> [octavia] Deployment complete
  • ==> [magnum] Deployment complete
  • [magnum/magnum] instance : ok=50 changed=5 unreachable=0 failed=0 skipped=21 rescued=0 ignored=0
• post-rerun checks passed: node Ready, no bad pods, Helm releases deployed, 41 OpenStack endpoints, Nova services up, OVS Neutron agents alive/up, Magnum image active, Ceph PGs active+clean with only the expected AIO no-replica warning
• detailed environment note: /home/rico/notes/logs/atmosphere/260616.pr4009-ovs-aio-38-108-68-141.md

Previous validation retained from this PR before the main retarget:

• OVN AIO on 38.108.68.159 with dependency PRs installed passed deploy and verify
• dependency PR code was verified in /root/.ansible/collections on .159 before deploy:
  • vexxhost.ceph PR build(deps): bump tj-actions/changed-files from 31.0.3 to 32.0.0 #113 fake-device playbook loops over ceph_osds instead of reading item.invocation.module_args.vg
  • atmosphere.common PR feat: allow for a custom ingressClassName on OpenStack component ingress objects #117 secretgen_controller renders release.yml.tpl through lookup('ansible.builtin.template', ...) | from_yaml_all | list
• Tempest smoke on .159 passed: Ran: 164, Passed: 163, Skipped: 1, Failed: 0
• .159 provider-network scenario passed: tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops ... ok
• earlier OVS AIO on 38.108.68.150 passed tox -e molecule-aio-openvswitch
• .150 Tempest smoke passed: Ran: 131, Passed: 129, Skipped: 2, Failed: 0
• .150 post-build checks passed: node Ready, no non-running pods, no non-deployed Helm releases, 41 OpenStack endpoints, Nova services up, OVS Neutron agents up, and expected AIO Ceph no-replica warning only

[Rico Lin (ricolin)]

covered with https://github.com/vexxhost/atmosphere/pull/4010/changes

[Mohammed Naser (mnaser)]

Rico Lin (@ricolin) can we not have this stacked for now and just have it on a seperate change?

[Rico Lin (ricolin)]

Rico Lin (Rico Lin (@ricolin)) can we not have this stacked for now and just have it on a seperate change?

yes, stuck these up just for me to easier to test locally. will seperate those works