November 28, 2022 Magma Testing Meeting

4G Federation

Adding 4G Fed-Integration tests to Magma CI Dashboard

• Defined a list of 4G Fed Integ tests (see here)
• Adding test for HSS/OCS and PCRF

• Started: 15/07/2022

• Finish adding P0 tests into CI 30/09/2022

• Finish adding P1 tests into CI 30/11/2022

5G SA Tester

• Develop a new 5G CN tester for 5G SA (under 3-Clause BSD license)

• 5G SA Tester repo will be hosted at OAI during the development period (then, to be decided later on)

• Define different category of test cases for 5G

  • 5G Basic: Enable P0 tests (basic attach-detach type of test cases) on Magma CI and local dev env  (e.g., see here)

    • Progression can be see in this Magma Repo Issue

  • 5G Extended: Enable P1 tests on Magma CI and local dev env (e.g., see here)

  • 5G Federation: Add PCF tests on Magma CI (P2)

• 5G Basic

  • Start: 01/09/2022

  • Finish: 15/01/2023 (Adding first set of test and their results in CI-Dashboard)

• 5G Extended

  • Start: 16/01/2023

  • Finish: 30/04/2023

• 5G Federation

  • Start: 01/05/2023

  • Finish: 31/07/2023

CI Maintenance

A continuous task to make CI green

• CI Activity is tracked in the GitHub Issue

• In the last few months, OAI team helped Radisys team (owner of S1AP LTE integ tests) to fix LTE Integ flakiness issues that existed for long time

  • Tracking of failures in CI

  • Analysis of failures   

  • Proposing fixes to Radisys team (either in testing scenarios or in S1AP tester)

  • From now on, OAI team is only responsible for tracking the issues, then simply flag the failures to the Radisys team

• Worked on CWF Flakiness with TNG team

• Starting to work on containerization of S1AP tester to make it work on ARM servers

• It’s a continuous task-> no timeline

4G Federation

• Issue with Feg redis deployment (https://github.com/magma/magma/issues/14307)
• PCRF and OCS related test is going
  Created PR for mock PCRF test

5G SA Tester

CI Maintenance

• Enable S1AP Testing for Arm (AWS Resources for testing)

• Track LTE Integ tests fakiness:

  • https://github.com/magma/magma/issues/13954

• Track CWF Integ tests fakiness:
  • https://github.com/magma/magma/issues/14113