How can we improve the End to End Tests

[liamfallon]

The End to End tests in Nephio work well to test the Nephio functionality. However, there are a number of issues in the Nephio functions and in the testing. Following experience in R3 where it was difficult to get the tests to pass, we can improve the tests.

Here is a preliminary list of areas fir improvement

1. Make it easier to identify why a test has failed, identifying the faulty component or component that has timed out

• Identify where possible if it is an infrastructure component or a Nephio function that has failed
• Identify what component has failed clearly
• Identify what component has timed out more clearly

2. Decrease the execution time of the tests

• Allow some operations to be executed in parallel
• Explore using pre-canned VMs with clusters already created
• Re-design tests to perhaps have more shorter tests
• Re-design tests to rely less on timeouts