[uss_qualifier] Add test scenario for validation of op intents (#87)

* [uss_qualifier] Add test scenario for validation of op intents

* add config to suites and configurations for invalid flight intents scenario and resource

* remove valid_ended flight intent

* remove valid_very_close flight intent

* remove intent with many vertices injection

* add checks not planned

* add opin0040 check

* add validation for precision

* add kentland test data

* add kentland resources entry

Author: mickmis

monitoring/uss_qualifier/configurations/dev/f3548/flight_intent_validation.yaml

@@ -0,0 +1,21 @@
+v1:
+  test_run:
+    resources:
+      resource_declarations:
+        "$ref": ../resources.yaml#/f3548_single_scenario
+    action:
+      test_scenario:
+        scenario_type: scenarios.astm.utm.FlightIntentValidation
+        resources:
+          tested_uss: uss1
+          flight_intents: invalid_flight_intents
+          dss: dss
+  artifacts:
+    tested_roles:
+      report_path: output/tested_requirements.html
+      roles:
+      - name: Strategic Coordination role
+        requirement_set: astm.f3548.v21.scd
+        participants:
+        - uss1
+    "$ref": ../artifacts.yaml#/relative

monitoring/uss_qualifier/configurations/dev/local_test.json

@@ -21,6 +21,7 @@
             "flight_planners": "flight_planners",
             "conflicting_flights": "conflicting_flights",
             "priority_preemption_flights": "priority_preemption_flights",
+            "invalid_flight_intents": "invalid_flight_intents",
             "invalid_flight_auth_flights": "invalid_flight_auth_flights",
             "dss": "dss",
             "netrid_dss_instances_v19": "netrid_dss_instances_v19"

monitoring/uss_qualifier/configurations/dev/resources.yaml

@@ -54,6 +54,11 @@ che_flight_intents:
         specification:
             planning_time: '0:05:00'
             file_source: test_data.che.flight_intents.priority_preemption
+    invalid_flight_intents:
+      resource_type: resources.flight_planning.FlightIntentsResource
+      specification:
+        planning_time: '0:05:00'
+        file_source: test_data.che.flight_intents.invalid_flight_intents
 
 kentland_flight_intents:
     conflicting_flights:
@@ -66,6 +71,11 @@ kentland_flight_intents:
         specification:
             planning_time: '0:05:00'
             file_source: test_data.usa.kentland.flight_intents.priority_preemption
+    invalid_flight_intents:
+      resource_type: resources.flight_planning.FlightIntentsResource
+      specification:
+        planning_time: '0:05:00'
+        file_source: test_data.usa.kentland.flight_intents.invalid_flight_intents
 
 f3548_che:
     allOf:

monitoring/uss_qualifier/configurations/dev/self_contained_f3548.yaml

@@ -13,6 +13,7 @@ v1:
           flight_planners: flight_planners
           conflicting_flights: conflicting_flights
           priority_preemption_flights: priority_preemption_flights
+          invalid_flight_intents: invalid_flight_intents
           dss: dss
 
     # This block defines all the resources available in the resource pool.
@@ -57,6 +58,13 @@ v1:
             planning_time: '0:05:00'
             file_source: test_data.che.flight_intents.priority_preemption
 
+        # Details of flights with invalid operational intents (used in flight intent validation scenario)
+        invalid_flight_intents:
+          resource_type: resources.flight_planning.FlightIntentsResource
+          specification:
+            planning_time: '0:05:00'
+            file_source: test_data.che.flight_intents.invalid_flight_intents
+
         # Location of DSS instance that can be used to verify flight planning outcomes
         dss:
           resource_type: resources.astm.f3548.v21.DSSInstanceResource

monitoring/uss_qualifier/scenarios/astm/utm/__init__.py

@@ -1,3 +1,4 @@
+from .flight_intent_validation.flight_intent_validation import FlightIntentValidation
 from .nominal_planning.nominal_planning import NominalPlanning
 from .nominal_planning.conflict_higher_priority.conflict_higher_priority import (
     ConflictHigherPriority,

monitoring/uss_qualifier/scenarios/astm/utm/flight_intent_validation/flight_intent_validation.md

@@ -0,0 +1,165 @@
+# Validation of operational intents test scenario
+
+## Description
+This test checks that the USS validates correctly the operational intents it creates.
+Notably the following requirements:
+- **[astm.f3548.v21.OPIN0015](../../../../requirements/astm/f3548/v21.md)**
+- **[astm.f3548.v21.OPIN0020](../../../../requirements/astm/f3548/v21.md)**
+- **[astm.f3548.v21.OPIN0030](../../../../requirements/astm/f3548/v21.md)**
+- **[astm.f3548.v21.OPIN0040](../../../../requirements/astm/f3548/v21.md)**
+- **[astm.f3548.v21.GEN0500](../../../../requirements/astm/f3548/v21.md)**
+
+
+## Resources
+### flight_intents
+FlightIntentsResource that provides the following flight intents:
+- `valid_flight`: a valid operational intent upon which other invalid ones are derived, in `Accepted` state
+  - `valid_activated`: state mutation `Activated`
+  - `invalid_accepted_offnominal`: off-nominal volumes mutation: has (any valid) off-nominal volume
+    - `invalid_activated_offnominal`: state mutation `Activated`
+  - `invalid_too_far_away`: reference time mutation: reference time pulled back so that it is like the operational intent is attempted to be planned more than OiMaxPlanHorizon = 30 days ahead of time
+  - `valid_conflict_tiny_overlap`: volumes mutation: has a volume that overlaps with `valid_op_intent` just above IntersectionMinimumPrecision = 1cm in a way that must result as a conflict
+
+### tested_uss
+FlightPlannerResource that will be tested for its validation of operational intents.
+
+### dss
+DSSInstanceResource that provides access to a DSS instance where flight creation/sharing can be verified.
+
+
+## Setup test case
+### Check for necessary capabilities test step
+The USSs is queried for its capabilities to ensure this test can proceed.
+
+#### Valid responses check
+If the USS does not respond appropriately to the endpoint queried to determine capability, this check will fail.
+
+#### Support BasicStrategicConflictDetection check
+This check will fail if the flight planner does not support BasicStrategicConflictDetection per
+**[astm.f3548.v21.GEN0310](../../../../requirements/astm/f3548/v21.md)** as the USS does not support the InterUSS
+implementation of that requirement.
+
+### Area clearing test step
+The tested USS is requested to remove all flights from the area under test.
+
+#### Area cleared successfully check
+**[interuss.automated_testing.flight_planning.ClearArea](../../../../requirements/interuss/automated_testing/flight_planning.md)**
+
+
+## Attempt to plan invalid flight intents test case
+### Attempt to plan flight intent too far ahead of time test step
+The user flight intent that the test driver attempts to plan has a reference time that is more than
+OiMaxPlanHorizon = 30 days ahead of time from the actual intent. As such, the planning attempt should be rejected.
+
+#### Incorrectly planned check
+If the USS successfully plans the flight or otherwise fails to indicate a rejection, it means that it failed to validate
+the intent provided.  Therefore, this check will fail if the USS indicates success in creating the flight from the user
+flight intent, per **[astm.f3548.v21.OPIN0030](../../../../requirements/astm/f3548/v21.md)**.
+
+#### Failure check
+All flight intent data provided was complete and correct. It should have been processed successfully, allowing the USS
+to reject or accept the flight. If the USS indicates that the injection attempt failed, this check will fail per
+**[interuss.automated_testing.flight_planning.ExpectedBehavior](../../../../requirements/interuss/automated_testing/flight_planning.md)**.
+
+### [Validate flight intent too far ahead of time not planned test step](../validate_not_shared_operational_intent.md)
+
+
+## Attempt to specify off-nominal volume in Accepted and Activated states test case
+### Attempt to plan flight with an off-nominal volume test step
+The user flight intent that the test driver attempts to plan has an off-nominal volume.
+As such, the planning attempt should be rejected.
+
+#### Incorrectly planned check
+If the USS successfully plans the flight or otherwise fails to indicate a rejection, it means that it failed to validate
+the intent provided.  Therefore, this check will fail if the USS indicates success in creating the flight from the user
+flight intent, per **[astm.f3548.v21.OPIN0015](../../../../requirements/astm/f3548/v21.md)**.
+
+#### Failure check
+All flight intent data provided was complete and correct. It should have been processed successfully, allowing the USS
+to reject or accept the flight. If the USS indicates that the injection attempt failed, this check will fail per
+**[interuss.automated_testing.flight_planning.ExpectedBehavior](../../../../requirements/interuss/automated_testing/flight_planning.md)**.
+
+### [Validate flight intent with an off-nominal volume not planned test step](../validate_not_shared_operational_intent.md)
+
+### [Plan valid flight intent test step](../../../flight_planning/plan_flight_intent.md)
+The valid flight intent should be successfully planned by the flight planner.
+
+### Attempt to modify planned flight with an off-nominal volume test step
+The user flight intent that the test driver attempts to modify has an off-nominal volume and is in the `Accepted` state.
+As such, the modification attempt should be rejected.
+
+#### Incorrectly modified check
+If the USS successfully modifies the flight or otherwise fails to indicate a rejection, it means that it failed to validate
+the intent provided.  Therefore, this check will fail if the USS indicates success in modifying the flight from the user
+flight intent, per **[astm.f3548.v21.OPIN0015](../../../../requirements/astm/f3548/v21.md)**.
+
+#### Failure check
+All flight intent data provided was complete and correct. It should have been processed successfully, allowing the USS
+to reject or accept the flight. If the USS indicates that the injection attempt failed, this check will fail per
+**[interuss.automated_testing.flight_planning.ExpectedBehavior](../../../../requirements/interuss/automated_testing/flight_planning.md)**.
+
+### [Validate planned flight not modified test step](../validate_shared_operational_intent.md)
+Validate that the planned flight intent was not modified with an off-nominal volume.
+
+### [Activate valid flight intent test step](../../../flight_planning/activate_flight_intent.md)
+The valid flight intent should be successfully activated by the flight planner.
+
+### Attempt to modify activated flight with an off-nominal volume test step
+The user flight intent that the test driver attempts to modify has an off-nominal volume and is in the `Activated` state.
+As such, the modification attempt should be rejected.
+
+#### Incorrectly modified check
+If the USS successfully modifies the flight or otherwise fails to indicate a rejection, it means that it failed to validate
+the intent provided.  Therefore, this check will fail if the USS indicates success in modifying the flight from the user
+flight intent, per **[astm.f3548.v21.OPIN0015](../../../../requirements/astm/f3548/v21.md)**.
+
+#### Failure check
+All flight intent data provided was complete and correct. It should have been processed successfully, allowing the USS
+to reject or accept the flight. If the USS indicates that the injection attempt failed, this check will fail per
+**[interuss.automated_testing.flight_planning.ExpectedBehavior](../../../../requirements/interuss/automated_testing/flight_planning.md)**.
+
+### [Validate activated flight not modified test step](../validate_shared_operational_intent.md)
+Validate that the activated flight intent was not modified with an off-nominal volume.
+
+### [Delete valid flight intent test step](../../../flight_planning/delete_flight_intent.md)
+
+
+## Validate transition to Ended state after cancellation test case
+### [Plan flight intent test step](../../../flight_planning/plan_flight_intent.md)
+The valid flight intent should be successfully planned by the flight planner.
+
+### [Validate flight intent shared correctly test step](../validate_shared_operational_intent.md)
+Validate that the flight intent was shared correctly and is discoverable.
+
+### [Cancel flight intent test step](../../../flight_planning/delete_flight_intent.md)
+The flight intent should be successfully transition to Ended state by the flight planner.
+
+### Validate flight intent is non-discoverable test step
+#### Operational intent not shared check
+If the operational intent is still discoverable after it was transitioned to Ended,
+this check will fail per **[astm.f3548.v21.OPIN0040](../../../../requirements/astm/f3548/v21.md)**.
+
+
+## Validate precision of intersection computations test case
+### [Plan control flight intent test step](../../../flight_planning/plan_flight_intent.md)
+The valid control flight intent should be successfully planned by the flight planner.
+
+### Attempt to plan flight conflicting by a tiny overlap test step
+The tested USS is instructed to plan a flight that is constructed in a way that it intersects by just over IntersectionMinimumPrecision = 1 cm.
+
+#### Incorrectly planned check
+If the tested USS successfully plans the flight or otherwise fails to indicate a rejection, it means that it failed
+to correctly compute the conflicting intersection. Therefore, this check will fail if the USS indicates success in
+planning the flight from the user flight intent, per **[astm.f3548.v21.GEN0500](../../../../requirements/astm/f3548/v21.md)**.
+
+#### Failure check
+All flight intent data provided was complete and correct. It should have been processed successfully, allowing the USS
+to reject or accept the flight. If the USS indicates that the injection attempt failed, this check will fail per
+**[interuss.automated_testing.flight_planning.ExpectedBehavior](../../../../requirements/interuss/automated_testing/flight_planning.md)**.
+
+### [Validate conflicting flight not planned test step](../validate_not_shared_operational_intent.md)
+
+
+## Cleanup
+### Successful flight deletion check
+**[interuss.automated_testing.flight_planning.DeleteFlightSuccess](../../../../requirements/interuss/automated_testing/flight_planning.md)**