ML path selection #60

sergeyrid · 2023-09-07T09:52:55Z

No description provided.

…th-selection # Conflicts: # buildSrc/src/main/kotlin/Versions.kt # usvm-core/src/main/kotlin/org/usvm/Machine.kt # usvm-core/src/main/kotlin/org/usvm/ps/PathSelectorFactory.kt # usvm-jvm/build.gradle.kts

…th-selection

# Conflicts: # usvm-core/build.gradle.kts

…h-selection

…th-selection

usvm-ml-path-selection/src/main/kotlin/org/usvm/ModifiedUMachineOptions.kt

usvm-ml-path-selection/src/main/kotlin/org/usvm/MLConfig.kt

Saloed · 2023-09-12T11:57:57Z

usvm-ml-path-selection/src/main/kotlin/org/usvm/statistics/CoverageCounterStatistics.kt

+class CoverageCounterStatistics<State : UState<*, *, *, *, State>>(
+    private val coverageStatistics: CoverageStatistics<*, *, State>,
+    private val coverageCounter: CoverageCounter,
+    private val methodName: String


Do we include method signature here?

usvm-ml-path-selection/src/main/kotlin/org/usvm/ps/BlockGraph.kt

usvm-ml-path-selection/src/main/kotlin/org/usvm/util/ModifiedUtil.kt

usvm-ml-path-selection/src/main/kotlin/org/usvm/CoverageCounter.kt

usvm-ml-path-selection/src/main/kotlin/org/usvm/machine/ModifiedJcMachine.kt

…th-selection

usvm-ml-path-selection/src/main/kotlin/org/usvm/ps/FeaturesLogger.kt

Saloed · 2023-10-20T14:00:35Z

usvm-ml-path-selection/src/main/kotlin/org/usvm/CoverageCounter.kt

+            testStatementsCounts.values.sum(),
+            testFinished.values.sumOf { if (it) 1.0 else 0.0 }.toFloat(),
+        )
+        return Json.encodeToJsonElement(statistics).jsonObject


It is better to return a statistics object, avoiding serialization to json.

Saloed · 2023-10-20T14:02:27Z

usvm-ml-path-selection/src/main/kotlin/org/usvm/ps/FeaturesLogger.kt

+        if (path.isEmpty()) {
+            return
+        }
+        val jsonData = buildJsonObject {


It is better to use serializable object instead of creating a json manually.

The first field of this object would need to be a multidimensional array of floats of unknown depth. I can think of 2 ways of making it serializabe: writing a custom serializer or making it a JsonArray. Both options seem to me like doing almost the same thing as creating a json manually, but probably even worse.

Saloed · 2023-11-08T13:15:02Z

usvm-ml-path-selection/src/main/kotlin/org/usvm/ps/BlockGraph.kt

+        return blockList.map { getBlockFeatures(it) }
+    }
+
+    fun saveGraph(filePath: Path) {


It is better to split the BlockGraph data structure and graph printer

Saloed · 2023-11-08T13:16:40Z

usvm-ml-path-selection/src/main/kotlin/org/usvm/ps/MachineLearningPathSelector.kt

+            env, edgesDataBuffer,
+            edgesShape.map { it.toLong() }.toLongArray()
+        )
+        val result = gnnSession!!.run(mapOf(Pair("x", featuresData), Pair("edge_index", edgesData)))


mapOf("x" to featuresData)

Saloed · 2023-11-08T13:17:07Z

usvm-ml-path-selection/src/main/kotlin/org/usvm/ps/MachineLearningPathSelector.kt

+        )
+        val result = gnnSession!!.run(mapOf(Pair("x", featuresData), Pair("edge_index", edgesData)))
+        val output = (result.get("output").get().value as Array<*>).map {
+            (it as FloatArray).toList()


It is better to use FloatArray if possible

* fix: lint * fix: inherit test method annotations from fakeMethod * feat: introduce reflection utils renderer, remove spring import manager * Fix class expression render for primitive and array types (UnitTestBot#144) * Fix empty unbound wildcard type bound (UnitTestBot#147) * feat: introduce reflection utils inline strategy Signed-off-by: Andrew Petrukhin <dartmol2300@gmail.com> * refactor: update reflection utils inline strategy ownership * fix: update JcSpringMvcTestTransformer.kt to match actual context init * fix: style * feat: remove unsafe import manager * fix: pass isAccessibleFromTestClass separately from inline strategy * fix: remove file renderer from unsafe utils renderer * fix: style --------- Signed-off-by: Andrew Petrukhin <dartmol2300@gmail.com>

sergeyrid and others added 30 commits July 7, 2023 12:19

Add BfsWithLoggingPathSelector

c28ceb6

Add features to BfsWithLoggingPathSelector

26be358

Add jsonAggregator

7df7145

Add InferencePathSelector

c8f0dfa

Fix jsonAggregator and InferencePathSelector

a93a138

Change jsonAggregator and fix path selectors

11ee239

Add graph visualization and alternative reward

8987aa7

Fix bugs and paths, add hashes to final json

5a33d7a

Add BlockGraph to BfsWithLoggingPathSelector

5310c7c

Add BlockGraph logging

da8e9dd

Add concurrency and fix bugs

fb8f93b

Add features, fix bugs and refactor

3523c44

Add features, fix bugs and refactor

575a266

Merge branch 'main' of https://github.com/UnitTestBot/usvm into ml-pa…

f85016c

…th-selection # Conflicts: # buildSrc/src/main/kotlin/Versions.kt # usvm-core/src/main/kotlin/org/usvm/Machine.kt # usvm-core/src/main/kotlin/org/usvm/ps/PathSelectorFactory.kt # usvm-jvm/build.gradle.kts

Add PPO support

4a4bcd0

Fix path selectors

1932d37

Merge branch 'main' of https://github.com/UnitTestBot/usvm into ml-pa…

c731f02

…th-selection

Change jsonAggregator and add options

f21c385

Add options and fix block graph

2093db0

Add graph features and refactor

03b93a5

Merge remote-tracking branch 'origin/main' into ml-path-selection

cfacb55

Support string and class constants

211ae65

Update tests ignore reasons

d3fc3a7

Add gnn inference and refactor main

2f5219c

Close machine (solver) after test

52bdecf

Mock native methods + few approximations

337c494

Update test ignore reasons

df92f73

Add graph features and probabilities logging

db0ce16

Merge remote-tracking branch 'origin/main' into ml-path-selection

7860242

# Conflicts: # usvm-core/build.gradle.kts

Merge remote-tracking branch 'origin/saloed/native-mocks' into ml-pat…

d6dd569

…h-selection

sergeyrid added 3 commits September 7, 2023 20:03

Add test dependencies

5baa20a

Merge branch 'main' of https://github.com/UnitTestBot/usvm into ml-pa…

01a795b

…th-selection

Fix ModifiedUMachine

8278b6e

sergeyrid requested a review from Saloed September 7, 2023 17:23

Fix ModifiedUMachine

52e2385

Saloed requested changes Sep 12, 2023

View reviewed changes

Saloed reviewed Sep 12, 2023

View reviewed changes

usvm-ml-path-selection/src/main/kotlin/org/usvm/machine/ModifiedJcMachine.kt Outdated Show resolved Hide resolved

sergeyrid added 4 commits September 14, 2023 02:38

Refactor

9625b22

Merge branch 'main' of https://github.com/UnitTestBot/usvm into ml-pa…

389c5a3

…th-selection

Fix merge

587321f

Merge branch 'main' of https://github.com/UnitTestBot/usvm into ml-pa…

e7cd950

…th-selection

dvvrd force-pushed the main branch from db1fc27 to 8c4290c Compare September 21, 2023 17:30

sergeypospelov mentioned this pull request Sep 25, 2023

Add GNN path selector #67

Closed

Fix merge

65a2876

emnigma mentioned this pull request Oct 4, 2023

Common ml base #74

Closed

sergeyrid added 5 commits October 16, 2023 17:22

Merge remote-tracking branch 'origin/main' into ml-path-selection

50f6f1c

Fix merge

fe38cea

Refactor BlockGraph

629f26b

Refactor CoverageCounter

c689de1

Refactor CoverageCounterStatistics

f837ef3

sergeyrid requested a review from Saloed October 18, 2023 23:26

Saloed reviewed Oct 20, 2023

View reviewed changes

usvm-ml-path-selection/src/main/kotlin/org/usvm/ps/FeaturesLogger.kt Outdated Show resolved Hide resolved

Saloed reviewed Oct 20, 2023

View reviewed changes

sergeyrid added 3 commits October 30, 2023 23:07

Refactor

cac5201

Merge remote-tracking branch 'origin/main' into ml-path-selection

542c11e

Fix merge

72e1a72

sergeyrid requested a review from Saloed October 30, 2023 20:24

Saloed reviewed Nov 8, 2023

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

ML path selection #60

ML path selection #60

Uh oh!

sergeyrid commented Sep 7, 2023

Uh oh!

Uh oh!

Uh oh!

Saloed Sep 12, 2023

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Saloed Oct 20, 2023

Uh oh!

Saloed Oct 20, 2023

Uh oh!

sergeyrid Oct 22, 2023

Uh oh!

Saloed Nov 8, 2023

Uh oh!

Saloed Nov 8, 2023

Uh oh!

Saloed Nov 8, 2023

Uh oh!

Uh oh!

ML path selection #60

Are you sure you want to change the base?

ML path selection #60

Uh oh!

Conversation

sergeyrid commented Sep 7, 2023

Uh oh!

Uh oh!

Uh oh!

Saloed Sep 12, 2023

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Saloed Oct 20, 2023

Choose a reason for hiding this comment

Uh oh!

Saloed Oct 20, 2023

Choose a reason for hiding this comment

Uh oh!

sergeyrid Oct 22, 2023

Choose a reason for hiding this comment

Uh oh!

Saloed Nov 8, 2023

Choose a reason for hiding this comment

Uh oh!

Saloed Nov 8, 2023

Choose a reason for hiding this comment

Uh oh!

Saloed Nov 8, 2023

Choose a reason for hiding this comment

Uh oh!

Uh oh!