Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RAPIDE & IPSL: first proof of concept #148

Closed
wants to merge 35 commits into from
Closed
Changes from 1 commit
Commits
Show all changes
35 commits
Select commit Hold shift + click to select a range
15a26fb
ipsl: compiler and mesh for ipsl structure
Jorropo Jan 18, 2023
50a362d
ipsl: add scope test
Jorropo Jan 18, 2023
37a81a2
ipsl: remove type field from SomeNode and use reflection on Node instead
Jorropo Jan 18, 2023
cb5c976
ipsl: add empty builtin
Jorropo Jan 25, 2023
a78774b
ipsl/helpers: add SyncDFS helper
Jorropo Jan 25, 2023
d66c1e5
ipsl/unixfs: add Everything node
Jorropo Jan 25, 2023
8ed4783
ipsl: add a comment to the compiler tests
Jorropo Jan 26, 2023
123ccb7
ipsl/helpers: test ipsl.All node in SyncDFS test
Jorropo Jan 26, 2023
877a66b
ipsl: use blocks interface
Jorropo Feb 3, 2023
67b755e
ipsl: return UnexpectedEOF with broken nodes
Jorropo Jan 27, 2023
9fc24d7
ipsl: add support for string literal
Jorropo Jan 27, 2023
c0311ca
ipsl: add None support
Jorropo Jan 27, 2023
8e03d43
ipsl: add support for load-builtin-scope
Jorropo Jan 27, 2023
92315b6
ipsl: rename compileNodeWithoutClosure to compileNextNodeWithoutTermi…
Jorropo Jan 30, 2023
090dc45
ipsl: add unixfs scope object
Jorropo Jan 30, 2023
b71e345
ipsl: make CompileEmpty and CompileAll private
Jorropo Jan 31, 2023
604d757
blocks: add BlockIterator
Jorropo Jan 31, 2023
f24da5b
blocks: add BlockOrError
Jorropo Jan 31, 2023
432e9aa
ipsl: make all run the child traversals
Jorropo Jan 31, 2023
031ebc7
rapide: initial commit
Jorropo Jan 31, 2023
9c48161
rapide: fix termination logic
Jorropo Jan 31, 2023
608fa43
rapide/gateway: change User-Agent to RAPIDE
Jorropo Jan 31, 2023
40cb2d2
rapide: refactor serverDrivenWork.work to not be hot garbage
Jorropo Jan 31, 2023
a778ca3
rapide: fully remove workers from the tree when they fail
Jorropo Jan 31, 2023
419cdfa
rapide: gc traversal objects in expand
Jorropo Jan 31, 2023
0c5c6f0
rapide: return worker errors when all workers died
Jorropo Jan 31, 2023
b3db9e8
rapide/gateway: implement fmt.Stringer with PathName
Jorropo Jan 31, 2023
0310c77
rapide: disable eager check for len(w.tasks) == 0 in the server worker
Jorropo Jan 31, 2023
cebbabf
rapide: randomly distribute equivalent walks
Jorropo Feb 1, 2023
6e74518
rapide: add make use of io.Closer for BlockIterators
Jorropo Feb 1, 2023
d02cbce
rapide: fix leaking worker count when we reset after duplicated block
Jorropo Feb 2, 2023
c5905d7
rapide: add tests and fix race issues
Jorropo Feb 2, 2023
bc755ab
ipsl: remove the compiler and language
Jorropo Feb 3, 2023
021b3c9
rapide: fix: make unexpected blocks a retriable error
Jorropo Feb 3, 2023
143cd01
examples/rapido: add example on how to use rapide
Jorropo Feb 3, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
ipsl/helpers: test ipsl.All node in SyncDFS test
  • Loading branch information
Jorropo committed Feb 3, 2023
commit 123ccb7b4898b2c726498dc63cf4fe04225eb6a6
9 changes: 7 additions & 2 deletions ipsl/helpers/helpers_test.go
Original file line number Diff line number Diff line change
Expand Up @@ -109,7 +109,10 @@ func TestSyncDFS(t *testing.T) {
traversal := mockTraversal{t, root1Cid, root1, []ipsl.CidTraversalPair{
{Cid: leaf1Cid, Traversal: mockTraversal{t, leaf1Cid, leaf1, nil}},
{Cid: root2Cid, Traversal: mockTraversal{t, root2Cid, root2, []ipsl.CidTraversalPair{
{Cid: leaf2Cid, Traversal: mockTraversal{t, leaf2Cid, leaf2, nil}},
{Cid: leaf2Cid, Traversal: ipsl.All(
mockTraversal{t, leaf2Cid, leaf2, nil},
mockTraversal{t, leaf2Cid, leaf2, nil},
)},
{Cid: leaf3Cid, Traversal: mockTraversal{t, leaf3Cid, leaf3, nil}},
}}},
{Cid: leaf4Cid, Traversal: mockTraversal{t, leaf4Cid, leaf4, nil}},
Expand All @@ -134,10 +137,12 @@ func TestSyncDFS(t *testing.T) {
leaf1Cid,
root2Cid,
leaf2Cid,
leaf2Cid,
leaf2Cid,
leaf3Cid,
leaf4Cid,
}
if !slices.Equal(result, expectedOrder) {
t.Errorf("bad traversal order: expected: %#v; got %#v", expectedOrder, result)
t.Errorf("bad traversal order: expected: %v; got %v", expectedOrder, result)
}
}