Skip to content

Extend tikv load graph #24

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 445 commits into
base: master
Choose a base branch
from
Open

Extend tikv load graph #24

wants to merge 445 commits into from

Conversation

Katherine2013
Copy link
Collaborator

@Katherine2013 Katherine2013 commented Apr 1, 2020

Major work:

  1. Add labels into nodes and edges' structures.
  2. Add a prefix scan function to get the neighbors of a given node.
  3. Add a new data loader to read graph from .csv files into TiKV.

Newly added functions:

  1. ExtendTikvNodeTrait, node: <node_id, label_id>.
  2. ExtendTikvEdgeTrait, edge: <src_id, direction, edge_label, dst_id>.
  3. trait PrefixScan for neighborhood search. Note that we provide specified search conditions on 'direction' and 'edge_label', which means it can return certain labeled, directed(optional) edges with a limit of records. But if there's not, we search through all potential neighbors of a given node.
  4. struct DataLoader, integrates the CSVReader and TikvLoader, the former one reads the csv file address in and stores the graph information, the second one loads the nodes and edges in parallel ways.

*All related tests had been passed.
*The tikv-client dependency in Cargo.toml was changed in need of the fixed scan function for now. It should be changed back when the official version is released.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

8 participants