Skip to content

Commit

Permalink
Merge remote-tracking branch 'origin/gnn-llm-model-integration' into …
Browse files Browse the repository at this point in the history
…gnn_llm2
  • Loading branch information
rusty1s committed May 22, 2024
2 parents 9745df0 + 19bcada commit a7f072a
Show file tree
Hide file tree
Showing 11 changed files with 1,335 additions and 4 deletions.
1 change: 1 addition & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).

### Added

- Added the `WebQSPDataset` dataset with example training G-Retriever (GNN+LLM) ([#9167](https://github.com/pyg-team/pytorch_geometric/pull/9167))
- Added support for negative sampling in `LinkLoader` acccording to source and destination node weights ([#9316](https://github.com/pyg-team/pytorch_geometric/pull/9316))
- Added support for `EdgeIndex.unbind` ([#9298](https://github.com/pyg-team/pytorch_geometric/pull/9298))
- Integrate `torch_geometric.Index` into `torch_geometric.EdgeIndex` ([#9296](https://github.com/pyg-team/pytorch_geometric/pull/9296))
Expand Down
8 changes: 5 additions & 3 deletions examples/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,8 +14,10 @@ For examples on [Open Graph Benchmark](https://ogb.stanford.edu/) datasets, see
- [`ogbn_papers_100m.py`](./ogbn_papers_100m.py) is an example for training a GNN on the large-scale `ogbn-papers100m` dataset, containing approximately ~1.6B edges.
- [`ogbn_papers_100m_cugraph.py`](./ogbn_papers_100m_cugraph.py) shows how to accelerate the `ogbn-papers100m` workflow using [CuGraph](https://github.com/rapidsai/cugraph).

For examples on using `torch.compile`, see the examples under [`examples/compile`](./compile).
For examples on co-training LLM with GNN, see examples and README under [`examples/llm_plus_gnn`](./llm_plus_gnn).

For examples on scaling PyG up via multi-GPUs, see the examples under [`examples/multi_gpu`](./multi_gpu).
For examples on using `torch.compile`, see examples and README under [`examples/compile`](./compile).

For examples on working with heterogeneous data, see the examples under [`examples/hetero`](./hetero).
For examples on scaling PyG up via multi-GPUs, see examples and README under [`examples/multi_gpu`](./multi_gpu).

For examples on working with heterogeneous data, see examples and README under [`examples/hetero`](./hetero).
5 changes: 5 additions & 0 deletions examples/llm_plus_gnn/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
# Examples for LLM and GNN co-training

| Example | Description |
| ------------------------------------ | ------------------------------------------------------------------------------------------------------------------------------------------------------- |
| [`g_retriever.py`](./g_retriever.py) | Example for Retrieval-Augmented Generation (RAG) w/ GNN+LLM by co-training LLAMA2 with GAT for answering questions based on knowledge graph information |
Loading

0 comments on commit a7f072a

Please sign in to comment.