Skip to content

Adding Distributed OGB-LSC Example with GATConv #21

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
szaman19 wants to merge 48 commits into
base: main
Choose a base branch
from
Open

Adding Distributed OGB-LSC Example with GATConv #21

szaman19 wants to merge 48 commits into from

Conversation

@szaman19
Copy link
Contributor

@szaman19 szaman19 commented Sep 12, 2025

No description provided.

@szaman19 szaman19 marked this pull request as ready for review September 15, 2025 16:42
@bvanessen bvanessen self-requested a review October 22, 2025 21:43
szaman19 and others added 28 commits November 19, 2025 12:17
@szaman19
Adding distributed batch normalization layers
38249ec
@szaman19
Wrap around implementation with torch nn module
b24ef7d
@szaman19
Add DGraph imlementation of RGat
9cdadb6
@szaman19
Adding PyG sparse tensor wrapper if needed
d44bc83
@szaman19
Add RGat implementation
b539e79
@szaman19
Completed with RGAT implementation
63109a3 
- Add datasets for synthetic and MAG240M graphs
- Add cache generators for the comm
- Fix implementation bug for GAT
@szaman19
Add the synthetic dataset for testing purposes
335a65e
@szaman19
Add MAG240M dataset
2d9ff3f
@szaman19
Bug fixes to get things running correctly
c2530ad
@szaman19
Update fix for data type issues and cache generator, but experiencing…
88c0410 
… hangs
@szaman19
paper2paper layer running.
d44fc6e 
Isolated hang to author2paper
@szaman19
Updating the synthetic dataset to track down hang on directed relatio…
e3f091e 
…n edge between papers and authors
@szaman19
Still debugging error on miscalculated gradient size
1b45b75
@szaman19
Fix for incorrect tensor shape
f71f109
@szaman19
Author 2 paper relation working. Only author 2 institution error rema…
076a692 
…ins. Incorrect local recv tensor size
@szaman19
Remove extra breakpoints in cache generators
2d27416
@szaman19
Fix cache generator with correct input shape for destination gather
d127220
@szaman19
Fix on batch norm to have correct local variance reduction
a6962cc
@szaman19
Added additional parameters to batch norm for backprop
f85f133
@szaman19
Adding helper functions to sync normalization values and fixed evalua…
750d8e6 
…tion on trainer
@szaman19
Latest changes to RGAT
657111e
@KIwabuchi @szaman19
(OGB-LSC) Bugfix for geenrating _dest_scatter_cache
746693d
@KIwabuchi @szaman19
(OGB-LSC) Workaround for DDP's unsed parameter error
296fa2f
@KIwabuchi @szaman19
(OGB-LSC) Some performance optimizations
fa585a3
@szaman19
Fix DGraph Mag240M dataset __getitem__ method
483bc48
@KIwabuchi @szaman19
Remove debug messages
7930024
@KIwabuchi @szaman19
(OGB-LSC) Bugfix for mag240m dataset
09735a7
@KIwabuchi @szaman19
(OGB-LSC) Remove debug message
ee1f725
@szaman19
Updated torch bindings implementation for local-scatter-gather
c663626
@szaman19
New and improved concise dataplan with efficient connectivity data st…
47f6ef3 
…orage
@szaman19
Add updated kernels for local scatter-gather + NCCLCommPlan
e4c9b2e
@szaman19
Update the scatter-gather impl to allow set and add aggregation
8535a40
@szaman19
Add ScatterSumGather python wrapper
3280ee8
@szaman19
Fix backward function call on StaticGather
13c1205
@szaman19
Fixed Scatter forward
ef2efbb
@szaman19
Updated scatter function impl
22ed522
@szaman19
Fix build issues and change op struct�
dc0ded2
@szaman19
Remove unnecesary imports and remove cache implementation
f559bcf
@szaman19
Decompose internal function to reduce memory usage
f2c3915 
- Allows GC to deallocate transient maasking arrays
@szaman19
Optimized CommPlan generator
bf8c6ac 
- Remove unnecessary arrays and memory inefficiencies
@szaman19
Fix node size check
934d532
@szaman19
Add edge-conditioned graph plan to hold full edge communication info
25c3edf
@szaman19
Update GAT implementation with new comm plan
16dd5ad
@szaman19
Remove pyg_wrapper function
ceb6d90
@szaman19
Enable hetero-graphs in comm-plan
673f8b6
@szaman19
Fixed mismatched API on scatter_sum_gather
88269a1
@szaman19
Update python bindings for localScatterSumGather
0b17d4a
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@bvanessen bvanessen Awaiting requested review from bvanessen

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@szaman19 @KIwabuchi