Skip to content

kron-torch 0.3.0

Choose a tag to compare

View all tags
@evanatyourservice evanatyourservice released this 12 Feb 17:52
v0.3.0
a86b20e

What's Changed

  • Adding distributed versions of PSGD Kron and PSGD One-Sided Kron that use simple pipeline sharding, distributing params across GPUs layer-wise
Assets 2
Loading