Skip to content

Commit

Permalink
nit: typo
Browse files Browse the repository at this point in the history
PiperOrigin-RevId: 436600912
  • Loading branch information
afrozenator authored and t5-copybara committed Mar 22, 2022
1 parent b5cb038 commit 716111d
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/usage/partitioning.md
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ logical axis names can be found [below](#canonical-logical-axis-names).
For `jax.pjit` to know how to partition these arrays across the hardware, the
logical axis names must be mapped to physical axes of the accelerator (TPU/GPU)
mesh. In T5X, the two primary hardware axes are named `'data'` and `'model'`,
referring to the defalt mappings for data- and model-parallelism, respectively.
referring to the default mappings for data- and model-parallelism, respectively.
Names notwithstanding, you are free to map model parameters/activations across
the "data" axis. In fact, this is what is done in "2D" parameter/activation
sharding. See [`t5x.partitioning.standard_logical_axis_rules`][standard-rules]
Expand Down

0 comments on commit 716111d

Please sign in to comment.