Skip to content
Snippets Groups Projects

Lightning acc

Merged Gokhan OZBULAK requested to merge lightning-acc into main
1 unresolved thread
1 file
+ 5
6
Compare changes
  • Side-by-side
  • Inline
@@ -86,12 +86,11 @@ def reusable_options(f):
"parameter, used in conjunction with the batch-size, may be used to "
"reduce the number of samples loaded in each iteration, to affect memory "
"usage in exchange for processing time (more iterations). This is "
"especially interesting when one is training on GPUs with a limited amount "
"of onboard RAM. processing time (more iterations). This is especially interesting "
"when one is training on GPUs with limited RAM. The default of 1 forces "
"the whole batch to be processed at once. Otherwise the batch is "
"multiplied by accumulate-grad-batches pieces, and gradients are accumulated "
"to complete each step.",
"useful interesting when one is training on GPUs with a limited amount "
"of onboard RAM. The default of 1 forces the whole batch to be "
"processed at once. Otherwise the batch is multiplied by "
"accumulate-grad-batches pieces, and gradients are accumulated "
"to complete each training step.",
required=True,
show_default=True,
default=1,
Loading