Skip to content

`memory_demanding` for TF based transformers

Tiago de Freitas Pereira requested to merge memory_demanding into master

There are some situations where you have SampleSets with more than 1000 samples and we can't just TF forward them in one shot without OOM. In this MR I introduce the argument memory_demanding, where, once it's set to true, will `forward one sample at a time.

Edited by Tiago de Freitas Pereira

Merge request reports