This project is archived. Its data is read-only.
Closed
Milestone expired on Sep 30, 2016

Improvements in the datashuffler

  • For the time being the data shuffler fetch the whole dataset in memory. This is not the best scenario. Study how to do PREFETCHING (https://www.tensorflow.org/versions/r0.10/how_tos/reading_data/index.html#creating-threads-to-prefetch-using-queuerunner-objects)
  • Add the possibility to shuffle text lists and load them in the get_batch function.
  • Work items 0
  • Merge requests 0
  • Participants 0
  • Labels 0
Loading
Loading
Loading
Loading
0% complete
0%
Start date
No start date
Until
Sep 30 2016
Due date
Sep 30, 2016 (Past due)
0
Work items 0
Open: 0 Closed: 0
0
Merge requests 0
Open: 0 Closed: 0 Merged: 0
0
Releases
None
Reference: bob/bob.learn.tensorflow%"Improvements in the datashuffler"