Skip to content

Latest commit

 

History

History
19 lines (16 loc) · 596 Bytes

TODO.md

File metadata and controls

19 lines (16 loc) · 596 Bytes
Raw

TODO

Global

  1. README.md
  2. HOWTO.md
  3. setup.py to simplify installation
  4. more pydoc
  5. unit tests

Features

  1. meta-benchmark? benchmark a subset of configured frameworks: runbenchmark.py frameworks_list.yaml test.
  2. progress bar?? fancy useless stuff.

Bugs & Improvements

  1. expose training_duration + count_models from ranger
  2. properly kill job threads on KeyInterruptError (mainly in AWS mode)
  3. AWS: reuse instances for faster startup, at least during a single benchmark, we could limit #instances = #parallel jobs.
  4. search for TODO and FIXME in codebase.