performance test

[meejah]

Before tackling any generally "performance" bugs it is desirable to have some idea of whether any changes make things "faster" or "slower" (maybe related "use more resources" or not).

Required:

• "canonical" test-cases
  • X files with Y data
  • "lots of tiny files"
  • "a few big file" (but same total data as above)
  • "a mix"?
• times to perform common things
  • wall-clock time to upload some "common case" (e.g. X files with Y data)

Nice to have:

• CPU times to perform uploads
• network traffic required to perform uploads
• (max?) memory usage to perform uploads
• profiling information (e.g. from vmprof) identifying code-paths to blame for {slow,memory,..}