Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Launch pothos-benchmark toolkit #5

Open
guruofquality opened this issue Jan 19, 2015 · 0 comments
Open

Launch pothos-benchmark toolkit #5

guruofquality opened this issue Jan 19, 2015 · 0 comments
Assignees

Comments

@guruofquality
Copy link
Contributor

With the new feature of JSON topologies and JSON stats reporting, and nicely bundled up into the PothoUtil executable: https://github.com/pothosware/pothos-library/wiki/PothosUtilGuide#running-a-json-topology ... it should be possible to make a python-based benchmark suite that executes a variety of benchmarks, collecting the data, and plotting it in matplotlib to create nice comparison barcharts.

This helps to establish a very encompasing baseline to determine how future features and performance work affects anything and everything. Most of the benchmarks will probably use passthrough blocks like router, gateway, black hole, infinite source... so that scheduler overhead is the dominating factor in the benchmarks.

Interesting things to vary:

  • machines, arm, x86, NUMA nodes
  • thread pool vs thread per actor
  • waiting on CVs vs spining
  • extreme topologies - linear-chain, massive fan-in, fan-out, hyper-mesh

Close this issue when the benchmark toolkit is created and in a mostly useful state.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant