How will this affect the next version number?
New feature (increment MINOR version)
Is your feature request related to a problem?
Yes, some zstash runs are subject to random/external variation in runtime -- notably Globus, which relies on network transfers. This makes it difficult to tell which performance changes are coming from code changes and which are just natural variation.
Describe the solution you'd like
Each performance run of the scripts in #427 takes about 1-2 hours to run -- they also involve transferring relatively large amounts of data. This makes it impractical to run many times to get an average.
What we can do, however, is take averages of the records we build up over time as we do performance profiling. Such an averages plot would be a good new figure to add.
Describe alternatives you've considered
No response
Additional context
No response
How will this affect the next version number?
New feature (increment MINOR version)
Is your feature request related to a problem?
Yes, some
zstashruns are subject to random/external variation in runtime -- notably Globus, which relies on network transfers. This makes it difficult to tell which performance changes are coming from code changes and which are just natural variation.Describe the solution you'd like
Each performance run of the scripts in #427 takes about 1-2 hours to run -- they also involve transferring relatively large amounts of data. This makes it impractical to run many times to get an average.
What we can do, however, is take averages of the records we build up over time as we do performance profiling. Such an averages plot would be a good new figure to add.
Describe alternatives you've considered
No response
Additional context
No response