Skip to content

Conversation

@fipar
Copy link
Contributor

@fipar fipar commented Jan 25, 2016

I've added mongo-response-time, a utility to watch mongo network traffic and generate a csv file with a timestamp and response time for each operation seen.

I use this to generate response time graphs that I can correlate with the output from load generators and other utilities, while benchmarking.

fipar added 12 commits January 22, 2016 19:48
- Added binaries for linux64 and darwin64 for mongo-response-time
- Created subdir at the top level for mongo-response-time, for easy reference when browing the repo (as it is not really a slowlog-generator)
- created a function to do minimal validation of test cases
- added minimal validation for all test cases
- added a function to print an object as a string, while (unsucessfully) debugging 'undefined' in server status for shards
- added sample output
- Fixed bug that caused 'undefined' to be printed instead of some info (like serverStatus) for shards
- Remove accidentally added file to generated
- Completed the addition of example outputs (one per test case)
@fipar
Copy link
Contributor Author

fipar commented Mar 26, 2016

This pull request now also adds:

  • mongo-response-time-exporter, to export response time statistics to prometheus
  • minor improvements for mongo-summary
  • support for loopback device sniffing for mongo-response-time and mongo-response-time-exporter

@dbmurphy
Copy link

Why are you not jus using Prometheus and the Prometheus exporter for this type of data? Seems like it's just another reinvention on time series DBs

Sent from my iPhone

On Jan 25, 2016, at 16:55, Fernando Ipar notifications@github.com wrote:

I've added mongo-response-time, a utility to watch mongo network traffic and generate a csv file with a timestamp and response time for each operation seen.

I use this to generate response time graphs that I can correlate with the output from load generators and other utilities, while benchmarking.

You can view, comment on, or merge this pull request online at:

#3

Commit Summary

added new util to print query response time per second

  • Set time resolution to one second for mongo-response-time
    File Changes

A mongo-response-time/README (7)
A mongo-response-time/mongo-response-time.go (1)
A slowlog-generator/response-time/Makefile (8)
A slowlog-generator/response-time/mongo-response-time.darwin64.bin (0)
A slowlog-generator/response-time/mongo-response-time.go (185)
A slowlog-generator/response-time/mongo-response-time.linux64.bin (0)
Patch Links:

https://github.com/Percona-Lab/ognom-toolkit/pull/3.patch
https://github.com/Percona-Lab/ognom-toolkit/pull/3.diff

Reply to this email directly or view it on GitHub.

@fipar
Copy link
Contributor Author

fipar commented Apr 27, 2016

I wrote these tools before we were using prometheus (and before I was aware
of it), so yes, this is mostly replaced now by the response time exporter
for prometheus. It doesn't export the response time for every operation,
because prometheus wouldn't be able to handle it, but it's good enough for
me as it is anyway.

Fernando Ipar

http://fernandoipar.com

Skype: ipar.fernando

Phone: +598 93809968

On Sat, Mar 26, 2016 at 4:15 AM, David Murphy notifications@github.com
wrote:

Why are you not jus using Prometheus and the Prometheus exporter for this
type of data? Seems like it's just another reinvention on time series DBs

Sent from my iPhone

On Jan 25, 2016, at 16:55, Fernando Ipar notifications@github.com
wrote:

I've added mongo-response-time, a utility to watch mongo network traffic
and generate a csv file with a timestamp and response time for each
operation seen.

I use this to generate response time graphs that I can correlate with
the output from load generators and other utilities, while benchmarking.

You can view, comment on, or merge this pull request online at:

#3

Commit Summary

added new util to print query response time per second

  • Set time resolution to one second for mongo-response-time
    File Changes

A mongo-response-time/README (7)
A mongo-response-time/mongo-response-time.go (1)
A slowlog-generator/response-time/Makefile (8)
A slowlog-generator/response-time/mongo-response-time.darwin64.bin (0)
A slowlog-generator/response-time/mongo-response-time.go (185)
A slowlog-generator/response-time/mongo-response-time.linux64.bin (0)
Patch Links:

https://github.com/Percona-Lab/ognom-toolkit/pull/3.patch
https://github.com/Percona-Lab/ognom-toolkit/pull/3.diff

Reply to this email directly or view it on GitHub.


You are receiving this because you authored the thread.
Reply to this email directly or view it on GitHub
#3 (comment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants