Skip to content

Filter out the log stream which have event timestamps which specify a…#1

Open
peakxu wants to merge 1 commit intoTim-B:masterfrom
peakxu:filter_streams_by_event_timestamps
Open

Filter out the log stream which have event timestamps which specify a…#1
peakxu wants to merge 1 commit intoTim-B:masterfrom
peakxu:filter_streams_by_event_timestamps

Conversation

@peakxu
Copy link

@peakxu peakxu commented Jun 5, 2015

… non-overlapping interval with the period of interest

@Tim-B, please review.

The metadata on the log streams can be used to filter out log streams which do not have events that overlap with the period of interest. In cases like use with Amazon Lambda, where hundreds or thousands of log streams may be generated, this can result in a significant reduction in the number of log stream calls.

… non-overlapping interval with the period of interest
@Tim-B
Copy link
Owner

Tim-B commented Jun 6, 2015

Thanks for the pull request, that's a good point about the number of log streams.

I noticed they also recently introduced the filter_log_events function which can return results across all log streams. I was thinking about using that function instead with either an empty filter pattern or with a new parameter to filter the results.

Can you think of any down sides to that approach?

@peakxu
Copy link
Author

peakxu commented Jun 6, 2015

Didn't realize there was a filter_log_events function. That sounds like a great fit for this use case. Can't think of any downsides off the top of my head.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants