Skip to content

Add support for SETEX and ZRANGEBYSCORE #5

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
SalmaanP wants to merge 4 commits into
base: master
Choose a base branch
from
Open

Add support for SETEX and ZRANGEBYSCORE #5

Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
cb3f652
add setex and zrangebyscore
Mar 8, 2018
7766bc2
add SETEX and ZRANGEBYSCORE
Mar 13, 2018
f721dac
cleanup
Mar 13, 2018
8f15185
changes to dynamic fields
Mar 13, 2018
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
24 changes: 24 additions & 0 deletions lib/logstash/filters/cache_redis.rb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,15 @@ class LogStash::Filters::CacheRedis < LogStash::Filters::Base

# For now only working for rpushnx and llen!
config :cmd_key_is_formatted, :validate => :boolean, :default => false

# expire time for SETEX in seconds
config :expiration, :validate => :number, :default => 600

# Options for ZRANGEBYSCORE
config :min_value, :validate => :string
config :max_value, :validate => :string, :default => "+inf"
config :offset, :validate => :number, :default => 0
config :count, :validate => :number, :default => 1

# The hostname(s) of your Redis server(s). Ports may be specified on any
# hostname, which will override the global port config.
Expand Down Expand Up @@ -62,6 +71,8 @@ class LogStash::Filters::CacheRedis < LogStash::Filters::Base
config :get, :validate => :string

config :set, :validate => :string

config :setex, :validate => :string

config :exists, :validate => :string

Expand Down Expand Up @@ -108,6 +119,9 @@ class LogStash::Filters::CacheRedis < LogStash::Filters::Base
# config :get, :validate => :boolean, :default => false
# O(N)
config :lget, :validate => :string

config :zrangebyscore, :validate => :string



public
Expand Down Expand Up @@ -139,6 +153,10 @@ def filter(event)
if @set
@redis.set(event.get(@set), event.get(@source))
end

if @setex
@redis.setex(event.get(@setex), @expiration, event.get(@source))
end

if @exists
@redis.exists(event.get(@exists))
Expand Down Expand Up @@ -210,6 +228,12 @@ def filter(event)
if @lget
event.set(@target, @redis.lrange(event.get(@lget), 0, -1))
end

if @zrangebyscore
event.set(@target, @redis.zrangebyscore(event.get(@zrangebyscore), event.get(@min_value), event.get(@max_value), :limit => [@offset,@count]))
end



rescue => e
@logger.warn("Failed to send event to Redis, retrying after #{@reconnect_interval} seconds...", :event => event,
Expand Down