You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hello,
I use 'fluent-plugin-webhdfs' version '1.2.2', fluentd version: 1.4
My log file looks like: interface=login&time=20170925&...others fields...
In my td-agent config file, I named my log as a tag:interface.login.hdfs
<source>
@type tail
format none
path /data/td-agent/logs/interface.log
pos_file /etc/td-agent/pos/interface.pos
read_from_head true
tag interface.**login**.hdfs
</source>
<match interface.**>
@type webhdfs
host *.*.*.*
port 50070
path /data/gamelogs/hdfs/date=${record['time']}/${tag[2]}.#{Socket.gethostname}.log
<format>
@type json
</format>
</match>
and I need to get "login" from tag, and get time from my log record, so if there has any method to get these two values?
In some other plugins, I can use $tag[2] or ${record['interface']}, ${record['time']} to get these values,but in this plugin, it doesn't work.
Thanks...
The text was updated successfully, but these errors were encountered:
monkeypiggy
changed the title
Can hdfs path use tag or record? just like: /data/hdfs/${tag}.#{Socket.gethostname}.log
Can hdfs path use ${tag} or ${record} ? just like: /data/hdfs/${tag}.#{Socket.gethostname}.log
Sep 25, 2017
Hello,
I use 'fluent-plugin-webhdfs' version '1.2.2', fluentd version: 1.4
My log file looks like:
interface=login&time=20170925&...others fields...
In my td-agent config file, I named my log as a tag:interface.login.hdfs
and I need to get "login" from tag, and get time from my log record, so if there has any method to get these two values?
In some other plugins, I can use$tag[2] or $ {record['interface']}, ${record['time']} to get these values,but in this plugin, it doesn't work.
Thanks...
The text was updated successfully, but these errors were encountered: