文本数据怎么批量导入Elasticsearch

Posted 2023-04-18

参考技术A input
file
type => "log"
#stat_interval => "\t"
path
=> "/home/hadoop/xinwang_XW351464_2110.log"



filter
if
[path] =~ "xinwang_XW351464_2110"
mutate replace => "type" =>
"apache_access"
grok
match => "message" =>
"%COMBINEDAPACHELOG"


date
match => [ "timestamp" ,
"dd/MMM/yyyy:HH:mm:ss Z" ]



output
elasticsearch

#cluster => "logstash_ela"
#node_name=> "es_master"
host =>
"192.168.1.152"
index => "eslsg"
index_type => "type"
protocol
=> "http"
port => 9200
workers => 1



执行 ./logstash agent -v -f txtTes.conf 的时候出现：

Grok loading patterns from file
:path=>"/home/hadoop/logstash-1.4.2/patterns/postgresql",
:level=>:info
Grok loading patterns from file
:path=>"/home/hadoop/logstash-1.4.2/patterns/mongodb",
:level=>:info
Grok loading patterns from file
:path=>"/home/hadoop/logstash-1.4.2/patterns/mcollective",
:level=>:info
Grok loading patterns from file
:path=>"/home/hadoop/logstash-1.4.2/patterns/redis",
:level=>:info
Grok loading patterns from file
:path=>"/home/hadoop/logstash-1.4.2/patterns/java",
:level=>:info
Grok loading patterns from file
:path=>"/home/hadoop/logstash-1.4.2/patterns/ruby",
:level=>:info
Grok loading patterns from file
:path=>"/home/hadoop/logstash-1.4.2/patterns/junos",
:level=>:info
Match data
:match=>"message"=>"%COMBINEDAPACHELOG", :level=>:info
Grok
compile :field=>"message", :patterns=>["%COMBINEDAPACHELOG"],
:level=>:info
Pipeline started :level=>:info
New Elasticsearch
output :cluster=>nil, :host=>"192.168.1.152", :port=>9200,
:embedded=>false, :protocol=>"http", :level=>:info
Automatic
template management enabled :manage_template=>"true",
:level=>:info
Using mapping template :template=>" \"template\" :
\"logstash-*\", \"settings\" : \"index.refresh_interval\" : \"5s\" ,
\"mappings\" : \"_default_\" : \"_all\" : \"enabled\" : true,
\"dynamic_templates\" : [ \"string_fields\" : \"match\" : \"*\",
\"match_mapping_type\" : \"string\", \"mapping\" : \"type\" : \"string\",
\"index\" : \"analyzed\", \"omit_norms\" : true, \"fields\" : \"raw\" :
\"type\": \"string\", \"index\" : \"not_analyzed\", \"ignore_above\" : 256
], \"properties\" : \"@version\": \"type\": \"string\", \"index\":
\"not_analyzed\" , \"geoip\" : \"type\" : \"object\", \"dynamic\": true,
\"path\": \"full\", \"properties\" : \"location\" : \"type\" : \"geo_point\"
", :level=>:info本回答被提问者和网友采纳

怎么把C语言中产生的数据导入到Excel表格

1、C语言产生ASCII数据文件，使用空格做作为数据分隔符。
2、进入Excel，选择数据选项卡 / 获取外部数据工具组 / 自文本按钮
3、进入数据导入对话框，
在第一步中，选择使用数据分隔符（不选固定数据长度）
在第二步中，指定数据分隔符为空格
4、按对话框向导操作就可以达到目的啦。 参考技术A Excel表格可以用TAB分隔的列，回车分隔的行的文本文件。
因此，最简单的办法是输出以TAB和回车分隔的文本文件就可以了(文件以.xls命名)。本回答被提问者采纳