zabbix历史数据相关表研究

Posted 2021-01-31 liao-lin

tags:

篇首语：本文由小常识网(cha138.com)小编为大家整理，主要介绍了zabbix历史数据相关表研究相关的知识，希望对你有一定的参考价值。

zabbix历史数据相关表研究

history和trends相关表

history和trends都是存储历史数据的地方。一般是通过监控项(item)配置里、匹配更新监控项(item)和设置HouseKeeper tasks来设置保留数据的时长。

Housekeeper 会定期删除过期的数据。如果不是特别有意义，建议你把保留时间设置短一些，如果想看以前的数据图怎么办？这里趋势数据就派上用场了，一般只要小时平均即可这样话趋势据保留久一点即可，趋势数据的计算源数据来自history表。如果将history设置为0那么就只会获取item的值然后用于触发器，不会存历史数据到数据库。

监控项前端配置:

技术分享图片

history相关表

MariaDB [rtm]> show tables like 'history%';
+--------------------------+
| Tables_in_rtm (history%) |
+--------------------------+
| history                  |
| history_log              |
| history_str              |
| history_text             |
| history_uint             |
+--------------------------+

history

history 表存放信息类型为浮点数的监控项历史数据，类型在配置监控项是指定

itemid: 监控项唯一标识id

clock: 时间戳整数部分

value：监控项的值

ns：纳秒数

MariaDB [rtm]> desc history;
+--------+---------------------+------+-----+---------+-------+
| Field  | Type                | Null | Key | Default | Extra |
+--------+---------------------+------+-----+---------+-------+
| itemid | bigint(20) unsigned | NO   | MUL | NULL    |       |
| clock  | int(11)             | NO   |     | 0       |       |
| value  | double(16,4)        | NO   |     | 0.0000  |       |
| ns     | int(11)             | NO   |     | 0       |       |
+--------+---------------------+------+-----+---------+-------+


MariaDB [rtm]> select * from history limit 10;
+-----------+------------+---------+----+
| itemid    | clock      | value   | ns |
+-----------+------------+---------+----+
| 300161484 | 1545404400 |  1.9616 |  0 |
| 300161484 | 1545379200 |  2.3494 |  0 |
| 300161484 | 1545382800 |  2.7355 |  0 |
| 300161484 | 1545386400 |  3.3068 |  0 |
| 300161484 | 1545390000 |  3.2508 |  0 |
| 300161484 | 1545393600 |  4.2648 |  0 |
| 300161484 | 1545397200 |  4.0263 |  0 |
| 300161484 | 1545400800 |  2.7983 |  0 |
| 300161485 | 1545404400 | 16.8910 |  0 |
| 300161485 | 1545379200 | 20.5173 |  0 |
+-----------+------------+---------+----+

history_log

history_log 表存放信息类型为日志的监控项历史数据，类型在配置监控项是指定

MariaDB [rtm]> desc history_log;
+------------+---------------------+------+-----+---------+-------+
| Field      | Type                | Null | Key | Default | Extra |
+------------+---------------------+------+-----+---------+-------+
| id         | bigint(20) unsigned | NO   | PRI | NULL    |       |
| itemid     | bigint(20) unsigned | NO   | MUL | NULL    |       |
| clock      | int(11)             | NO   |     | 0       |       |
| timestamp  | int(11)             | NO   |     | 0       |       |
| source     | varchar(64)         | NO   |     |         |       |
| severity   | int(11)             | NO   |     | 0       |       |
| value      | text                | NO   |     | NULL    |       |
| logeventid | int(11)             | NO   |     | 0       |       |
| ns         | int(11)             | NO   |     | 0       |       |
+------------+---------------------+------+-----+---------+-------+

history_str

history_str 表存放信息类型为字符的监控项历史数据，类型在配置监控项是指定

MariaDB [rtm]> desc history_str;
+--------+---------------------+------+-----+---------+-------+
| Field  | Type                | Null | Key | Default | Extra |
+--------+---------------------+------+-----+---------+-------+
| itemid | bigint(20) unsigned | NO   | MUL | NULL    |       |
| clock  | int(11)             | NO   |     | 0       |       |
| value  | varchar(255)        | NO   |     |         |       |
| ns     | int(11)             | NO   |     | 0       |       |
+--------+---------------------+------+-----+---------+-------+


MariaDB [rtm]> select * from history_str limit 2G;
*************************** 1. row ***************************
itemid: 23307
 clock: 1545384507
 value: localhost.localdomain
    ns: 410719216
*************************** 2. row ***************************
itemid: 23312
 clock: 1545384512
 value: Linux localhost.localdomain 3.10.0-862.el7.x86_64 #1 SMP Fri Apr 20 16:44:24 UTC 2018 x86_64
    ns: 411996428

history_text

history_text 表存放信息类型为文本的监控项历史数据，类型在配置监控项是指定

MariaDB [rtm]> desc history_text;
+--------+---------------------+------+-----+---------+-------+
| Field  | Type                | Null | Key | Default | Extra |
+--------+---------------------+------+-----+---------+-------+
| id     | bigint(20) unsigned | NO   | PRI | NULL    |       |
| itemid | bigint(20) unsigned | NO   | MUL | NULL    |       |
| clock  | int(11)             | NO   |     | 0       |       |
| value  | text                | NO   |     | NULL    |       |
| ns     | int(11)             | NO   |     | 0       |       |
+--------+---------------------+------+-----+---------+-------+


MariaDB [rtm]> select * from history_text limit 10;
+---------+--------+------------+---------------------+-----------+
| id      | itemid | clock      | value               | ns        |
+---------+--------+------------+---------------------+-----------+
| 1937748 |  30436 | 1545381354 | 10/11/2017 14:28:06 | 892072527 |
| 1937749 |  28311 | 1545381364 | N/A                 | 146021861 |
| 1937750 |  27186 | 1545381374 | N/A                 | 934199968 |
| 1937751 |  26936 | 1545381376 | N/A                 | 146546842 |
| 1937752 |  28936 | 1545381378 | N/A                 | 189324808 |
| 1937753 |  24686 | 1545381380 | N/A                 |  89381118 |
| 1937754 |  25061 | 1545381383 | N/A                 | 484549259 |
| 1937755 |  28061 | 1545381385 | N/A                 | 699330874 |
| 1937756 |  27061 | 1545381389 | N/A                 | 559602805 |
| 1937757 |  30686 | 1545381391 | N/A                 | 303467948 |
+---------+--------+------------+---------------------+-----------+

history_uint

history_unit 表存放信息类型为数字(无正负)的监控项历史数据，类型在配置监控项是指定

MariaDB [rtm]> desc history_uint;
+--------+---------------------+------+-----+---------+-------+
| Field  | Type                | Null | Key | Default | Extra |
+--------+---------------------+------+-----+---------+-------+
| itemid | bigint(20) unsigned | NO   | MUL | NULL    |       |
| clock  | int(11)             | NO   |     | 0       |       |
| value  | bigint(20) unsigned | NO   |     | 0       |       |
| ns     | int(11)             | NO   |     | 0       |       |
+--------+---------------------+------+-----+---------+-------+

MariaDB [rtm]> select * from history_uint limit 10;
+-----------+------------+-------+----+
| itemid    | clock      | value | ns |
+-----------+------------+-------+----+
| 100029541 | 1545404700 |  4311 |  0 |
| 100029541 | 1545405000 |  4276 |  0 |
| 100029541 | 1545405300 |  4242 |  0 |
| 100029541 | 1545405600 |  4207 |  0 |
| 100029541 | 1545405900 |  4172 |  0 |
| 100029541 | 1545406200 |  4137 |  0 |
| 100029541 | 1545406500 |  4102 |  0 |
| 100029541 | 1545406800 |  4067 |  0 |
| 100029541 | 1545407100 |  4032 |  0 |
| 100029541 | 1545407400 |  3997 |  0 |
+-----------+------------+-------+----+

trends相关表

MariaDB [rtm]> show tables like 'trends%';
+-------------------------+
| Tables_in_rtm (trends%) |
+-------------------------+
| trends                  |
| trends_uint             |
+-------------------------+

trends

itemid: 监控项唯一标识id

clock: 时间戳整数部分

num：该小时内用了多少数据用于计算平均值、最小值、最大值

value_min：趋势时间内最小值(趋势数据时间间隔为一小时)

value_avg：趋势时间内平均值(趋势数据时间间隔为一小时)

value_max：趋势时间内最大值(趋势数据时间间隔为一小时)

MariaDB [rtm]> desc trends;
+-----------+---------------------+------+-----+---------+-------+
| Field     | Type                | Null | Key | Default | Extra |
+-----------+---------------------+------+-----+---------+-------+
| itemid    | bigint(20) unsigned | NO   | PRI | NULL    |       |
| clock     | int(11)             | NO   | PRI | 0       |       |
| num       | int(11)             | NO   |     | 0       |       |
| value_min | double(16,4)        | NO   |     | 0.0000  |       |
| value_avg | double(16,4)        | NO   |     | 0.0000  |       |
| value_max | double(16,4)        | NO   |     | 0.0000  |       |
+-----------+---------------------+------+-----+---------+-------+


MariaDB [rtm]> select * from trends limit 10;
+--------+------------+-----+-----------+-----------+-----------+
| itemid | clock      | num | value_min | value_avg | value_max |
+--------+------------+-----+-----------+-----------+-----------+
|  23252 | 1538211600 |  60 |    0.0000 |    0.0006 |    0.0169 |
|  23252 | 1538215200 |  60 |    0.0000 |    0.0008 |    0.0169 |
|  23252 | 1538218800 |  60 |    0.0000 |    0.0008 |    0.0169 |
|  23252 | 1538222400 |  60 |    0.0000 |    0.0003 |    0.0169 |
|  23252 | 1538226000 |  60 |    0.0000 |    0.0008 |    0.0169 |
|  23252 | 1538229600 |  60 |    0.0000 |    0.0017 |    0.0508 |
|  23252 | 1538233200 |  60 |    0.0000 |    0.0011 |    0.0169 |
|  23252 | 1538236800 |  60 |    0.0000 |    0.0014 |    0.0169 |
|  23252 | 1538240400 |  60 |    0.0000 |    0.0008 |    0.0169 |
|  23252 | 1538244000 |  60 |    0.0000 |    0.0003 |    0.0169 |
+--------+------------+-----+-----------+-----------+-----------+

trends_unit

MariaDB [rtm]> desc trends_uint;
+-----------+---------------------+------+-----+---------+-------+
| Field     | Type                | Null | Key | Default | Extra |
+-----------+---------------------+------+-----+---------+-------+
| itemid    | bigint(20) unsigned | NO   | PRI | NULL    |       |
| clock     | int(11)             | NO   | PRI | 0       |       |
| num       | int(11)             | NO   |     | 0       |       |
| value_min | bigint(20) unsigned | NO   |     | 0       |       |
| value_avg | bigint(20) unsigned | NO   |     | 0       |       |
| value_max | bigint(20) unsigned | NO   |     | 0       |       |
+-----------+---------------------+------+-----+---------+-------+


MariaDB [rtm]> select * from trends_uint limit 10;
+--------+------------+-----+-----------+-----------+-----------+
| itemid | clock      | num | value_min | value_avg | value_max |
+--------+------------+-----+-----------+-----------+-----------+
|  23271 | 1538211600 |   6 |         0 |         0 |         0 |
|  23271 | 1538215200 |   6 |         0 |         0 |         0 |
|  23271 | 1538218800 |   6 |         0 |         0 |         0 |
|  23271 | 1538222400 |   6 |         0 |         0 |         0 |
|  23271 | 1538226000 |   6 |         0 |         0 |         0 |
|  23271 | 1538229600 |   6 |         0 |         0 |         0 |
|  23271 | 1538233200 |   6 |         0 |         0 |         0 |
|  23271 | 1538236800 |   6 |         0 |         0 |         0 |
|  23271 | 1538240400 |   6 |         0 |         0 |         0 |
|  23271 | 1538244000 |   6 |         0 |         0 |         0 |
+--------+------------+-----+-----------+-----------+-----------+

以上是关于zabbix历史数据相关表研究的主要内容，如果未能解决你的问题，请参考以下文章

Zabbix的history相关数据表数据太大，执行表分区操作过程

如何通过Zabbix获取监控数据

Zabbix DB历史表由Innodb转换成Tokudb引擎总结

从zabbix的数据库获取数据