Monitor Minio server with Prometheus
Prometheus is an open source monitoring platform that help you analyze and monitor infrastructure components. Prometheus server collects metrics from targets by scraping HTTP endpoints.
Minio now has built-in support for exporting Prometheus compatible data on an unauthenticated endpoint. This enables Prometheus monitoring for Minio server deployments without sharing server credentials and eliminates the need to run an external Prometheus exporter.
In this post, we’ll take a look at the data points available under a Minio Prometheus endpoint, and see how to use those fields to create critical alerts for Minio based storage infrastructure. Finally, we’ll also see how to visualize the data points using Grafana.
Setup Minio and Prometheus
Setting up Prometheus to scrape Minio endpoints is straightforward. Follow the [How to monitor Minio server with Prometheus] guide to setup Minio server monitoring with Prometheus.
Note that Prometheus support was added in Minio server release RELEASE.2018–05–11T00–29–24Z
, so you need to have this version or later running. To get started with Minio, refer Minio QuickStart Document.
Minio Prometheus exporter fields
Minio uses the Prometheus Go client along with internal administration data to instrument and export data. Here are the data points that you can expect from the Minio Prometheus endpoint.
- Uptime (available for Minio server/gateway)
process_start_time_seconds
: This stores the time since Minio server process started. You can use it with Prometheus query language to generate interesting insights easily. For example, get Minio server uptime using time() — process_start_time_seconds
and detect crash loops using changes(process_uptime_seconds[30m])
- Storage (available for Minio server instances only)
minio_disk_storage_used_bytes
: This is the total disk storage used by Minio server (in bytes).
If caching is enabled, following additional metrics are available
minio_disk_cache_storage_bytes
: This is the total cache capacity available for current Minio instance (in bytes).
minio_disk_cache_storage_free_bytes
: This is the free cache capacity available to current Minio instances (in bytes).
- Request duration (available for Minio server/gateway)
Request duration information is split into request types using Prometheus Histogram metric type. The basename for this metric is minio_http_requests_duration_seconds
. You can add _bucket
to the basename to get cumulative counters for all the request types. So, minio_http_requests_duration_seconds_bucket
will show something like this:

Other options are minio_http_requests_duration_seconds_sum
which shows the current aggregate time spent servicing all HTTP requests in seconds, and minio_http_requests_duration_seconds_count
which shows the sum of all requests served.
- Network statistics (available for Minio server/gateway)
minio_network_received_bytes_total
: This shows the total number of bytes received by Minio server (in bytes).
minio_network_sent_bytes_total
: This is the total number of bytes sent by Minio server (in bytes).
- Disk statistics (available for Minio server instances only)
minio_total_disks
: This is the total number of disks available to Minio server.
minio_offline_disks
: This is the count of total offline disks.
Use Cases
Monitoring alone is of not much use until you have a integrated alerting system that notifies concerned stakeholders whenever something goes wrong. Thankfully Prometheus does all this and more.
Once Minio server data is plugged into Prometheus monitoring, you can configure Prometheus alertmanager and create alerting rules. This way you have production ready, end to end monitoring and alerting setup.
Let’s explore some interesting use cases of such alerting setup.
- Alert when disk is offline
Using the minio_offline_disks
field, you can set up alerts if disk(s) are offline on a Minio server instance. This is how a sample alerting rule would look
groups:
- name: Minio
rules:
- alert: DiskOffline
expr: minio_offline_disks != 0
for: 5m
labels:
severity: page
annotations:
summary: Disk offline
- Alert when free space is less than specified threshold
Using the minio_disk_storage_free_bytes
field, you can set up alerts when a Minio server instance is running low on available storage space. A sample alerting rule would look like this
groups:
10737418240
- name: Minio
rules:
- alert: StorageSpaceExhausted
expr: minio_disk_storage_free_bytes <
labels:
severity: page
annotations:
summary: Free space threshold reached
This will fire an alert when free bytes reaches below 10GiB.
- Alert when a Minio server instance is under high load
Following above examples, you can set up alerts when Minio server is under high load, using the minio_http_requests_duration_seconds_bucket
field.
Grafana
Grafana is a visualization platform to understand metrics. It integrates very well with Prometheus and helps visually analyze Prometheus data. If you followed along till now, you already have Minio data coming into your Prometheus server.
Let us now see how to set up Grafana to fetch data from Prometheus and visualize it via Grafana dashboard.
- Install Grafana
On Ubuntu/Debian based platforms, Grafana already has deb
packages available. Install it using
$ wget https://s3-us-west-2.amazonaws.com/grafana- releases/release/grafana_5.1.2_amd64.deb
$ sudo apt-get install -y adduser libfontconfig
$ sudo dpkg -i grafana_5.1.2_amd64.deb
Once installed, start Grafana using
$ sudo service grafana-server start
For other platforms refer Grafana documentation. By default Grafana listens on port 3000. Access Grafana UI via browser on http://localhost:3000
. Default credentials are user name = admin and password = admin
- Create Dashboard
Once you have access to the UI, create a datasource for Grafana to fetch data from Prometheus. Click on Settings >> Data Sources >> Add Data Source. Then select Prometheus as the data type in the dropdown and add Prometheus URL and a name for the data source.
Then click Create >> Dashboard on the left side bar. Inside the dashboard, you can add panels. Select a graph as the new panel. Once the graph opens, click on the edit button on graph top menu bar. You can now edit graphs properties. Here you can choose any of the data points that Minio exposes and the data source.

While you’re at it, help us understand your use case and how we can help you better! Fill out our “Best of Minio” deployment form (takes less than a minute), and get a chance to be featured on the Minio website and showcase your Minio private cloud design to Minio community.
Monitor Minio server with Prometheus的更多相关文章
- A simple way to monitor SQL server SQL performance.
This is all begins from a mail. ... Dear sir: This is liulei. Thanks for your help about last PM for ...
- MinIO Server配置指南
MinIO server在默认情况下会将所有配置信息存到 ${HOME}/.minio/config.json 文件中. 以下部分提供每个字段的详细说明以及如何自定义它们. 配置目录 默认的配置目录是 ...
- 为MinIO Server设置Nginx代理
官方文档地址:http://docs.minio.org.cn/docs/master/setup-nginx-proxy-with-minio nginx参考网址:https://www.nginx ...
- monitor weblogic server ,Very simple to use, weblogic监控、巡检、故障简单小工具
1. 开发了一个简单的监视weblogic执行情况的小程序.各位朋友下载下来试试,不用登陆console就能够知道server的执行状况,包含了jvm.线程.jdbc.状态jms等:另一个更简 ...
- 使用 Prometheus 监控minio 性能指标信息&&docker-compose 方式运行
minio server 已经支持Prometheus 了,对于系统的运行参数我们可以方便.实时的查看 运行使用docker-compose docker-compose 文件 version: &q ...
- 使用loki+ mtail + grafana + prometheus server分析应用问题
loki 是一个方便的类似prometheus 的log 系统,mtail 是一个方便的日志提取工具, 可以暴露为http 服务——支持导出prometheus metrics 环境准备 docker ...
- 从零开始搭建Prometheus自动监控报警系统
从零搭建Prometheus监控报警系统 什么是Prometheus? Prometheus是由SoundCloud开发的开源监控报警系统和时序列数据库(TSDB).Prometheus使用Go语言开 ...
- Stream processing with Apache Flink and Minio
转自:https://blog.minio.io/stream-processing-with-apache-flink-and-minio-10da85590787 Modern technolog ...
- Prometheus监控系统之入门篇(一)
1. 简介 Prometheus: (简称Prom)是由SoundCloud开发的开源监控报警系统.是大名鼎鼎的CNCF云原生基金会下的第二大开源项目.具有如下特点: 使用Go语言开发 内置时序数据库 ...
随机推荐
- CentOS7安装配置Amanda
参考: https://wenku.baidu.com/view/881e0c998e9951e79a892759.html yum -y install amanda* http://blog ...
- 特殊权限set_gid
set gid: 权限说明: set gid权限可以作用在文件上(二进制可执行文件),也可以作用在目录上.当作用在文件上时,其功能和set,uid一样,它会使文件在执行阶段具有文件所属组的权限.目录被 ...
- 一、TCP扫描技术
一.TCP扫描技术 常用的端口扫描技术有很多种,如 TCP connect() 扫描 .TCP SYN 扫描.TCP FIN 扫描 等,网络上也有很多文章专门介绍,比如 :http://www.ant ...
- Linux文件系统命令 ln
命令:ln 功能:Linux下文件的链接功能,区别,软链接需要-s选项,硬链接不需要.相同的是,都是同步变化的,不过软链接不需要占用空间,硬链接占用空间 用法:软链接:ln -s 源文件 目标文件 硬 ...
- webview定位 & native和webview切换
前言:现在的app大都是混合式的native+webview,对于native可以直接用uiautomator定位然后操作元素,但是web就定位不到了 一.先看看使用native定位的 二.定位web ...
- L323 英语有必要学语法吗
The Agony and Ecstasy of Grammar “Underline a relative clause.” This challenge would give a lot of a ...
- L314 单音节词读音规则(二)-元音字母发音规则
1 单个元音发音尽量拖音一下(2S),发音会饱满一些. 2开音节: 辅音(辅组)(没有)+元音+辅音+e 的单词其中:元音发字母本身音,辅音字母不为r , 字母e不发音. 相对开音节:第一个元音都发字 ...
- 通过日志关键字检测判断obb程序是否工作正常
C118+Osmocom-bb 多机 gsm sniff环境,经常发生工作一段时间后,某个手机监听的arfcn就不工作了. 检查日志发现,日志最后有连续的多条:TOA AVG is not 16 qb ...
- ubuntu 安装 mysql 的正确姿势
1.下载官方提供的mysql-apt-config.deb包进行APT源设置,下载地址:https://dev.mysql.com/downloads/repo/apt/ 2. // 将 mysql- ...
- [转]HBASE 二级索引
1.二级索引的核心思想是什么?2.二级索引由谁来管理?3.在主表中插入某条数据后,hbase如何将索引列写到索引表中去?4.scan查询的时候,coprocessor钩子的作用是什么?5.在split ...