Understanding the Space Used by ZFS -- (转)
Understanding the Space Used by ZFS
By Brian Leonard on Sep 28, 2010
Until recently, I've been confused and frustrated by the zfs list output as I try to clear up space on my hard drive.
Take this example using a 1 GB zpool:
bleonard@os200906:~# mkfile 1G /dev/dsk/disk1
bleonard@os200906:~# zpool create tank disk1
bleonard@os200906:~# zpool list tank
NAME SIZE USED AVAIL CAP HEALTH ALTROOT
tank 1016M 73K 1016M 0% ONLINE -
Now let's create some files and snapshots:
bleonard@os200906:~# mkfile 100M /tank/file1
bleonard@os200906:~# zfs snapshot tank@snap1
bleonard@os200906:~# mkfile 100M /tank/file2
bleonard@os200906:~# zfs snapshot tank@snap2
bleonard@os200906:~# zfs list -t all -r tank
NAME USED AVAIL REFER MOUNTPOINT
tank 200M 784M 200M /tank
tank@snap1 17K - 100M -
tank@snap2 0 - 200M -
The output here looks as I'd expect. I have used 200 MB of disk space, neither of which is used by the snapshots. snap1 refers to 100 MBs of data (file1) and snap2 refers to 200 MBs of data (file1 and file2).
Now let's delete file1 and look at our zfs list output again:
bleonard@os200906:~# rm /tank/file1
bleonard@os200906:~# zpool scrub tank
bleonard@os200906:~# zfs list -t all -r tank
NAME USED AVAIL REFER MOUNTPOINT
tank 200M 784M 100M /tank
tank@snap1 17K - 100M -
tank@snap2 17K - 200M -
Only 1 thing has changed - tank now only refers to 100 MB of data. file1 has been deleted and is only referenced by the snapshots. So why don't the snapshots reflect this in their USED column? You may think we should show 100 MB used by snap1, however, this would be misleading as deleting snap1 has no effect on the data used by the tank file system. Deleting snap1 would only free up 17K of disk space. We'll come back to this test case in a moment.
There is an option to get more detail on the space consumed by the snapshots. Although you can pretty easily deduct from the example above that the snapshots are using 100 MB, by using the zfs space option you can save yourself from doing the math:
bleonard@os200906:~# zfs list -t all -o space -r tank
NAME AVAIL USED USEDSNAP USEDDS USEDREFRESERV USEDCHILD
tank 784M 200M 100M 100M 0 154K
tank@snap1 - 17K - - - -
tank@snap2 - 17K - - - -
Here we can clearly see that of the 200 MB used by our file system, 100 MB is used by snapshots (file1) and 100 MB is used by the dataset itself (file2). Of course, there are other factors that can affect the total amount used - see the zfs man page for details.
Now, if we were to delete snap1 (we know this is safe, because it's not using any space):
bleonard@os200906:~# zfs destroy tank@snap1
bleonard@os200906:~# zfs list -t all -r tank
NAME USED AVAIL REFER MOUNTPOINT
tank 200M 784M 100M /tank
tank@snap2 100M - 200M -
We can see that snap2 now shows 100 MBs used. If I were to delete snap2, I would be deleting 100 MB of data (or reclaiming 100 MB of space):
Now let's look at a more realistic example - my home directory where I have Time Slider running:
bleonard@opensolaris:~$ zfs list -t all -r -o space rpool/export/home
NAME AVAIL USED USEDSNAP USEDDS USEDREFRESERV USEDCHILD
rpool/export/home 25.4G 35.2G 17.9G 17.3G 0 0
rpool/export/home@zfs-auto-snap:monthly-2010-08-03-09:30 - 166M - - - -
rpool/export/home@zfs-backup-2010-08-12-15:30 - 5.06M - - - -
rpool/export/home@zfs-backup-2010-08-12-15:56 - 5.15M - - - -
rpool/export/home@zfs-backup-2010-08-31-14:12 - 54.6M - - - -
rpool/export/home@zfs-auto-snap:monthly-2010-09-01-00:00 - 53.8M - - - -
rpool/export/home@zfs-auto-snap:weekly-2010-09-08-00:00 - 95.8M - - - -
rpool/export/home@zfs-backup-2010-09-09-09:04 - 53.9M - - - -
rpool/export/home@zfs-auto-snap:weekly-2010-09-15-00:00 - 2.06G - - - -
rpool/export/home@zfs-auto-snap:weekly-2010-09-22-00:00 - 89.7M - - - -
rpool/export/home@zfs-auto-snap:frequent-2010-09-28-11:00 - 18.3M - - - -
rpool/export/home@zfs-auto-snap:frequent-2010-09-28-11:15 - 293K - - - -
rpool/export/home@zfs-auto-snap:frequent-2010-09-28-11:30 - 293K - - - -
rpool/export/home@zfs-auto-snap:frequent-2010-09-28-11:45 - 1.18M - - - -
My snapshots are consuming almost 18 GBs of space. However, it would appear that I could only reclaim about 2.5 GBs of space by deleting all of my snapshots. In reality, 15.5 GBs of space is referenced by 2 or more snapshots.
I can get a better idea of which snapshots might reclaim the most space by removing the space option so I get the REFER field in the output:
bleonard@opensolaris:~$ zfs list -t all -r rpool/export/home
NAME USED AVAIL REFER MOUNTPOINT
rpool/export/home 35.2G 25.4G 17.3G /export/home
rpool/export/home@zfs-auto-snap:monthly-2010-08-03-09:30 166M - 15.5G -
rpool/export/home@zfs-backup-2010-08-12-15:30 5.06M - 28.5G -
rpool/export/home@zfs-backup-2010-08-12-15:56 5.15M - 28.5G -
rpool/export/home@zfs-backup-2010-08-31-14:12 54.6M - 15.5G -
rpool/export/home@zfs-auto-snap:monthly-2010-09-01-00:00 53.8M - 15.5G -
rpool/export/home@zfs-auto-snap:weekly-2010-09-08-00:00 95.8M - 15.5G -
rpool/export/home@zfs-backup-2010-09-09-09:04 53.9M - 17.4G -
rpool/export/home@zfs-auto-snap:weekly-2010-09-15-00:00 2.06G - 19.4G -
rpool/export/home@zfs-auto-snap:weekly-2010-09-22-00:00 89.7M - 15.5G -
rpool/export/home@zfs-auto-snap:frequent-2010-09-28-11:15 293K - 17.3G -
rpool/export/home@zfs-auto-snap:frequent-2010-09-28-11:30 293K - 17.3G -
rpool/export/home@zfs-auto-snap:frequent-2010-09-28-11:45 1.18M - 17.3G -
rpool/export/home@zfs-auto-snap:hourly-2010-09-28-12:00 0 - 17.3G -
rpool/export/home@zfs-auto-snap:frequent-2010-09-28-12:00 0 - 17.3G -
In the above output, I can see that 2 snapshots, taken 26 seconds apart, are referring to 28.5 GBs of disk space. If I were to delete one of those snapshots and check the zfs list output again:
bleonard@opensolaris:~$ pfexec zfs destroy rpool/export/home@zfs-backup-2010-08-12-15:30
bleonard@opensolaris:~$ zfs list -t all -r rpool/export/home
NAME USED AVAIL REFER MOUNTPOINT
rpool/export/home 35.2G 25.4G 17.3G /export/home
rpool/export/home@zfs-auto-snap:monthly-2010-08-03-09:30 166M - 15.5G -
rpool/export/home@zfs-backup-2010-08-12-15:56 12.5G - 28.5G -
rpool/export/home@zfs-backup-2010-08-31-14:12 54.6M - 15.5G -
rpool/export/home@zfs-auto-snap:monthly-2010-09-01-00:00 53.8M - 15.5G -
rpool/export/home@zfs-auto-snap:weekly-2010-09-08-00:00 95.8M - 15.5G -
rpool/export/home@zfs-backup-2010-09-09-09:04 53.9M - 17.4G -
rpool/export/home@zfs-auto-snap:weekly-2010-09-15-00:00 2.06G - 19.4G -
rpool/export/home@zfs-auto-snap:weekly-2010-09-22-00:00 89.7M - 15.5G -
rpool/export/home@zfs-auto-snap:frequent-2010-09-28-11:15 293K - 17.3G -
rpool/export/home@zfs-auto-snap:frequent-2010-09-28-11:30 293K - 17.3G -
rpool/export/home@zfs-auto-snap:frequent-2010-09-28-11:45 1.18M - 17.3G -
rpool/export/home@zfs-auto-snap:frequent-2010-09-28-12:00 537K - 17.3G -
I can now clearly see that the remaining snapshot is using 12.5 GBs of space and deleting this snapshot would reclaim much needed space on my laptop:
bleonard@opensolaris:~$ zpool list rpool
NAME SIZE USED AVAIL CAP HEALTH ALTROOT
rpool 149G 120G 28.5G 80% ONLINE -
bleonard@opensolaris:~$ pfexec zfs destroy rpool/export/home@zfs-backup-2010-08-12-15:56
bleonard@opensolaris:~$ zpool list rpool
NAME SIZE USED AVAIL CAP HEALTH ALTROOT
rpool 149G 108G 41.0G 72% ONLINE -
And that should be enough to keep Time Slider humming along smoothly and prevent the warning dialog from appearing (lucky you if you haven't seen that yet).
Understanding the Space Used by ZFS -- (转)的更多相关文章
- linux概念之分区与文件系统
分区类型 [root@-shiyan dev]# fdisk /dev/sda WARNING: DOS-compatible mode is deprecated. It's strongly re ...
- User space 与 Kernel space
学习 Linux 时,经常可以看到两个词:User space(用户空间)和 Kernel space(内核空间). 简单说,Kernel space 是 Linux 内核的运行空间,User spa ...
- Understanding, Operating and Monitoring Apache Kafka
Apache Kafka is an attractive service because it's conceptually simple and powerful. It's easy to un ...
- A Beginner's Guide To Understanding Convolutional Neural Networks(转)
A Beginner's Guide To Understanding Convolutional Neural Networks Introduction Convolutional neural ...
- Understanding CMS GC Logs--转载
原文地址:https://blogs.oracle.com/poonam/entry/understanding_cms_gc_logs Understanding CMS GC Logs By Po ...
- Understanding G1 GC Logs--转载
原文地址:https://blogs.oracle.com/poonam/entry/understanding_g1_gc_logs Understanding G1 GC Logs By Poon ...
- [ZZ] Understanding 3D rendering step by step with 3DMark11 - BeHardware >> Graphics cards
http://www.behardware.com/art/lire/845/ --> Understanding 3D rendering step by step with 3DMark11 ...
- Understanding Virtual Memory
Understanding Virtual Memory by Norm Murray and Neil Horman Introduction Definitions The Life of a P ...
- (转)A Beginner's Guide To Understanding Convolutional Neural Networks Part 2
Adit Deshpande CS Undergrad at UCLA ('19) Blog About A Beginner's Guide To Understanding Convolution ...
随机推荐
- 微信小程序组件 下拉刷新
<!-- &&底部加载 --> <view class='page-add-data flexca'> <text>{{pageTottomText ...
- django-rest-swagger对API接口注释
Swagger是一个API开发者的工具框架,用于生成.描述.调用和可视化RESTful风格的Web服务.总体目标是使客户端和文件系统服务器以同样的速度来更新,方法,参数和模型紧密集成到服务器端的代码中 ...
- 【BZOJ3064】CPU监控(线段树)
[BZOJ3064]CPU监控(线段树) 题面 BZOJ 洛谷 题解 神仙\(zsy\)出在了\(noip\)模拟的题目.(然而\(zsy\)出的还是这题的升级版) 首先明确一点,这题是一个吉司机线段 ...
- Merge Intervals - LeetCode
目录 题目链接 注意点 解法 小结 题目链接 Merge Intervals - LeetCode 注意点 区间是无序的 每个区间start一定小于end 解法 解法一:首先以start的值从小到大来 ...
- std::function 使用_
#include <iostream> #include <functional> //函数指针写法 typedef int(*FuncPoint)(const int& ...
- (转)话说C语言const用法
const在C语言中算是一个比较新的描述符,我们称之为常量修饰符,意即其所修饰 的对象为常量(immutable). 我们来分情况看语法上它该如何被使用. 1.函数体内修饰局部变量. 例: void ...
- 【题解】打地鼠 SDOI2011 模拟 行列无关
Prelude 为什么洛谷上的题解都是剪枝做的啊!就没有人写复杂度靠谱的算法吗! 传送到洛谷:( ̄. ̄) 传送到BZOJ:( ´・・)ノ(._.`) 本篇博客地址:o(><:)oo Sol ...
- bzoj 刷题计划~_~
bzoj 2818 两个互质的数的gcd=1,所以他们同时乘一个素数那么他们的gcd=这个素数,所以枚举素数p找n/p以内有多少对互质数,用欧拉函数. bzoj 2809 可并堆,对于每一个子树显然是 ...
- python中的协程并发
python asyncio 网络模型有很多中,为了实现高并发也有很多方案,多线程,多进程.无论多线程和多进程,IO的调度更多取决于系统,而协程的方式,调度来自用户,用户可以在函数中yield一个状态 ...
- 哈密顿图 哈密顿回路 哈密顿通路(Hamilton)
本文链接:http://www.cnblogs.com/Ash-ly/p/5452580.html 概念: 哈密顿图:图G的一个回路,若它通过图的每一个节点一次,且仅一次,就是哈密顿回路.存在哈密顿回 ...