sed

sed - stream editor for filtering and transforming text；

sed：利用脚本来处理、编辑文本文件；

格式：sed [OPTION]... {script-only-if-no-other-script} [input-file]...

常用参数：

OPTIONS 意义
-e或--expression=<script文件> 以选项中指定的script来处理输入的文本文件
-f<script文件>或--file=<script文件> 以选项中指定的script文件来处理输入的文本文件
-h或--help 显示帮助
-n或--quiet或--silent 仅显示script处理后的结果
-V或--version 显示版本信息
-n 用于禁止打印所有内容
G 在每行数据后插入换行
-i 将sed修改后内容写入文件

参考案例：

# 案例数据 使用ctrl+c结束输出

$ cat > content.out

lorem ipsum is a dummy text. lorem ipsum has been the industry's standard dummy text.lorem ipsum has been the industry's standard dummy text.

lorem ipsum is highly used by designers. lorem ipsum is great for developers.

lorem ipsum is used for dummy text. lorem ipsum doesn't have meaning.

learn more about dummy text.
  • 单个字符串替换（词或符号）
# 替换匹配的第一个word or characters

# 默认只会替换第一个匹配的lorem,后面的lorem不再替换

# lorem是匹配的词,Lorem是替换的词

$ sed 's/lorem/Lorem/' content.out

Lorem ipsum is a dummy text. lorem ipsum has been the industry's standard dummy text.lorem ipsum has been the industry's standard dummy text.

Lorem ipsum is highly used by designers. lorem ipsum is great for developers.

Lorem ipsum is used for dummy text. lorem ipsum doesn't have meaning.

learn more about dummy text.
  • 多个字符串替换
# 替换匹配的全部word or characters

# 若需要替换匹配的全部则在''之间使用/g

$ sed 's/lorem/Lorem/g' content.out

Lorem ipsum is a dummy text. Lorem ipsum has been the industry's standard dummy text.Lorem ipsum has been the industry's standard dummy text.

Lorem ipsum is highly used by designers. Lorem ipsum is great for developers.

Lorem ipsum is used for dummy text. Lorem ipsum doesn't have meaning.

learn more about dummy text.
  • 替换指定位置的单个字符串
# 将位置为第二的lorem替换为Lorem

# 在每一行中替换第n个出现的word or characters

# 使用 /1,/2 or n (any number) 指定替换位置

$ sed 's/lorem/Lorem/2' content.out

lorem ipsum is a dummy text. Lorem ipsum has been the industry's standard dummy text.lorem ipsum has been the industry's standard dummy text.

lorem ipsum is highly used by designers. Lorem ipsum is great for developers.

lorem ipsum is used for dummy text. Lorem ipsum doesn't have meaning.

learn more about dummy text.
  • 多个字符替换 (类似tr命令)
# 将set1中出现的所有字符替换为set2中对应的字符

# 在''之间使用y参数

$ echo 'a for apple' | sed -e 'y/af/AF/'

A For Apple
  • 替换指定开始位置的字符串
# 从指定位置2开始往后的lerem都被替换成Lorem

$ sed 's/lorem/Lorem/2g' content.out

lorem ipsum is a dummy text. Lorem ipsum has been the industry's standard dummy text.Lorem ipsum has been the industry's standard dummy text.

lorem ipsum is highly used by designers. Lorem ipsum is great for developers.

lorem ipsum is used for dummy text. Lorem ipsum doesn't have meaning.

learn more about dummy text.
  • 指定行替换字符串
# 在s前面使用数字 表示指定行替换

# 在下面的命令中，我们可以发现只有第二行被字符串'Lorem'取代

$ sed '2 s/lorem/LOREM/' content.out

lorem ipsum is a dummy text. lorem ipsum has been the industry's standard dummy text.lorem ipsum has been the industry's standard dummy text.

LOREM ipsum is highly used by designers. lorem ipsum is great for developers.

lorem ipsum is used for dummy text. lorem ipsum doesn't have meaning.

learn more about dummy text.
  • 显示文本的部分内容
# -n: 用于禁止显示全部内容

# p: 用于打印特定行

# 显示2到4行的内容

$ sed -n 2,4p content.out

lorem ipsum is highly used by designers. lorem ipsum is great for developers.

lorem ipsum is used for dummy text. lorem ipsum doesn't have meaning.

learn more about dummy text.
  • 显示指定行外的文本内容
# 显示除去1到2行外的内容

$ sed 1,2d content.out

lorem ipsum is used for dummy text. lorem ipsum doesn't have meaning.

learn more about dummy text.
  • 显示匹配行外的文本内容
$ sed '/learn/d' content.out

lorem ipsum is a dummy text. lorem ipsum has been the industry's standard dummy text.lorem ipsum has been the industry's standard dummy text.

lorem ipsum is highly used by designers. lorem ipsum is great for developers.

lorem ipsum is used for dummy text. lorem ipsum doesn't have meaning.
  • 显示替换的行
# 显示被替换的行

# 最后一行learn more about dummy text.没有匹配lorem就不显示出来

$ sed -n 's/lorem/Lorem/p' content.out

Lorem ipsum is a dummy text. lorem ipsum has been the industry's standard dummy text.lorem ipsum has been the industry's standard dummy text.

Lorem ipsum is highly used by designers. lorem ipsum is great for developers.

Lorem ipsum is used for dummy text. lorem ipsum doesn't have meaning.
  • 'p'和'-n'
# 打印第一行文本内容

$ sed -n '1p' content.out

lorem ipsum is a dummy text. lorem ipsum has been the industry's standard dummy text.lorem ipsum has been the industry's standard dummy text.

# 打印指定范围行文本内容

# 打印第一行到第四行文本内容

$ sed -n '1,4p' content.out

lorem ipsum is a dummy text. lorem ipsum has been the industry's standard dummy text.lorem ipsum has been the industry's standard dummy text.

lorem ipsum is highly used by designers. lorem ipsum is great for developers.

lorem ipsum is used for dummy text. lorem ipsum doesn't have meaning.

learn more about dummy text.

# 打印多行文本内容

# 打印第一行和第四行文本内容

$ sed -n '1p;4p' content.out

# 打印一个文件内容

$ sed -n 'p' content.out

lorem ipsum is a dummy text. lorem ipsum has been the industry's standard dummy text.lorem ipsum has been the industry's standard dummy text.

lorem ipsum is highly used by designers. lorem ipsum is great for developers.

lorem ipsum is used for dummy text. lorem ipsum doesn't have meaning.

learn more about dummy text.

# 显示匹配字符串的行

$ sed -n '/lorem/p' content.out

# 输出包含数字的行

$ sed -n '/[0-9]/p' content.out

# 显示匹配的行并在前面添加`Matched--`内容

$ sed -n 's/^l/Matched--&/p' content.out

Matched--lorem ipsum is a dummy text. lorem ipsum has been the industry's standard dummy text.lorem ipsum has been the industry's standard dummy text.

Matched--lorem ipsum is highly used by designers. lorem ipsum is great for developers.

Matched--lorem ipsum is used for dummy text. lorem ipsum doesn't have meaning.

Matched--learn more about dummy text.
  • 使用sed替代grep
# 使用sed完成grep的功能

$ sed -n '/root/p' /etc/passwd

root:x:0:0:root:/root:/bin/bash

operator:x:11:0:operator:/root:/sbin/nologin
  • sed多参数
# 将所有出现的“lorem”替换为“lorem”，并删除与/learn/搜索模式匹配的行;

$ sed -e 's/lorem/Lorem/g' -e '/learn/d' content.out

Lorem ipsum is a dummy text. Lorem ipsum has been the industry's standard dummy text.Lorem ipsum has been the industry's standard dummy text.

Lorem ipsum is highly used by designers. Lorem ipsum is great for developers.

Lorem ipsum is used for dummy text. Lorem ipsum doesn't have meaning.
  • 插入换行符
# 插入单行换行符

$ sed G content.out

# 插入多行换行符

$ sed 'G;G' content.out
  • 备份文本并修改文本内容
# use 'i.<file extension>' for backup file name and -e editing.

# 创建一个原始文件'content.txt'的备份为'content.txt.bak'

$ sed -i.bak -e 's/lorem/LOREM/g' content.out

# Results

# 修改的文件

$ cat content.out

LOREM ipsum is a dummy text. LOREM ipsum has been the industry's standard dummy text.LOREM ipsum has been the industry's standard dummy text.

LOREM ipsum is highly used by designers. LOREM ipsum is great for developers.

LOREM ipsum is used for dummy text. LOREM ipsum doesn't have meaning.

learn more about dummy text.

# 备份文件

$ cat content.out.bak

lorem ipsum is a dummy text. lorem ipsum has been the industry's standard dummy text.lorem ipsum has been the industry's standard dummy text.

lorem ipsum is highly used by designers. lorem ipsum is great for developers.

lorem ipsum is used for dummy text. lorem ipsum doesn't have meaning.

learn more about dummy text.
  • 删除匹配的行
# In the following output, the line with starting 'lorem' and ending with 'text.' is deleted

# 删除以lerem且test.结尾的行

$ sed -e 's/^lorem.*text.$//g' content.out

LOREM ipsum is a dummy text. LOREM ipsum has been the industry's standard dummy text.LOREM ipsum has been the industry's standard dummy text.

LOREM ipsum is highly used by designers. LOREM ipsum is great for developers.

LOREM ipsum is used for dummy text. LOREM ipsum doesn't have meaning.

learn more about dummy text.
  • 添加数据到指定位置
# 可以看到“Here”被添加在每一行的前面

# 添加数据到行首

$ sed -e 's/.*/Here &/' content.out

Here LOREM ipsum is a dummy text. LOREM ipsum has been the industry's standard dummy text.LOREM ipsum has been the industry's standard dummy text.

Here LOREM ipsum is highly used by designers. LOREM ipsum is great for developers.

Here LOREM ipsum is used for dummy text. LOREM ipsum doesn't have meaning.

Here learn more about dummy text.

# 插入字符串在每行开始并换行

$ sed 'i \inserted line' content.out

inserted line

LOREM ipsum is a dummy text. LOREM ipsum has been the industry's standard dummy text.LOREM ipsum has been the industry's standard dummy text.

inserted line

LOREM ipsum is highly used by designers. LOREM ipsum is great for developers.

inserted line

LOREM ipsum is used for dummy text. LOREM ipsum doesn't have meaning.

inserted line

learn more about dummy text.

# 插入字符串在每行末尾并换行

$ sed 'a \Appended line' content.out

LOREM ipsum is a dummy text. LOREM ipsum has been the industry's standard dummy text.LOREM ipsum has been the industry's standard dummy text.

Appended line

LOREM ipsum is highly used by designers. LOREM ipsum is great for developers.

Appended line

LOREM ipsum is used for dummy text. LOREM ipsum doesn't have meaning.

Appended line

learn more about dummy text.

Appended line
  • 提取数据
# 将提取所有可用的linux用户名

$ sed 's/\([^:]*\).*/\1/' /etc/passwd
  • 打印不带注释#和空行的数据
# 打印不带注释和空行的数据

$ sed -e 's/#.*//;/^$/d' content.out

LOREM ipsum is a dummy text. LOREM ipsum has been the industry's standard dummy text.LOREM ipsum has been the industry's standard dummy text.

LOREM ipsum is highly used by designers. LOREM ipsum is great for developers.

LOREM ipsum is used for dummy text. LOREM ipsum doesn't have meaning.

learn more about dummy text.
  • 移除带有注释#的行
$ sed 's/#.*//' /etc/yum.repos.d/CentOS-Base.repo
  • 从文本种提取ip地址
# 添加测试数据

$ vi content.txt

lorem ipsum is a dummy text. lorem ipsum has been the industry's standard dummy text.

lorem ipsum is highly used by designers. lorem ipsum is great for developers.

lorem ipsum is used for dummy text. lorem ipsum doesn't have meaning.

learn more about dummy text.

122.65.49.2

221.11.165.233

219.158.9.97

219.158.19.137

# 复杂版 - 提取ip地址

$ sed '/\n/!s/[0-9.]\+/\n&\n/;/^\([0-9]\{1,3\}\.\)\{3\}[0-9]\{1,3\}\n/P;D' content.txt

# 简化版 - 提取ip地址

$ sed -n '/[0-9]/p' content.txt

# 使用管道(|)将sed与其他命令组合使用

$ ip addr | sed -n '/inet/p' |sed -e 's/  */ /g'|cut -d ' ' -f3

127.0.0.1/8

::1/128

192.168.188.188/24

fe80::400e:cc35:e4ab:8c3f/64

172.17.0.1/16

fe80::42:65ff:fee9:cfb0/64

fe80::4cf2:b7ff:feb4:44fa/64

fe80::4478:34ff:fe5b:8d9a/64
  • 数据提取并重定向并写到新的文件中
$ sed -n '/root/w rootpwd.txt' /etc/passwd

$ cat rootpwd.txt

root:x:0:0:root:/root:/bin/bash

operator:x:11:0:operator:/root:/sbin/nologin

Linux命令篇 - sed 命令的更多相关文章

  1. Linux实战教学笔记12:linux三剑客之sed命令精讲

    第十二节 linux三剑客之sed命令精讲 标签(空格分隔): Linux实战教学笔记-陈思齐 ---更多资料点我查看 1,前言 我们都知道,在Linux中一切皆文件,比如配置文件,日志文件,启动文件 ...

  2. Linux中使用sed命令或awk命令修改常规配置文件

    一.方案: Linux中使用sed命令或awk命令修改常规配置文件 二.步骤: 1.假设有一个a.txt,内容如下: #!/bin/bash aa= bbb= ccc= #ddd= 2.如果想要把里面 ...

  3. 快速理解linux流编辑器sed命令

    原创 杜亦舒性能与架构 之前介绍过 awk 命令,sed 命令同样是非常重要的文本处理工具,涉及到linux shell开发时,几乎是避不开这两大利器的 sed 是 stream editor 的简写 ...

  4. day14 linux三剑客之sed命令

    day14 linux三剑客之sed命令 sed命令 Sed 主要用来自动编辑一个或多个文件.简化对文件的反复操作.编写转换程序等. sed(流式编辑器) : sed主要用来修改文件. 1.sed命令 ...

  5. linux命令总结sed命令详解

    Sed 简介 sed 是一种新型的,非交互式的编辑器.它能执行与编辑器 vi 和 ex 相同的编辑任务.sed 编辑器没有提供交互式使用方式,使用者只能在命令行输入编辑命令.指定文件名,然后在屏幕上查 ...

  6. 【Linux 命令】sed 命令

    文章转载自:https://www.jianshu.com/p/779f40985b20 文本分隔:------ # 在每一行后面增加一空行. sed G # 在每一行后面增加两行空行. sed &q ...

  7. linux shell 用sed命令在文本的行尾或行首添加字符

    转自 http://www.cnblogs.com/aaronwxb/archive/2011/08/19/2145364.html 昨天写一个脚本花了一天的2/3的时间,而且大部分时间都耗在了sed ...

  8. linux三剑客之sed命令

    一.前言 我们都知道,在Linux中一切皆文件,比如配置文件,日志文件,启动文件等等.如果我们相对这些文件进行一些编辑查询等操作时,我们可能会想到一些vi,vim,cat,more等命令.但是这些命令 ...

  9. Linux Shell编程 sed命令

    概述 sed 是一种几乎可以应用在所有 UNIX 平台(包括 Linux)上的轻量级流编辑器,体积小.所以,它可以对从如管道这样的标准输入中接收的数据进行编辑. sed 主要是用来将数据进行选取.替换 ...

随机推荐

  1. CentOS7防火墙开启与关闭以及开放6379，3306，80等端口

    CentOS7用firewall防火墙替代了原来的iptables,所以我们应该使用firewall的一些命令.如下:1.关闭防火墙 systemctl stop firewalld.service ...

  2. Scanner几个问题与正则简介

    Pre:最近做了头条的在线笔试,对Scanner输入的处理有些特殊,当时是一脸懵逼态,遂由此随笔(/@_@\),java小白,有错难免! 查了下Scanner的源码,没有头绪,但是其中用到了正则的知识 ...

  3. Java中8种基本数据类型是哪些

    1 public class Ceshi { 2 int a; 3 double b; 4 boolean c; 5 char d; 6 float f; 7 byte e; 8 long h; 9 ...

  4. chubby 是什么，和 zookeeper 比你怎么看？

    chubby 是 google 的,完全实现 paxos 算法,不开源.zookeeper 是 chubby的开源实现,使用 zab 协议,paxos 算法的变种.

  5. python学习笔记（六）——程序调试

    在我们平时编写程序时,常常会遇到各种错误,俗称BUG.而我们程序猿的工作常常需要对程序进行调试,也就是所谓的debug. 程序调试是将编制的程序投入实际运行前,用手工或编译程序等方法进行测试,修正语法 ...

  6. python学习笔记（三）——函数

    函数定义 def 函数名(形参 . . . ) 函数体 1. 函数参数 返回值:可以有一个或多个 形参:支持默认形参.关键字形参.可变参数形参等 1.1 必须参数 调用时传入的参数必须与定义时相同. ...

  7. 单例模式应用 | Shared_ptr引用计数管理器

    在我们模拟设计 shared_ptr 智能指针时发现,不同类型的 Shared_ptr 不能使用同一个引用计数管理器,这显然会造成内存上的浪费.因此我们考虑将其设计为单例模式使其所有的 Shared_ ...

  8. Numpy对数组按索引查询

    Numpy对数组按索引查询 三种索引方法: 基础索引 神奇索引 布尔索引 基础索引 一维数组 和Python的List一样 二维数组 注意:切片的修改会修改原来的数组 原因:Numpy经常要处理大数组 ...

  9. APICloud案例源码、模块源码、考试源码、开发工具大集合！赶快收藏

    APICloud专注于APP开发定制技术,多年来不停为开发者奉献更多的资源.此次,APICloud将以往的的资源进行更新.整合,以合集的形式分享给广大的用户. APICloud应用案例源码合集 API ...

  10. Value注解获取值一直为Null

    @Value("${jwt.tokenHeader}") private String tokenHeader; 常见的错误解决办法如下: 1.使用static或final修饰了t ...