优化笔记:pfyhparopenfundinfotest_D_20140916.gz
性能瓶颈在函数的乱用。原代码黄色部分。
12分钟->35秒
---------------------------------------------------------------------------------------------
1.对两个函数调用多次，而且两个函数之间还有调用关系。（优化器是可以自动把函数体拆出来，拼到主查询里面一起优化的。但是太复杂了它也蒙。）
IsSpecial和gettradedate函数都是从1010表拿数据。
IsSpecial 扫2次1010表
Gettradedate 扫1次1010表
而4603表有25万多数据，对这个查询用了2次IsSpecial 和3次 Gettradedate，最糟糕的情况对1010表的扫描次数大约25万*（2+3） =125万次
用with把1010逻辑提出来，然后通过cross join连接到主查询，只扫一次。
2.这个案例跟昨天那个代码结构相似，但是情况正好相反。
如果把or改成union，性能反而会变慢。（昨天的把or改成union性能会变快）
开始判断性能瓶颈的时候发生了点悲剧。4603表有25万的数据，唯一性索引在OB_OBJECT_ID上面（错看成在f1_4603上了，o(╯□╰)o），而我们需要的只有2500左右，而且与1090相连用的是f1_4603.
所以错认为了走4603的索引效率会变高。
其实这个案例，不管索引在OB_OBJECT_ID还是f1_4603上面都没有用。因为真正把数据从25万筛选成2500的条件是在f3_4603上面，而f3上面没有索引，所以必须全表扫描。
所以，如果把or改成了union，本来对4603表的全扫描只扫1次，就会变成2次，效率反而降低。（昨天的案例把or改为union，从1次全表扫描变为2次索引扫描，效率提升）。
3.其他相似子查询，可按之前的办法合并。
-------------------------------优化后代码----------------------------------------------
with td as
(select max(f1_1010) - min(f1_1010) special,
max(f1_1010) ed,
min(f1_1010) sd
from (select f1_1010
from wind.tb_object_1010
where f1_1010 < to_char(&PlanTime, 'yyyymmdd')
order by f1_1010 desc)
where rownum <= 2)
select *
from (Select case
when f16_1090 like '%!%' then
substr(f16_1090, 1, instr(f16_1090, '!') - 1)
else
F16_1090
end Zqdm,
case
when nvl(F6_4603, 0) = 0 then
nvl(F4_4603, 0)
else
nvl(F6_4603, 0)
end Net_value,
0 Begin_Net,
case
when nvl(f4_4603, 0) <> 0 then
nvl(nvl(F5_4603, f4_4603), 0)
when nvl(f4_4603, 0) = 0 then
nvl(F5_4603, 0)
end Total_net,
---除货币基金累计未公布时，取单位净值[20140507]
0 Adjust_net,
0 Adjust_Int,
Case
When exists (select '1'
from wind.tb_object_1101
where f14_1101 = f2_1090
and f13_1101 = f3_4603
and f15_1101 = 1) Then
'Y'
Else
'N'
End div_date,
F3_4603 data_date,
Case
When Exists (Select '1'
From Wind.tb_object_4521
Where f1_4521 = f16_1090
And f14_4521 = F3_4603) Then
(Select f9_4521
From Wind.tb_object_4521
Where f1_4521 = f16_1090
And f14_4521 = F3_4603)
When f5_1090 = '上海' Then
'H'
When f5_1090 = '深圳' Then
'S'
Else
'Y'
End market,
Case
When Exists (Select '1'
From Wind.tb_object_4521
Where f1_4521 = f16_1090
And f14_4521 = F3_4603) Then
(Select f15_4521
From Wind.tb_object_4521
Where f1_4521 = f16_1090
And f14_4521 = F3_4603)
ELSE
F100_1099
END fund_type,
(select (F5_1115 * 10000)
from wind.tb_object_1115 a
where f1_1115 = f2_1090
and a.f2_1115 = (Select Max(b.F2_1115)
From wind.tb_object_1115 b
Where a.f1_1115 = b.f1_1115
And b.f2_1115 <= F3_4603)) Total_amt,
Null As BataValue
From wind.tb_object_1090
inner join wind.tb_object_4603 b
on F1_4603 = f2_1090
inner join wind.tb_object_1099
on f1_1099 = F2_1090
cross join td
Where (f19_1090 = '0' or f18_1090 >= to_char(&PlanTime, 'yyyymmdd'))
and ((td.special = 1 and td.ed = F3_4603) or
(td.special != 1 and F3_4603 > td.sd and F3_4603 <= td.ed)))
where length(zqdm) <= 6
union all
Select case
when f16_1090 = 'TZ0001' then
'TZ0002'
when f16_1090 = 'TZ0002' then
'TZ0001'
---小写转大写---
elSe
UPPER(f16_1090)
end Zqdm,
nvl(F3_4141, 0) Net_value,
0 Begin_Net,
case
when exists (select '1'
from wind.tb_object_1744
where f1_1744 = f1_4141
and f6_1744 = '货币市场型') then
0
else
nvl(nvl(F4_4141, F3_4141), 0)
end Total_net,
0 Adjust_net,
0 Adjust_Int,
'N' div_date,
f2_4141 data_date,
'Y' market,
nvl((select case
when f6_1744 = '货币市场型' then
'货币型'
else
f6_1744
end
from wind.tb_object_1744
where f1_1744 = f1_4141
and f6_1744 < > 'FOF'),
'债券型') fund_type,
nvl((Select f7_1772
From wind.tb_object_1772 b
Where f1_1772 = f2_1090
And f2_1772 = (Select Max(f2_1772)
From wind.tb_object_1772
Where b.f1_1772 = f1_1772)),
0) Total_amt,
null BataValue
From wind.tb_object_1090, wind.tb_object_4141 a
Where f1_4141 = f2_1090
And f2_4141 = (Select Max(f1_0012)
From wind.tb_object_0012
Where f1_0012 < to_char(&PlanTime, 'yyyymmdd')
And f3_0012 = 'CN'
And f4_0012 = 1
And F2_0012 = 'SSE')
AND F4_1090 = 'LC'
union
Select F16_1090 Zqdm,
nvl(F4_1449, 0) Net_value,
1 Begin_Net,
0 Total_net,
0 Adjust_net,
0 Adjust_Int,
'N' div_date,
F2_1449 data_date,
Case
When f5_1090 = '上海' Then
'H'
When f5_1090 = '深圳' Then
'S'
Else
'Y'
End market,
case
when exists (select '1'
from wind.tb_object_1400
where f2_1400 = f2_1090
and f6_1400 = '1'
and f3_1400 = '2001010503') then
'QDII'
else
(select decode(F100_1099, '货币市场型', '货币型', f100_1099)
from wind.tb_object_1099
where f1_1099 = f2_1090)
end fund_type,
(select F5_1115 * 10000
from wind.tb_object_1115 b
where f1_1115 = f2_1090
And b.f2_1115 = (Select Max(F2_1115)
From wind.tb_object_1115
Where f1_1115 = f2_1090
And f2_1115 < = f6_1449)) Total_amt,
(SELECT F4_5052
FROM WIND.TB_OBJECT_5052
WHERE F3_5052 = '613007000'
AND F1_5052 = F2_1090
AND F2_5052 =
(SELECT MAX(F2_5052)
FROM WIND.TB_OBJECT_5052
WHERE F1_5052 = F2_1090
AND F3_5052 = '613007000'
AND F2_5052 <= TO_CHAR(&PlanTime, 'YYYYMMDD'))) BataValue
From wind.tb_object_1090, wind.tb_object_1449 a
Where F1_1449 = f2_1090
And f19_1090 = '0'
and length(f16_1090) < = 6
and F3_1449 =
(select max(F16_1101)
from wind.tb_object_1101
where F16_1101 <= to_char(&PlanTime, 'yyyymmdd'))
AND NOT EXISTS (SELECT '1 '
from WIND.TB_OBJECT_4603
WHERE F3_4603 = F2_1449
AND F1_4603 = F1_1449)
------------------------原代码-------------------------------------------------------------
函数1：
create or replace function wind.GetTradeDate(p_start varchar2,p_inc number) return varchar2 is
Result varchar2(10);
begin
if p_start is null then
return null;
end if;
if p_inc<0 then
select min(f1_1010) into Result
from (select f1_1010 from wind.tb_object_1010
where f1_1010<p_start order by f1_1010 desc)
where rownum<=abs(p_inc);
elsif p_inc>0 then
select max(f1_1010) into Result
from (select f1_1010 from wind.tb_object_1010
where f1_1010>p_start order by f1_1010)
where rownum<=abs(p_inc);
else
Result:=p_start;
end if;
return(Result);
end GetTradeDate;
函数2：
create or replace function wind.IsSpecial(strDate varchar2) return number is
lastTradeDay varchar2(8);
nCount number;
begin
lastTradeDay := gettradeDate(strDate,-1);
select count(1) into nCount
from wind.tb_object_1010
where f1_1010 = to_char((to_date(lastTradeDay,'yyyymmdd') -1),'yyyymmdd');
return 1 - nCount;
end;
select *
from (Select case
when f16_1090 like '%!%' then
substr(f16_1090, 1, instr(f16_1090, '!') - 1)
else
F16_1090
end Zqdm,
case
when nvl(F6_4603, 0) = 0 then
nvl(F4_4603, 0)
else
nvl(F6_4603, 0)
end Net_value,
0 Begin_Net,
case
when nvl(f4_4603, 0) <> 0 then
nvl(nvl(F5_4603, f4_4603), 0)
when nvl(f4_4603, 0) = 0 then
nvl(F5_4603, 0)
end Total_net,
---除货币基金累计未公布时，取单位净值[20140507]
0 Adjust_net,
0 Adjust_Int,
Case
When exists (select '1'
from wind.tb_object_1101
where f14_1101 = f2_1090
and f13_1101 = f3_4603
and f15_1101 = 1) Then
'Y'
Else
'N'
End div_date,
F3_4603 data_date,
Case
When Exists (Select '1'
From Wind.tb_object_4521
Where f1_4521 = f16_1090
And f14_4521 = F3_4603) Then
(Select f9_4521
From Wind.tb_object_4521
Where f1_4521 = f16_1090
And f14_4521 = F3_4603)
When f5_1090 = '上海' Then
'H'
When f5_1090 = '深圳' Then
'S'
Else
'Y'
End market,
Case
When Exists (Select '1'
From Wind.tb_object_4521
Where f1_4521 = f16_1090
And f14_4521 = F3_4603) Then
(Select f15_4521
From Wind.tb_object_4521
Where f1_4521 = f16_1090
And f14_4521 = F3_4603)
ELSE
F100_1099
END fund_type,
(select (F5_1115 * 10000)
from wind.tb_object_1115 a
where f1_1115 = f2_1090
and a.f2_1115 = (Select Max(b.F2_1115)
From wind.tb_object_1115 b
Where a.f1_1115 = b.f1_1115
And b.f2_1115 <= F3_4603)) Total_amt,
Null As BataValue
From wind.tb_object_1090,
wind.tb_object_4603 b,
wind.tb_object_1099
Where F1_4603 = f2_1090
And f1_1099 = F2_1090
And (f19_1090 = '0' or f18_1090 >= to_char(&PlanTime, 'yyyymmdd'))
and (((IsSpecial(to_char(&PlanTime, 'yyyymmdd'))) = 0 and
gettradedate(to_char(&PlanTime, 'yyyymmdd'), -1) = F3_4603) or
(IsSpecial(to_char(&PlanTime, 'yyyymmdd')) = 1 and
F3_4603 >
gettradedate(gettradedate(to_char(&PlanTime, 'yyyymmdd'),
-1),
-1) and
F3_4603 <= gettradedate(to_char(&PlanTime, 'yyyymmdd'), -1))))
where length(zqdm) <= 6
union all
Select case
when f16_1090 = 'TZ0001' then
'TZ0002'
when f16_1090 = 'TZ0002' then
'TZ0001'
---小写转大写---
elSe
UPPER(f16_1090)
end Zqdm,
nvl(F3_4141, 0) Net_value,
0 Begin_Net,
case
when exists (select '1'
from wind.tb_object_1744
where f1_1744 = f1_4141
and f6_1744 = '货币市场型') then
0
else
nvl(nvl(F4_4141, F3_4141), 0)
end Total_net,
0 Adjust_net,
0 Adjust_Int,
'N' div_date,
f2_4141 data_date,
'Y' market,
nvl((select case
when f6_1744 = '货币市场型' then
'货币型'
else
f6_1744
end
from wind.tb_object_1744
where f1_1744 = f1_4141
and f6_1744 < > 'FOF'),
'债券型') fund_type,
nvl((Select f7_1772
From wind.tb_object_1772 b
Where f1_1772 = f2_1090
And f2_1772 = (Select Max(f2_1772)
From wind.tb_object_1772
Where b.f1_1772 = f1_1772)),
0) Total_amt,
null BataValue
From wind.tb_object_1090, wind.tb_object_4141 a
Where f1_4141 = f2_1090
And f2_4141 = (Select Max(f1_0012)
From wind.tb_object_0012
Where f1_0012 < to_char(&PlanTime, 'yyyymmdd')
And f3_0012 = 'CN'
And f4_0012 = 1
And F2_0012 = 'SSE')
AND F4_1090 = 'LC'
union
Select F16_1090 Zqdm,
nvl(F4_1449, 0) Net_value,
1 Begin_Net,
0 Total_net,
0 Adjust_net,
0 Adjust_Int,
'N' div_date,
F2_1449 data_date,
Case
When f5_1090 = '上海' Then
'H'
When f5_1090 = '深圳' Then
'S'
Else
'Y'
End market,
case
when exists (select '1'
from wind.tb_object_1400
where f2_1400 = f2_1090
and f6_1400 = '1'
and f3_1400 = '2001010503') then
'QDII'
else
(select decode(F100_1099, '货币市场型', '货币型', f100_1099)
from wind.tb_object_1099
where f1_1099 = f2_1090)
end fund_type,
(select F5_1115 * 10000
from wind.tb_object_1115 b
where f1_1115 = f2_1090
And b.f2_1115 = (Select Max(F2_1115)
From wind.tb_object_1115
Where f1_1115 = f2_1090
And f2_1115 < = f6_1449)) Total_amt,
(SELECT F4_5052
FROM WIND.TB_OBJECT_5052
WHERE F3_5052 = '613007000'
AND F1_5052 = F2_1090
AND F2_5052 =
(SELECT MAX(F2_5052)
FROM WIND.TB_OBJECT_5052
WHERE F1_5052 = F2_1090
AND F3_5052 = '613007000'
AND F2_5052 <= TO_CHAR(&PlanTime, 'YYYYMMDD'))) BataValue
From wind.tb_object_1090, wind.tb_object_1449 a
Where F1_1449 = f2_1090
And f19_1090 = '0'
and length(f16_1090) < = 6
and F3_1449 =
(select max(F16_1101)
from wind.tb_object_1101
where F16_1101 <= to_char(&PlanTime, 'yyyymmdd'))
AND NOT EXISTS (SELECT '1 '
from WIND.TB_OBJECT_4603
WHERE F3_4603 = F2_1449
AND F1_4603 = F1_1449)
优化笔记:pfyhparopenfundinfotest_D_20140916.gz的更多相关文章
- 优化笔记: jxrsfxrxx_D_20140916.gz
表的重复扫描. ----------------------------------想进一步研究,继续往下看------------------------------ 1. 所有相似 ...
- Android App性能优化笔记之一:性能优化是什么及为什么?
By Long Luo 周星驰的电影<功夫>里面借火云邪神之口说出了一句至理名言:“天下武功,唯快不破”. 在移动互联网时代,同样如此,留给一个公司的窗口往往只有很短的时间,如何把握住 ...
- （转）MySQL优化笔记（八）--锁机制超详细解析（锁分类、事务并发、引擎并发控制）
当一个系统访问量上来的时候,不只是数据库性能瓶颈问题了,数据库数据安全也会浮现,这时候合理使用数据库锁机制就显得异常重要了. 原文:http://www.jianshu.com/p/163c96983 ...
- U3D开发性能优化笔记(待增加版本.x)
http://blog.csdn.net/kaitiren/article/details/45071997 此总结由自己经验及网上收集整理优化内容 包括: .代码方面: .函数使用方面: .ui注意 ...
- CMU Convex Optimization(凸优化)笔记1--凸集和凸函数
CMU凸优化笔记--凸集和凸函数 结束了一段时间的学习任务,于是打算做个总结.主要内容都是基于CMU的Ryan Tibshirani开设的Convex Optimization课程做的笔记.这里只摘了 ...
- 优化笔记：jsyhjkzqxx_D_20140916.gz
有几张表没有权限,所以跑不起来. 目测黄色部分比较坑爹,死了n多脑细胞才看懂,又死了n多脑细胞才改出来.对5034进行了2次扫描,并多次分组排序求和.(分组和排序算法相对来说比较耗性能) 改为只扫描一 ...
- 移动web性能优化笔记
移动web性能优化 最近看了一些文章,对移动web性能优化方法,做一个简单笔记 笔记内容主要出自 移动H5前端性能优化指南和移动前端系列——移动页面性能优化
- mysql系列十一、mysql优化笔记：表设计、sql优化、配置优化
可以从这些方面进行优化: 数据库(表)设计合理 SQL语句优化 数据库配置优化 系统层.硬件层优化 数据库设计 关系数据库三范式 1NF:字段不可分; 2NF:有主键,非主键字段依赖主键; 3NF:非 ...
- nginx优化笔记（keepalive、https等）
一.nginx之tcp_nopush.tcp_nodelay.sendfile 1.TCP_NODELAY你怎么可以强制 socket 在它的缓冲区里发送数据?一个解决方案是 TCP 堆栈的 TCP_ ...
随机推荐
- 在ORACLE中移动数据库文件
转载: 在ORACLE中移动数据库文件 --ORACLE数据库由数据文件,控制文件和联机日志文件三种文件组成. --由于磁盘空间的变化,或者基于数据库磁盘I/O性能的调整等, --我們可能会考虑移动数 ...
- Openflow1.3
Openflow1.3 协议标准
- Ubuntu网络代理问题
问题描述 新开机的电脑,不开lantern就上不了网.很气. 解决过程 首先当然是寻求解决方案了.未果 然后就是妥协,每次先开一次lantern.(其实也不是很麻烦是吧,哎,是的是的) 今天早晨友人来 ...
- python对文件的读写
文件 File 什么是文件 文件是用于数据存储和单位 文件通常用来长期存储数据 文件中的数据是以字节为单位进行顺序存储的 文件的操作流程: 1. 打开文件 2. 读/写文件 3. 关闭文件 注: 任何 ...
- BZOJ - 3295 动态逆序对 (树状数组套treap)
题目链接 思路和bzoj2141差不多,不过这道题的数据更强一些,线段树套treapT了,树状数组套treap卡过~~ #include<bits/stdc++.h> using name ...
- Codeforces 382E Ksenia and Combinatorics 【组合计数】*
Codeforces 382E Ksenia and Combinatorics Ksenia has her winter exams. Today she is learning combinat ...
- jenkins for mac
Mac环境中Jenkins的停止和启动命令启动sudo launchctl load /Library/LaunchDaemons/org.jenkins-ci.plist停止sudo launchc ...
- 如何最快速地将旧的 NuGet 包 (2.x, packages.config) 升级成新的 NuGet 包 (4.x, PackageReference)
最近我将项目格式进行了升级,从旧的 csproj 升级成了新的 csproj:NuGet 包管理的方式也从 packages.config 升级成了 PackageReference.然而迁移完才发现 ...
- scrapy 伪装代理和fake_userAgent的使用
伪装浏览器代理 在爬取网页是有些服务器对请求过滤的不是很高可以不用ip来伪装请求直接将自己的浏览器信息给伪装也是可以的. 第一中方法: 1.在setting.py文件中加入以下内容,这是一些浏览器的头 ...
- SpringBoot在logback.xml中读取application.properties中配置的日志路径
1.在springboot项目中使用logback记录日志,在logback.xml中配置日志存储位置时读取application.properties中配置的路径,在 logback.xml中配置引 ...