Python 爬虫 数据提取
一下子运行 七八十个 select 将会是什么样的体验呢?
业务部门提供了一个需要,要求从爬虫数据中提取出88家的数据,
并且也提供了一个excel表格,如下图:

这个时候我们可以通过拍卖行,拍卖时间,拍卖会专场写SQL语句,单个SQL是这样写的。其中数据库表格的数据是540万,我们在建表的时候已经为 item_auct_time ,session_name
,aucr_name_spider ,添加了索引。所以SQL的执行速度很快。
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="中国嘉德国际拍卖有限公司"
and session_name ="大观——四海崇誉庆典之夜·古代"
但是面对的是 88 行,我们总不能写88 个SQL语句吧,这样效率太低了,
这个时候我们可以用代码直接生成SQL语句
首先去复制这三行的数据,然后封装一个列表。如下
ccc= [{"data1":"佳士得伦敦有限公司","data2":"中国瓷器及工艺精品","data3":"2017/5/9"},
{"data1":"佳士得香港有限公司","data2":"瑰丽珠宝及翡翠首饰","data3":"2017/11/28"},
{"data1":"邦瀚斯拍卖行","data2":"中国瓷器及工艺精品专场","data3":"2017/11/28"},
{"data1":"保利华谊","data2":"中国书画","data3":"2017/12/8"},
{"data1":"保利香港拍卖有限公司","data2":"璀璨珠宝专场","data3":"2017/4/3"},
{"data1":"保利香港拍卖有限公司","data2":"璀璨珠宝专场","data3":"2017/4/3"},
{"data1":"保利香港拍卖有限公司","data2":"中国及亚洲现当代艺术专场","data3":"2017/4/3"},
{"data1":"保利香港拍卖有限公司","data2":"璀璨珠宝专场","data3":"2017/10/2"},
{"data1":"保利香港拍卖有限公司","data2":"清净广严—重要藏家珍藏永乐宫廷造像","data3":"2017/10/2"},
{"data1":"保利香港拍卖有限公司","data2":"清净广严—重要藏家珍藏永乐宫廷造像","data3":"2017/10/2"},
{"data1":"保利香港拍卖有限公司","data2":"清净广严—重要藏家珍藏永乐宫廷造像","data3":"2017/10/2"},
{"data1":"保利香港拍卖有限公司","data2":"现当代艺术专场","data3":"2017/10/2"},
{"data1":"保利香港拍卖有限公司","data2":"尤伦斯男爵藏中国重要金器专场","data3":"2017/10/2"},
{"data1":"保利香港拍卖有限公司","data2":"璀璨珠宝专场","data3":" 2017/10/2"},
{"data1":"北京保利国际拍卖有限公司","data2":"瓷器 玉器 工艺品(二)","data3":"2017/4/17"},
{"data1":"北京保利国际拍卖有限公司","data2":"中国古代书画夜场","data3":"2017/6/5"},
{"data1":"北京保利国际拍卖有限公司","data2":"中国古代书画夜场","data3":"2017/6/5"},
{"data1":"北京保利国际拍卖有限公司","data2":"中国古代书画夜场","data3":"2017/6/5"},
{"data1":"北京保利国际拍卖有限公司","data2":"中国近现代书画夜场","data3":"2017/6/5"},
{"data1":"北京保利国际拍卖有限公司","data2":"泉韵古今——纸币、机制币、金银锭 王觐彤旧藏古钱","data3":"2017/6/6"},
{"data1":"北京保利国际拍卖有限公司","data2":"自在菩提——中国金铜佛造像、唐卡","data3":"2017/6/7"},
{"data1":"北京保利国际拍卖有限公司","data2":"仰之弥高—中国古代书画夜场","data3":"2017/12/17"},
{"data1":"北京保利国际拍卖有限公司","data2":"震古烁今——从北宋到当代的中国书画","data3":"2017/12/17"},
{"data1":"北京保利国际拍卖有限公司","data2":"震古烁今——从北宋到当代的中国书画","data3":"2017/12/17"},
{"data1":"北京保利国际拍卖有限公司","data2":"震古烁今——从北宋到当代的中国书画","data3":"2017/12/17"},
{"data1":"北京保利国际拍卖有限公司","data2":"中国近现代书画夜场","data3":"2017/12/17"},
{"data1":"北京保利国际拍卖有限公司","data2":"中国近现代书画夜场","data3":"2017/12/17"},
{"data1":"北京保利国际拍卖有限公司","data2":"瑰映如茵Ⅱ——玫茵堂暨欧美名藏盛清五朝御窑隽品","data3":"2017/12/18"},
{"data1":"北京保利国际拍卖有限公司","data2":"佞宋——宋元巷陌间的“色·声·香·味·触”","data3":"2017/12/18"},
{"data1":"北京保利国际拍卖有限公司","data2":"禹贡(二)——康熙御制黄花梨大四件柜 唐英督陶与大清的辉煌时刻","data3":"2017/12/18"},
{"data1":"北京保利国际拍卖有限公司","data2":"禹贡(二)——康熙御制黄花梨大四件柜 唐英督陶与大清的辉煌时刻","data3":"2017/12/18"},
{"data1":"北京保利国际拍卖有限公司","data2":"禹贡(二)——康熙御制黄花梨大四件柜 唐英督陶与大清的辉煌时刻","data3":"2017/12/18"},
{"data1":"北京保利国际拍卖有限公司","data2":"禹贡(二)——康熙御制黄花梨大四件柜 唐英督陶与大清的辉煌时刻","data3":"2017/12/18"},
{"data1":"北京保利国际拍卖有限公司","data2":"方寸聚九州——邮品专场","data3":"2017/12/22"},
{"data1":"北京保利国际拍卖有限公司","data2":"方寸聚九州——名家旧藏华东解放区专场","data3":"2017/12/23"},
{"data1":"北京保利国际拍卖有限公司","data2":"禹贡——敬勝怠者吉 古董珍玩之夜","data3":" 2017/6/6"},
{"data1":"北京诚轩拍卖有限公司","data2":"古钱 银锭 机制币","data3":"2017/12/20"},
{"data1":"北京诚轩拍卖有限公司","data2":"古钱 银锭 机制币","data3":"2017/12/20"},
{"data1":"北京诚轩拍卖有限公司","data2":"古钱 银锭 机制币","data3":" 2017/12/20"},
{"data1":"北京诚轩拍卖有限公司","data2":"古钱 银锭 机制币","data3":" 2017-6-21"},
{"data1":"北京东正拍卖有限公司","data2":"皇家长物","data3":"2017/6/8"},
{"data1":"北京东正拍卖有限公司","data2":"乾坤荟萃—旦暮清供","data3":"2017/6/8"},
{"data1":"北京东正拍卖有限公司","data2":"皇家长物","data3":"2017/12/9"},
{"data1":"北京华辰拍卖有限公司","data2":"瓷器玉器工艺品","data3":"2017/12/17"},
{"data1":"北京匡时国际拍卖有限公司","data2":"畅怀——古代书法夜场","data3":"2017/6/4"},
{"data1":"北京匡时国际拍卖有限公司","data2":"神工妙造——瓷玉工艺品专场","data3":"2017/6/4"},
{"data1":"北京匡时国际拍卖有限公司","data2":"天工开物——瓷器工艺品精品夜场","data3":"2017/6/4"},
{"data1":"北京匡时国际拍卖有限公司","data2":"田帝玄黄——田黄石专场","data3":"2017/12/3"},
{"data1":"北京匡时国际拍卖有限公司","data2":"田帝玄黄——田黄石专场","data3":"2017/12/3"},
{"data1":"北京匡时国际拍卖有限公司","data2":"天工开物——瓷器工艺品夜场","data3":" 2017/12/3"},
{"data1":"北京匡时国际拍卖有限公司","data2":"田帝玄黄——田黄石专场","data3":" 2017/12/3"},
{"data1":"北京匡时国际拍卖有限公司","data2":"田帝玄黄——田黄石专场","data3":" 2017/12/3"},
{"data1":"北京伍伦国际拍卖有限公司","data2":"写经书画外国手迹专场","data3":"2017/11/15"},
{"data1":"北京印千山国际拍卖有限公司","data2":"潜龙邸——明清家具专场","data3":"2017/7/9"},
{"data1":"广州华艺国际拍卖有限公司","data2":"中国书画","data3":"2017/11/25"},
{"data1":"佳士得伦敦有限公司","data2":"中国瓷器及工艺精品","data3":"2017/5/9"},
{"data1":"佳士得伦敦有限公司","data2":"中国瓷器及工艺精品","data3":"2017/5/9"},
{"data1":"佳士得伦敦有限公司","data2":"中国瓷器及工艺精品","data3":" 2017/5/9"},
{"data1":"佳士得纽约有限公司","data2":"宗器宝绘—藤田美术馆藏中国古代艺术珍品","data3":"2017/3/15"},
{"data1":"佳士得纽约有限公司","data2":"宗器宝绘—藤田美术馆藏中国古代艺术珍品","data3":"2017/3/15"},
{"data1":"佳士得纽约有限公司","data2":"宗器寶繪 ─ 藤田美術館藏中國古代藝術珍品","data3":"2017/3/15"},
{"data1":"佳士得纽约有限公司","data2":"宗器寶繪 ─ 藤田美術館藏中國古代藝術珍品","data3":"2017/3/15"},
{"data1":"佳士得纽约有限公司","data2":"宗器寶繪 ─ 藤田美術館藏中國古代藝術珍品","data3":"2017/3/15"},
{"data1":"佳士得纽约有限公司","data2":"宗器寶繪 ─ 藤田美術館藏中國古代藝術珍品","data3":"2017/3/15"},
{"data1":"佳士得纽约有限公司","data2":"家族遗珍:玛丽·泰瑞莎·L·维勒泰亚洲艺术珍藏","data3":"2017/3/16"},
{"data1":"佳士得纽约有限公司","data2":"家族遗珍:玛丽·泰瑞莎·L·维勒泰亚洲艺术珍藏","data3":"2017/3/16"},
{"data1":"佳士得纽约有限公司","data2":"中国瓷器及工艺精品","data3":"2017/9/14"},
{"data1":"佳士得纽约有限公司","data2":" 宗器宝绘—藤田美术馆藏中国古代艺术珍品","data3":" 2017/3/15"},
{"data1":"佳士得香港有限公司","data2":"融艺/ 亚洲二十世纪及当代艺术(晚间拍卖)","data3":"2017/5/27"},
{"data1":"佳士得香港有限公司","data2":"融艺/ 亚洲二十世纪及当代艺术(晚间拍卖)","data3":"2017/5/27"},
{"data1":"佳士得香港有限公司","data2":"瑰丽珠宝及翡翠首饰","data3":"2017/5/30"},
{"data1":"佳士得香港有限公司","data2":"雍正粉青釉双龙尊","data3":"2017/5/31"},
{"data1":"佳士得香港有限公司","data2":"妙相圆明–佛教艺术精品","data3":"2017/5/31"},
{"data1":"佳士得香港有限公司","data2":"亚洲二十世纪及当代艺术(晚间拍卖)","data3":"2017/11/25"},
{"data1":"佳士得香港有限公司","data2":"瑰丽珠宝及翡翠首饰","data3":"2017/11/28"},
{"data1":"佳士得香港有限公司","data2":"瑰丽珠宝及翡翠首饰","data3":"2017/11/28"},
{"data1":"佳士得香港有限公司","data2":"千秋名韵—孔祥熙家族旧藏傅抱石《琵琶行》","data3":"2017/11/28"},
{"data1":"佳士得香港有限公司","data2":"重要中国瓷器及工艺精品","data3":"2017/11/29"},
{"data1":"佳士得香港有限公司","data2":"养德堂珍藏中国古玉器","data3":"2017/11/29"},
{"data1":"佳士得香港有限公司","data2":"养德堂珍藏中国古玉器","data3":"2017/11/29"},
{"data1":"佳士得香港有限公司","data2":"养德堂珍藏中国古玉器","data3":"2017/11/29"},
{"data1":"佳士得香港有限公司","data2":"重要中国瓷器及工艺精品","data3":"2017/11/29"},
{"data1":"佳士得香港有限公司","data2":"重要中国瓷器及工艺精品","data3":"2017/11/29"},
{"data1":"佳士得香港有限公司","data2":"乐从堂藏明代宫廷珍器晚间拍卖","data3":" 2017/11/27"},
{"data1":"佳士得香港有限公司","data2":"乐从堂藏明代宫廷珍器晚间拍卖","data3":" 2017-11-27"},
{"data1":"羅芙奧股份有限公司","data2":"亚洲现当代艺术专场","data3":"2017/6/4"},
{"data1":"纽约蘇富比有限公司","data2":"明·国风","data3":"2017/3/14"},
{"data1":"上海嘉禾拍卖有限公司","data2":"《禾风》—中国书画夜场","data3":"2017/12/30"},
{"data1":"上海匡时拍卖有限公司","data2":"大器——古代空间夜场","data3":"2017/11/5"},
{"data1":"上海匡时拍卖有限公司","data2":"文玩雅集专场","data3":"2017/11/5"},
{"data1":"苏富比巴黎","data2":"亚洲艺术","data3":"2017/6/22"},
{"data1":"天成国际拍卖有限公司","data2":"珠宝及翡翠","data3":"2017/12/3"},
{"data1":"西泠印社拍卖有限公司","data2":"登昆仑兮—中国首届和田玉籽料原石专场","data3":"2017/7/15"},
{"data1":"西泠印社拍卖有限公司","data2":"南宋宫廷旧藏西周重器国宝兮甲盘专拍暨中国青铜器专场","data3":"2017/7/15"},
{"data1":"西泠印社拍卖有限公司","data2":"中国历代钱币专场","data3":"2017/7/17"},
{"data1":"香港蘇富比拍卖有限公司","data2":"玲珑雅趣:明清掌上御瓷珍翫","data3":"2017/4/5"},
{"data1":"香港蘇富比拍卖有限公司","data2":"轻巧袖珍宝:攻玉山房藏明式家具","data3":"2017/4/5"},
{"data1":"香港蘇富比拍卖有限公司","data2":"鱼豫幽蓝:明宣德青花鱼藻纹十棱菱口大盌","data3":"2017/4/5"},
{"data1":"香港蘇富比拍卖有限公司","data2":"中国艺术珍品","data3":"2017/4/5"},
{"data1":"香港蘇富比拍卖有限公司","data2":"中国艺术珍品","data3":"2017/4/5"},
{"data1":"香港蘇富比拍卖有限公司","data2":"中国艺术珍品","data3":"2017/4/5"},
{"data1":"香港蘇富比拍卖有限公司","data2":"中国艺术珍品","data3":"2017/4/5"},
{"data1":"香港蘇富比拍卖有限公司","data2":"现当代艺术晚间拍卖","data3":"2017/9/30"},
{"data1":"香港蘇富比拍卖有限公司","data2":"现当代艺术晚间拍卖","data3":"2017/9/30"},
{"data1":"香港蘇富比拍卖有限公司","data2":"现当代艺术晚间拍卖","data3":"2017/9/30"},
{"data1":"香港蘇富比拍卖有限公司","data2":"中国古代书画","data3":"2017/10/1"},
{"data1":"香港蘇富比拍卖有限公司","data2":"八宝吉祥 — 仇焱之旧藏明宣德合盌","data3":"2017/10/3"},
{"data1":"香港蘇富比拍卖有限公司","data2":"俊雅清凝 — 乐从堂藏宋瓷粹珍","data3":"2017/10/3"},
{"data1":"香港蘇富比拍卖有限公司","data2":"密慧禅心:菩萨道珍藏及其他佛教艺术精品","data3":"2017/10/3"},
{"data1":"香港蘇富比拍卖有限公司","data2":"中国艺术珍品","data3":"2017/10/3"},
{"data1":"香港蘇富比拍卖有限公司","data2":"中国艺术珍品","data3":"2017/10/3"},
{"data1":"香港蘇富比拍卖有限公司","data2":"粉红之星:大自然的瑰宝","data3":" 2017/4/4"},
{"data1":"香港蘇富比拍卖有限公司","data2":"中国艺术珍品","data3":" 2017/4/5"},
{"data1":"中古陶(北京)拍卖行有限公司","data2":"华廷雅集·一带一路中国瓷器","data3":"2017/12/20"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"大观——中国书画珍品之夜·古代","data3":"2017/6/19"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"大观——中国书画珍品之夜·古代","data3":"2017/6/19"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"大观——中国书画珍品之夜·近现代","data3":"2017/6/19"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"大观——中国书画珍品之夜·近现代","data3":"2017/6/19"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"旃檀林——佛教艺术集萃","data3":"2017/6/20"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"见微知著——金银珍玩","data3":"2017/6/20"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"见微知著——金银珍玩","data3":"2017/6/20"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"见微知著——金银珍玩","data3":"2017/6/20"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"清隽明朗——明清古典家具精品","data3":"2017/6/20"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"古籍善本 金石碑帖","data3":"2017/6/21"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"哲匠斤墨—名家藏明式家具精品及雅玩","data3":"2017/10/2"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"大观——四海崇誉庆典之夜·古代","data3":"2017/12/18"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"大观——四海崇誉庆典之夜·古代","data3":"2017/12/18"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"大观——四海崇誉庆典之夜·古代","data3":"2017/12/18"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"当代艺术夜场","data3":"2017/12/19"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"古籍善本 金石碑帖","data3":"2017/12/20"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"清隽明朗——明清古典家具精品","data3":"2017/12/21"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"玉映壶光——明清玉器鼻烟壶","data3":"2017/12/21"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"清宁——国石篆刻艺术","data3":" 2017/12/20"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"锡文藏泉 古钱 金银币 金银锭","data3":"2017/12/22"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"大观——中国书画珍品之夜·古代","data3":"2017-6-19"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"大观——中国书画珍品之夜·古代","data3":"2017-6-19"},
{"data1":"中贸圣佳国际拍卖有限公司","data2":"璀璨——中国古代艺术珍品及宫廷器物夜场","data3":"2017/6/18"},
{"data1":"中贸圣佳国际拍卖有限公司","data2":"璀璨——中国古代艺术珍品及宫廷器物夜场","data3":"2017/6/18"},
{"data1":"中贸圣佳国际拍卖有限公司","data2":"集萃——古董珍玩","data3":"2017/6/18"},
]
下面是生成SQL语句的代码:
MySQL中使用了 union all ,不会的同学请百度
#-*-coding:utf--*-
from common.contest import *
ccc= [{"data1":"佳士得伦敦有限公司","data2":"中国瓷器及工艺精品","data3":"2017/5/9"},
{"data1":"佳士得香港有限公司","data2":"瑰丽珠宝及翡翠首饰","data3":"2017/11/28"},
{"data1":"邦瀚斯拍卖行","data2":"中国瓷器及工艺精品专场","data3":"2017/11/28"},
{"data1":"保利华谊","data2":"中国书画","data3":"2017/12/8"},
{"data1":"保利香港拍卖有限公司","data2":"璀璨珠宝专场","data3":"2017/4/3"},
{"data1":"保利香港拍卖有限公司","data2":"璀璨珠宝专场","data3":"2017/4/3"},
{"data1":"保利香港拍卖有限公司","data2":"中国及亚洲现当代艺术专场","data3":"2017/4/3"},
{"data1":"保利香港拍卖有限公司","data2":"璀璨珠宝专场","data3":"2017/10/2"},
{"data1":"保利香港拍卖有限公司","data2":"清净广严—重要藏家珍藏永乐宫廷造像","data3":"2017/10/2"},
{"data1":"保利香港拍卖有限公司","data2":"清净广严—重要藏家珍藏永乐宫廷造像","data3":"2017/10/2"},
{"data1":"保利香港拍卖有限公司","data2":"清净广严—重要藏家珍藏永乐宫廷造像","data3":"2017/10/2"},
{"data1":"保利香港拍卖有限公司","data2":"现当代艺术专场","data3":"2017/10/2"},
{"data1":"保利香港拍卖有限公司","data2":"尤伦斯男爵藏中国重要金器专场","data3":"2017/10/2"},
{"data1":"保利香港拍卖有限公司","data2":"璀璨珠宝专场","data3":" 2017/10/2"},
{"data1":"北京保利国际拍卖有限公司","data2":"瓷器 玉器 工艺品(二)","data3":"2017/4/17"},
{"data1":"北京保利国际拍卖有限公司","data2":"中国古代书画夜场","data3":"2017/6/5"},
{"data1":"北京保利国际拍卖有限公司","data2":"中国古代书画夜场","data3":"2017/6/5"},
{"data1":"北京保利国际拍卖有限公司","data2":"中国古代书画夜场","data3":"2017/6/5"},
{"data1":"北京保利国际拍卖有限公司","data2":"中国近现代书画夜场","data3":"2017/6/5"},
{"data1":"北京保利国际拍卖有限公司","data2":"泉韵古今——纸币、机制币、金银锭 王觐彤旧藏古钱","data3":"2017/6/6"},
{"data1":"北京保利国际拍卖有限公司","data2":"自在菩提——中国金铜佛造像、唐卡","data3":"2017/6/7"},
{"data1":"北京保利国际拍卖有限公司","data2":"仰之弥高—中国古代书画夜场","data3":"2017/12/17"},
{"data1":"北京保利国际拍卖有限公司","data2":"震古烁今——从北宋到当代的中国书画","data3":"2017/12/17"},
{"data1":"北京保利国际拍卖有限公司","data2":"震古烁今——从北宋到当代的中国书画","data3":"2017/12/17"},
{"data1":"北京保利国际拍卖有限公司","data2":"震古烁今——从北宋到当代的中国书画","data3":"2017/12/17"},
{"data1":"北京保利国际拍卖有限公司","data2":"中国近现代书画夜场","data3":"2017/12/17"},
{"data1":"北京保利国际拍卖有限公司","data2":"中国近现代书画夜场","data3":"2017/12/17"},
{"data1":"北京保利国际拍卖有限公司","data2":"瑰映如茵Ⅱ——玫茵堂暨欧美名藏盛清五朝御窑隽品","data3":"2017/12/18"},
{"data1":"北京保利国际拍卖有限公司","data2":"佞宋——宋元巷陌间的“色·声·香·味·触”","data3":"2017/12/18"},
{"data1":"北京保利国际拍卖有限公司","data2":"禹贡(二)——康熙御制黄花梨大四件柜 唐英督陶与大清的辉煌时刻","data3":"2017/12/18"},
{"data1":"北京保利国际拍卖有限公司","data2":"禹贡(二)——康熙御制黄花梨大四件柜 唐英督陶与大清的辉煌时刻","data3":"2017/12/18"},
{"data1":"北京保利国际拍卖有限公司","data2":"禹贡(二)——康熙御制黄花梨大四件柜 唐英督陶与大清的辉煌时刻","data3":"2017/12/18"},
{"data1":"北京保利国际拍卖有限公司","data2":"禹贡(二)——康熙御制黄花梨大四件柜 唐英督陶与大清的辉煌时刻","data3":"2017/12/18"},
{"data1":"北京保利国际拍卖有限公司","data2":"方寸聚九州——邮品专场","data3":"2017/12/22"},
{"data1":"北京保利国际拍卖有限公司","data2":"方寸聚九州——名家旧藏华东解放区专场","data3":"2017/12/23"},
{"data1":"北京保利国际拍卖有限公司","data2":"禹贡——敬勝怠者吉 古董珍玩之夜","data3":" 2017/6/6"},
{"data1":"北京诚轩拍卖有限公司","data2":"古钱 银锭 机制币","data3":"2017/12/20"},
{"data1":"北京诚轩拍卖有限公司","data2":"古钱 银锭 机制币","data3":"2017/12/20"},
{"data1":"北京诚轩拍卖有限公司","data2":"古钱 银锭 机制币","data3":" 2017/12/20"},
{"data1":"北京诚轩拍卖有限公司","data2":"古钱 银锭 机制币","data3":" 2017-6-21"},
{"data1":"北京东正拍卖有限公司","data2":"皇家长物","data3":"2017/6/8"},
{"data1":"北京东正拍卖有限公司","data2":"乾坤荟萃—旦暮清供","data3":"2017/6/8"},
{"data1":"北京东正拍卖有限公司","data2":"皇家长物","data3":"2017/12/9"},
{"data1":"北京华辰拍卖有限公司","data2":"瓷器玉器工艺品","data3":"2017/12/17"},
{"data1":"北京匡时国际拍卖有限公司","data2":"畅怀——古代书法夜场","data3":"2017/6/4"},
{"data1":"北京匡时国际拍卖有限公司","data2":"神工妙造——瓷玉工艺品专场","data3":"2017/6/4"},
{"data1":"北京匡时国际拍卖有限公司","data2":"天工开物——瓷器工艺品精品夜场","data3":"2017/6/4"},
{"data1":"北京匡时国际拍卖有限公司","data2":"田帝玄黄——田黄石专场","data3":"2017/12/3"},
{"data1":"北京匡时国际拍卖有限公司","data2":"田帝玄黄——田黄石专场","data3":"2017/12/3"},
{"data1":"北京匡时国际拍卖有限公司","data2":"天工开物——瓷器工艺品夜场","data3":" 2017/12/3"},
{"data1":"北京匡时国际拍卖有限公司","data2":"田帝玄黄——田黄石专场","data3":" 2017/12/3"},
{"data1":"北京匡时国际拍卖有限公司","data2":"田帝玄黄——田黄石专场","data3":" 2017/12/3"},
{"data1":"北京伍伦国际拍卖有限公司","data2":"写经书画外国手迹专场","data3":"2017/11/15"},
{"data1":"北京印千山国际拍卖有限公司","data2":"潜龙邸——明清家具专场","data3":"2017/7/9"},
{"data1":"广州华艺国际拍卖有限公司","data2":"中国书画","data3":"2017/11/25"},
{"data1":"佳士得伦敦有限公司","data2":"中国瓷器及工艺精品","data3":"2017/5/9"},
{"data1":"佳士得伦敦有限公司","data2":"中国瓷器及工艺精品","data3":"2017/5/9"},
{"data1":"佳士得伦敦有限公司","data2":"中国瓷器及工艺精品","data3":" 2017/5/9"},
{"data1":"佳士得纽约有限公司","data2":"宗器宝绘—藤田美术馆藏中国古代艺术珍品","data3":"2017/3/15"},
{"data1":"佳士得纽约有限公司","data2":"宗器宝绘—藤田美术馆藏中国古代艺术珍品","data3":"2017/3/15"},
{"data1":"佳士得纽约有限公司","data2":"宗器寶繪 ─ 藤田美術館藏中國古代藝術珍品","data3":"2017/3/15"},
{"data1":"佳士得纽约有限公司","data2":"宗器寶繪 ─ 藤田美術館藏中國古代藝術珍品","data3":"2017/3/15"},
{"data1":"佳士得纽约有限公司","data2":"宗器寶繪 ─ 藤田美術館藏中國古代藝術珍品","data3":"2017/3/15"},
{"data1":"佳士得纽约有限公司","data2":"宗器寶繪 ─ 藤田美術館藏中國古代藝術珍品","data3":"2017/3/15"},
{"data1":"佳士得纽约有限公司","data2":"家族遗珍:玛丽·泰瑞莎·L·维勒泰亚洲艺术珍藏","data3":"2017/3/16"},
{"data1":"佳士得纽约有限公司","data2":"家族遗珍:玛丽·泰瑞莎·L·维勒泰亚洲艺术珍藏","data3":"2017/3/16"},
{"data1":"佳士得纽约有限公司","data2":"中国瓷器及工艺精品","data3":"2017/9/14"},
{"data1":"佳士得纽约有限公司","data2":" 宗器宝绘—藤田美术馆藏中国古代艺术珍品","data3":" 2017/3/15"},
{"data1":"佳士得香港有限公司","data2":"融艺/ 亚洲二十世纪及当代艺术(晚间拍卖)","data3":"2017/5/27"},
{"data1":"佳士得香港有限公司","data2":"融艺/ 亚洲二十世纪及当代艺术(晚间拍卖)","data3":"2017/5/27"},
{"data1":"佳士得香港有限公司","data2":"瑰丽珠宝及翡翠首饰","data3":"2017/5/30"},
{"data1":"佳士得香港有限公司","data2":"雍正粉青釉双龙尊","data3":"2017/5/31"},
{"data1":"佳士得香港有限公司","data2":"妙相圆明–佛教艺术精品","data3":"2017/5/31"},
{"data1":"佳士得香港有限公司","data2":"亚洲二十世纪及当代艺术(晚间拍卖)","data3":"2017/11/25"},
{"data1":"佳士得香港有限公司","data2":"瑰丽珠宝及翡翠首饰","data3":"2017/11/28"},
{"data1":"佳士得香港有限公司","data2":"瑰丽珠宝及翡翠首饰","data3":"2017/11/28"},
{"data1":"佳士得香港有限公司","data2":"千秋名韵—孔祥熙家族旧藏傅抱石《琵琶行》","data3":"2017/11/28"},
{"data1":"佳士得香港有限公司","data2":"重要中国瓷器及工艺精品","data3":"2017/11/29"},
{"data1":"佳士得香港有限公司","data2":"养德堂珍藏中国古玉器","data3":"2017/11/29"},
{"data1":"佳士得香港有限公司","data2":"养德堂珍藏中国古玉器","data3":"2017/11/29"},
{"data1":"佳士得香港有限公司","data2":"养德堂珍藏中国古玉器","data3":"2017/11/29"},
{"data1":"佳士得香港有限公司","data2":"重要中国瓷器及工艺精品","data3":"2017/11/29"},
{"data1":"佳士得香港有限公司","data2":"重要中国瓷器及工艺精品","data3":"2017/11/29"},
{"data1":"佳士得香港有限公司","data2":"乐从堂藏明代宫廷珍器晚间拍卖","data3":" 2017/11/27"},
{"data1":"佳士得香港有限公司","data2":"乐从堂藏明代宫廷珍器晚间拍卖","data3":" 2017-11-27"},
{"data1":"羅芙奧股份有限公司","data2":"亚洲现当代艺术专场","data3":"2017/6/4"},
{"data1":"纽约蘇富比有限公司","data2":"明·国风","data3":"2017/3/14"},
{"data1":"上海嘉禾拍卖有限公司","data2":"《禾风》—中国书画夜场","data3":"2017/12/30"},
{"data1":"上海匡时拍卖有限公司","data2":"大器——古代空间夜场","data3":"2017/11/5"},
{"data1":"上海匡时拍卖有限公司","data2":"文玩雅集专场","data3":"2017/11/5"},
{"data1":"苏富比巴黎","data2":"亚洲艺术","data3":"2017/6/22"},
{"data1":"天成国际拍卖有限公司","data2":"珠宝及翡翠","data3":"2017/12/3"},
{"data1":"西泠印社拍卖有限公司","data2":"登昆仑兮—中国首届和田玉籽料原石专场","data3":"2017/7/15"},
{"data1":"西泠印社拍卖有限公司","data2":"南宋宫廷旧藏西周重器国宝兮甲盘专拍暨中国青铜器专场","data3":"2017/7/15"},
{"data1":"西泠印社拍卖有限公司","data2":"中国历代钱币专场","data3":"2017/7/17"},
{"data1":"香港蘇富比拍卖有限公司","data2":"玲珑雅趣:明清掌上御瓷珍翫","data3":"2017/4/5"},
{"data1":"香港蘇富比拍卖有限公司","data2":"轻巧袖珍宝:攻玉山房藏明式家具","data3":"2017/4/5"},
{"data1":"香港蘇富比拍卖有限公司","data2":"鱼豫幽蓝:明宣德青花鱼藻纹十棱菱口大盌","data3":"2017/4/5"},
{"data1":"香港蘇富比拍卖有限公司","data2":"中国艺术珍品","data3":"2017/4/5"},
{"data1":"香港蘇富比拍卖有限公司","data2":"中国艺术珍品","data3":"2017/4/5"},
{"data1":"香港蘇富比拍卖有限公司","data2":"中国艺术珍品","data3":"2017/4/5"},
{"data1":"香港蘇富比拍卖有限公司","data2":"中国艺术珍品","data3":"2017/4/5"},
{"data1":"香港蘇富比拍卖有限公司","data2":"现当代艺术晚间拍卖","data3":"2017/9/30"},
{"data1":"香港蘇富比拍卖有限公司","data2":"现当代艺术晚间拍卖","data3":"2017/9/30"},
{"data1":"香港蘇富比拍卖有限公司","data2":"现当代艺术晚间拍卖","data3":"2017/9/30"},
{"data1":"香港蘇富比拍卖有限公司","data2":"中国古代书画","data3":"2017/10/1"},
{"data1":"香港蘇富比拍卖有限公司","data2":"八宝吉祥 — 仇焱之旧藏明宣德合盌","data3":"2017/10/3"},
{"data1":"香港蘇富比拍卖有限公司","data2":"俊雅清凝 — 乐从堂藏宋瓷粹珍","data3":"2017/10/3"},
{"data1":"香港蘇富比拍卖有限公司","data2":"密慧禅心:菩萨道珍藏及其他佛教艺术精品","data3":"2017/10/3"},
{"data1":"香港蘇富比拍卖有限公司","data2":"中国艺术珍品","data3":"2017/10/3"},
{"data1":"香港蘇富比拍卖有限公司","data2":"中国艺术珍品","data3":"2017/10/3"},
{"data1":"香港蘇富比拍卖有限公司","data2":"粉红之星:大自然的瑰宝","data3":" 2017/4/4"},
{"data1":"香港蘇富比拍卖有限公司","data2":"中国艺术珍品","data3":" 2017/4/5"},
{"data1":"中古陶(北京)拍卖行有限公司","data2":"华廷雅集·一带一路中国瓷器","data3":"2017/12/20"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"大观——中国书画珍品之夜·古代","data3":"2017/6/19"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"大观——中国书画珍品之夜·古代","data3":"2017/6/19"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"大观——中国书画珍品之夜·近现代","data3":"2017/6/19"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"大观——中国书画珍品之夜·近现代","data3":"2017/6/19"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"旃檀林——佛教艺术集萃","data3":"2017/6/20"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"见微知著——金银珍玩","data3":"2017/6/20"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"见微知著——金银珍玩","data3":"2017/6/20"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"见微知著——金银珍玩","data3":"2017/6/20"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"清隽明朗——明清古典家具精品","data3":"2017/6/20"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"古籍善本 金石碑帖","data3":"2017/6/21"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"哲匠斤墨—名家藏明式家具精品及雅玩","data3":"2017/10/2"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"大观——四海崇誉庆典之夜·古代","data3":"2017/12/18"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"大观——四海崇誉庆典之夜·古代","data3":"2017/12/18"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"大观——四海崇誉庆典之夜·古代","data3":"2017/12/18"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"当代艺术夜场","data3":"2017/12/19"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"古籍善本 金石碑帖","data3":"2017/12/20"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"清隽明朗——明清古典家具精品","data3":"2017/12/21"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"玉映壶光——明清玉器鼻烟壶","data3":"2017/12/21"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"清宁——国石篆刻艺术","data3":" 2017/12/20"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"锡文藏泉 古钱 金银币 金银锭","data3":"2017/12/22"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"大观——中国书画珍品之夜·古代","data3":"2017-6-19"},
{"data1":"中国嘉德国际拍卖有限公司","data2":"大观——中国书画珍品之夜·古代","data3":"2017-6-19"},
{"data1":"中贸圣佳国际拍卖有限公司","data2":"璀璨——中国古代艺术珍品及宫廷器物夜场","data3":"2017/6/18"},
{"data1":"中贸圣佳国际拍卖有限公司","data2":"璀璨——中国古代艺术珍品及宫廷器物夜场","data3":"2017/6/18"},
{"data1":"中贸圣佳国际拍卖有限公司","data2":"集萃——古董珍玩","data3":"2017/6/18"},
]
sql_list = []
for item in ccc:
aucr_name_spider = item['data1']
session_name = item['data2']
item_auct_time = item['data3']
item_auct_time = item_auct_time.replace('-','/').replace(' ','')
item_auct_time_list = item_auct_time.split('/')
item_auct_time_year = item_auct_time_list[]
item_auct_time_month = item_auct_time_list[]
item_auct_time_day = item_auct_time_list[]
if int(item_auct_time_month)< :
item_auct_time_month = ""+ item_auct_time_month
if int(item_auct_time_day)<:
item_auct_time_day = ""+ item_auct_time_day
auct_time = item_auct_time_year + item_auct_time_month + item_auct_time_day
if int(auct_time) >=:
#核心代码
sql = "SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "+ "\"" + auct_time + "\""
+" AND aucr_name_spider =" + '\"' + aucr_name_spider + '"' +" and session_name =" + '\"'+ session_name + '\"' + " union all"
sql_list.append(sql)
result = set(sql_list)
print result
输出结果是:
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="中国嘉德国际拍卖有限公司" and session_name ="哲匠斤墨—名家藏明式家具精品及雅玩" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="北京伍伦国际拍卖有限公司" and session_name ="写经书画外国手迹专场" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="保利香港拍卖有限公司" and session_name ="璀璨珠宝专场" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="北京华辰拍卖有限公司" and session_name ="瓷器玉器工艺品" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="保利香港拍卖有限公司" and session_name ="尤伦斯男爵藏中国重要金器专场" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="佳士得香港有限公司" and session_name ="乐从堂藏明代宫廷珍器晚间拍卖" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="北京保利国际拍卖有限公司" and session_name ="佞宋——宋元巷陌间的“色·声·香·味·触”" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="北京保利国际拍卖有限公司" and session_name ="中国近现代书画夜场" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="北京保利国际拍卖有限公司" and session_name ="方寸聚九州——名家旧藏华东解放区专场" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="西泠印社拍卖有限公司" and session_name ="南宋宫廷旧藏西周重器国宝兮甲盘专拍暨中国青铜器专场" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="佳士得香港有限公司" and session_name ="重要中国瓷器及工艺精品" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="北京诚轩拍卖有限公司" and session_name ="古钱 银锭 机制币" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="佳士得香港有限公司" and session_name ="瑰丽珠宝及翡翠首饰" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="北京保利国际拍卖有限公司" and session_name ="禹贡(二)——康熙御制黄花梨大四件柜 唐英督陶与大清的辉煌时刻" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="北京匡时国际拍卖有限公司" and session_name ="天工开物——瓷器工艺品夜场" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="西泠印社拍卖有限公司" and session_name ="登昆仑兮—中国首届和田玉籽料原石专场" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="中国嘉德国际拍卖有限公司" and session_name ="古籍善本 金石碑帖" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="香港蘇富比拍卖有限公司" and session_name ="中国古代书画" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="上海匡时拍卖有限公司" and session_name ="大器——古代空间夜场" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="中国嘉德国际拍卖有限公司" and session_name ="清隽明朗——明清古典家具精品" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="北京保利国际拍卖有限公司" and session_name ="仰之弥高—中国古代书画夜场" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="佳士得香港有限公司" and session_name ="养德堂珍藏中国古玉器" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="保利香港拍卖有限公司" and session_name ="现当代艺术专场" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="香港蘇富比拍卖有限公司" and session_name ="俊雅清凝 — 乐从堂藏宋瓷粹珍" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="佳士得香港有限公司" and session_name ="亚洲二十世纪及当代艺术(晚间拍卖)" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="中国嘉德国际拍卖有限公司" and session_name ="玉映壶光——明清玉器鼻烟壶" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="天成国际拍卖有限公司" and session_name ="珠宝及翡翠" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="广州华艺国际拍卖有限公司" and session_name ="中国书画" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="北京匡时国际拍卖有限公司" and session_name ="田帝玄黄——田黄石专场" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="北京印千山国际拍卖有限公司" and session_name ="潜龙邸——明清家具专场" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="中国嘉德国际拍卖有限公司" and session_name ="当代艺术夜场" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="香港蘇富比拍卖有限公司" and session_name ="八宝吉祥 — 仇焱之旧藏明宣德合盌" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="北京保利国际拍卖有限公司" and session_name ="方寸聚九州——邮品专场" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="佳士得香港有限公司" and session_name ="千秋名韵—孔祥熙家族旧藏傅抱石《琵琶行》" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="香港蘇富比拍卖有限公司" and session_name ="中国艺术珍品" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="北京保利国际拍卖有限公司" and session_name ="震古烁今——从北宋到当代的中国书画" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="佳士得纽约有限公司" and session_name ="中国瓷器及工艺精品" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="保利香港拍卖有限公司" and session_name ="清净广严—重要藏家珍藏永乐宫廷造像" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="北京东正拍卖有限公司" and session_name ="皇家长物" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="北京保利国际拍卖有限公司" and session_name ="瑰映如茵Ⅱ——玫茵堂暨欧美名藏盛清五朝御窑隽品" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="西泠印社拍卖有限公司" and session_name ="中国历代钱币专场" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="中国嘉德国际拍卖有限公司" and session_name ="大观——四海崇誉庆典之夜·古代" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="邦瀚斯拍卖行" and session_name ="中国瓷器及工艺精品专场" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="中古陶(北京)拍卖行有限公司" and session_name ="华廷雅集·一带一路中国瓷器" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="香港蘇富比拍卖有限公司" and session_name ="现当代艺术晚间拍卖" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="香港蘇富比拍卖有限公司" and session_name ="密慧禅心:菩萨道珍藏及其他佛教艺术精品" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="中国嘉德国际拍卖有限公司" and session_name ="清宁——国石篆刻艺术" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="上海匡时拍卖有限公司" and session_name ="文玩雅集专场" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="中国嘉德国际拍卖有限公司" and session_name ="锡文藏泉 古钱 金银币 金银锭" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="上海嘉禾拍卖有限公司" and session_name ="《禾风》—中国书画夜场" union all
SELECT * FROM `guonei_artron_items_core__qingxi` WHERE item_auct_time = "" AND aucr_name_spider ="保利华谊" and session_name ="中国书画" union all
51
解决问题并不重要,重要的是解决问题的思路。
Python 爬虫 数据提取的更多相关文章
- Python——爬虫——数据提取
一.XML数据提取 (1)定义:XML指可扩展标记语言.标记语言,标签需要我们自行定义 (2)设计宗旨:是传输数据,而非显示数据,具有自我描述性 (3)节点关系: 父:每个元素及属性都有一个父. ...
- python爬虫数据提取之bs4的使用方法
Beautiful Soup的使用 1.下载 pip install bs4 pip install lxml # 解析器 官方推荐 2.引用方法 from bs4 import BeautifulS ...
- python爬虫+数据可视化项目(关注、持续更新)
python爬虫+数据可视化项目(一) 爬取目标:中国天气网(起始url:http://www.weather.com.cn/textFC/hb.shtml#) 爬取内容:全国实时温度最低的十个城市气 ...
- python 爬虫数据存入csv格式方法
python 爬虫数据存入csv格式方法 命令存储方式:scrapy crawl ju -o ju.csv 第一种方法:with open("F:/book_top250.csv" ...
- python爬虫数据解析之BeautifulSoup
BeautifulSoup是一个可以从HTML或者XML文件中提取数据的python库.它能够通过你喜欢的转换器实现惯用的文档导航,查找,修改文档的方式. BeautfulSoup是python爬虫三 ...
- python爬虫--数据解析
数据解析 什么是数据解析及作用 概念:就是将一组数据中的局部数据进行提取 作用:来实现聚焦爬虫 数据解析的通用原理 标签定位 取文本或者属性 正则解析 正则回顾 单字符: . : 除换行以外所有字符 ...
- python爬虫数据解析之正则表达式
爬虫的一般分为四步,第二个步骤就是对爬取的数据进行解析. python爬虫一般使用三种解析方式,一正则表达式,二xpath,三BeautifulSoup. 这篇博客主要记录下正则表达式的使用. 正则表 ...
- 【学习】Python进行数据提取的方法总结【转载】
链接:http://www.jb51.net/article/90946.htm 数据提取是分析师日常工作中经常遇到的需求.如某个用户的贷款金额,某个月或季度的利息总收入,某个特定时间段的贷款金额和笔 ...
- 爬虫数据提取之JSON与JsonPATH
数据提取之JSON与JsonPATH JSON(JavaScript Object Notation) 是一种轻量级的数据交换格式,它使得人们很容易的进行阅读和编写.同时也方便了机器进行解析和生成.适 ...
随机推荐
- RPC框架研究(二)Hadoop源代码-1
报名了阿里中间件性能大赛,我来说是一个全新的挑战.一切从空白学起,比赛的过程也是学习的过程 是的.想让自己学好.给自己报一个比赛吧~ 就像当初学围棋,也是报了围棋比赛,为了不至于输的太慘.一个星期里学 ...
- 如何使用SubtitleWorkshop制作字幕
任意打开一段字幕文件 对于初学者而言还是最好打开一个带有中英字幕的视频文件(字幕是嵌入在视频文件里面的)然后一句一句照着写 先打开视频预览模式 再打开一段视频文件,并新建一个字幕文件 牢记几个快捷键 ...
- oracle错误处理之ORA-00054:资源正忙,要求指定NOWAIT
查询所有会话 select t2.username, t2.sid, t2.serial#, t2.logon_time from v$locked_object t1, v$session t2 w ...
- css中url的路径含义及使用
http://www.jb51.net/css/37554.html 在CSS中有用url语法来指定background-image或是其他引用文件中,如: 复制代码 代码如下: .mainheade ...
- listView.getChildAt(i)时java.lang.NullPointerException
BaseAdapter返回的是当前屏幕所能显示Item条数的组件,所以通过listView.getChildAt(i); 返回的是当前屏幕所能显示的组件.不能通过listView.getChildAt ...
- 1z0-052 q209_8
8: Note the following structures in your database server: 1. Extents 2. OS Blocks 3. Tablespace 4. S ...
- 剑指offer(2) - 二维数组中的查找
题目: 在一个二维数组中.每一行都依照从左到右递增的顺序排序,每一列都依照从上往下递增的顺序排序.请写一个函数,输入一个二维数组和一个整数,推断数组中是否含有该整数. 比如以下的二维数组就是每行.每列 ...
- 【shell】正则表达式
当一个文件或命令输出中抽取或过滤文本时,可以使用正则表达式(RE),正则表达式是一些特殊或很不特殊的字符串模式的集合. 在Linux中grep.awk.sed均可解释正则 1.基本元字符集及其定义 ^ ...
- jQuery仿天猫完美加入购物车
转载自:http://www.iteye.com/topic/1138064 <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transiti ...
- php 5.3新特性
1.命名空间 解决了类,函数和常量名冲突的问题 2.静态绑定 继承时父类可以直接调用子类重写父类的方法 class A { public static function who() { echo __ ...