pandas分组聚合案例

美国2012年总统候选人政治献金数据分析

导入包

import numpy as np

import pandas as pd

from pandas import Series,DataFrame

方便操作，将月份和参选人以及所在政党进行定义

months = {'JAN' : 1, 'FEB' : 2, 'MAR' : 3, 'APR' : 4, 'MAY' : 5, 'JUN' : 6,

          'JUL' : 7, 'AUG' : 8, 'SEP' : 9, 'OCT': 10, 'NOV': 11, 'DEC' : 12}

of_interest = ['Obama, Barack', 'Romney, Mitt', 'Santorum, Rick',

               'Paul, Ron', 'Gingrich, Newt']

parties = {

  'Bachmann, Michelle': 'Republican',

  'Romney, Mitt': 'Republican',

  'Obama, Barack': 'Democrat',

  "Roemer, Charles E. 'Buddy' III": 'Reform',

  'Pawlenty, Timothy': 'Republican',

  'Johnson, Gary Earl': 'Libertarian',

  'Paul, Ron': 'Republican',

  'Santorum, Rick': 'Republican',

  'Cain, Herman': 'Republican',

  'Gingrich, Newt': 'Republican',

  'McCotter, Thaddeus G': 'Republican',

  'Huntsman, Jon': 'Republican',

  'Perry, Rick': 'Republican'

 }

df = pd.read_csv('./data/usa_election.txt')

df.head()

C:\anaconda3\lib\site-packages\IPython\core\interactiveshell.py:2728: DtypeWarning: Columns (6) have mixed types. Specify dtype option on import or set low_memory=False.

  interactivity=interactivity, compiler=compiler, result=result)

.dataframe tbody tr th:only-of-type {
vertical-align: middle;
}

.dataframe tbody tr th {

    vertical-align: top;

}

.dataframe thead th {

    text-align: right;

}

	cmte_id	cand_id	cand_nm	contbr_nm	contbr_city	contbr_st	contbr_zip	contbr_employer	contbr_occupation	contb_receipt_amt	contb_receipt_dt	receipt_desc	memo_cd	memo_text	form_tp	file_num
0	C00410118	P20002978	Bachmann, Michelle	HARVEY, WILLIAM	MOBILE	AL	3.6601e+08	RETIRED	RETIRED	250.0	20-JUN-11	NaN	NaN	NaN	SA17A	736166
1	C00410118	P20002978	Bachmann, Michelle	HARVEY, WILLIAM	MOBILE	AL	3.6601e+08	RETIRED	RETIRED	50.0	23-JUN-11	NaN	NaN	NaN	SA17A	736166
2	C00410118	P20002978	Bachmann, Michelle	SMITH, LANIER	LANETT	AL	3.68633e+08	INFORMATION REQUESTED	INFORMATION REQUESTED	250.0	05-JUL-11	NaN	NaN	NaN	SA17A	749073
3	C00410118	P20002978	Bachmann, Michelle	BLEVINS, DARONDA	PIGGOTT	AR	7.24548e+08	NONE	RETIRED	250.0	01-AUG-11	NaN	NaN	NaN	SA17A	749073
4	C00410118	P20002978	Bachmann, Michelle	WARDENBURG, HAROLD	HOT SPRINGS NATION	AR	7.19016e+08	NONE	RETIRED	300.0	20-JUN-11	NaN	NaN	NaN	SA17A	736166

# 新建一列各个候选人所在党派party

df['party'] = df['cand_nm'].map(parties)

df.head()

.dataframe tbody tr th:only-of-type {
vertical-align: middle;
}

.dataframe tbody tr th {

    vertical-align: top;

}

.dataframe thead th {

    text-align: right;

}

	cmte_id	cand_id	cand_nm	contbr_nm	contbr_city	contbr_st	contbr_zip	contbr_employer	contbr_occupation	contb_receipt_amt	contb_receipt_dt	receipt_desc	memo_cd	memo_text	form_tp	file_num	party
0	C00410118	P20002978	Bachmann, Michelle	HARVEY, WILLIAM	MOBILE	AL	3.6601e+08	RETIRED	RETIRED	250.0	20-JUN-11	NaN	NaN	NaN	SA17A	736166	Republican
1	C00410118	P20002978	Bachmann, Michelle	HARVEY, WILLIAM	MOBILE	AL	3.6601e+08	RETIRED	RETIRED	50.0	23-JUN-11	NaN	NaN	NaN	SA17A	736166	Republican
2	C00410118	P20002978	Bachmann, Michelle	SMITH, LANIER	LANETT	AL	3.68633e+08	INFORMATION REQUESTED	INFORMATION REQUESTED	250.0	05-JUL-11	NaN	NaN	NaN	SA17A	749073	Republican
3	C00410118	P20002978	Bachmann, Michelle	BLEVINS, DARONDA	PIGGOTT	AR	7.24548e+08	NONE	RETIRED	250.0	01-AUG-11	NaN	NaN	NaN	SA17A	749073	Republican
4	C00410118	P20002978	Bachmann, Michelle	WARDENBURG, HAROLD	HOT SPRINGS NATION	AR	7.19016e+08	NONE	RETIRED	300.0	20-JUN-11	NaN	NaN	NaN	SA17A	736166	Republican

# party这一列中有哪些元素

df['party'].unique()

array(['Republican', 'Democrat', 'Reform', 'Libertarian'], dtype=object)

# 统计party列中各个元素出现次数

df['party'].value_counts()

Democrat       292400

Republican     237575

Reform           5364

Libertarian       702

Name: party, dtype: int64

# 查看各个党派收到的政治献金总数contb_receipt_amt

df.groupby(by='party')['contb_receipt_amt'].sum()

party

Democrat       8.105758e+07

Libertarian    4.132769e+05

Reform         3.390338e+05

Republican     1.192255e+08

Name: contb_receipt_amt, dtype: float64

# 查看每天各个党派收到的政治献金总数contb_receipt_amt

df.groupby(by=['contb_receipt_dt','party'])['contb_receipt_amt'].sum()

contb_receipt_dt  party

01-APR-11         Reform              50.00

                  Republican       12635.00

01-AUG-11         Democrat        175281.00

                  Libertarian       1000.00

                  Reform            1847.00

                  Republican      234598.46

01-DEC-11         Democrat        651532.82

                  Libertarian        725.00

                  Reform             875.00

                  Republican      486405.96

01-FEB-11         Republican         250.00

01-JAN-11         Republican        8600.00

01-JAN-12         Democrat         58098.80

                  Reform             515.00

                  Republican       75704.72

01-JUL-11         Democrat        165961.00

                  Libertarian       2000.00

                  Reform             100.00

                  Republican      115848.72

01-JUN-11         Democrat        145459.00

                  Libertarian        500.00

                  Reform              50.00

                  Republican      433109.20

01-MAR-11         Republican        1000.00

01-MAY-11         Democrat         82644.00

                  Reform             480.00

                  Republican       28663.87

01-NOV-11         Democrat        122529.87

                  Libertarian       3000.00

                  Reform            1792.00

                                    ...

30-OCT-11         Reform            3910.00

                  Republican       43913.16

30-SEP-11         Democrat       3373517.24

                  Libertarian        550.00

                  Reform            2050.00

                  Republican     4886331.76

31-AUG-11         Democrat        374387.44

                  Libertarian      10750.00

                  Reform             450.00

                  Republican     1017735.02

31-DEC-11         Democrat       3553072.57

                  Reform             695.00

                  Republican     1094376.72

31-JAN-11         Republican        6000.00

31-JAN-12         Democrat       1418410.31

                  Reform             150.00

                  Republican      869890.41

31-JUL-11         Democrat         20305.00

                  Reform             966.00

                  Republican       12781.02

31-MAR-11         Reform             200.00

                  Republican       62475.00

31-MAY-11         Democrat        351705.66

                  Libertarian        250.00

                  Reform             100.00

                  Republican      301339.80

31-OCT-11         Democrat        204996.87

                  Libertarian       4250.00

                  Reform            3105.00

                  Republican      734601.83

Name: contb_receipt_amt, Length: 1183, dtype: float64

# 将表中日期格式转换为'yyyy-mm-dd'  day-m-y

def transformDate(d):

    day,month,year = d.split('-')

    month = months[month]

    return '20'+year+'-'+str(month)+'-'+day

df['contb_receipt_dt'] = df['contb_receipt_dt'].apply(transformDate)

df.head()

.dataframe tbody tr th:only-of-type {
vertical-align: middle;
}

.dataframe tbody tr th {

    vertical-align: top;

}

.dataframe thead th {

    text-align: right;

}

	cmte_id	cand_id	cand_nm	contbr_nm	contbr_city	contbr_st	contbr_zip	contbr_employer	contbr_occupation	contb_receipt_amt	contb_receipt_dt	receipt_desc	memo_cd	memo_text	form_tp	file_num	party
0	C00410118	P20002978	Bachmann, Michelle	HARVEY, WILLIAM	MOBILE	AL	3.6601e+08	RETIRED	RETIRED	250.0	2011-6-20	NaN	NaN	NaN	SA17A	736166	Republican
1	C00410118	P20002978	Bachmann, Michelle	HARVEY, WILLIAM	MOBILE	AL	3.6601e+08	RETIRED	RETIRED	50.0	2011-6-23	NaN	NaN	NaN	SA17A	736166	Republican
2	C00410118	P20002978	Bachmann, Michelle	SMITH, LANIER	LANETT	AL	3.68633e+08	INFORMATION REQUESTED	INFORMATION REQUESTED	250.0	2011-7-05	NaN	NaN	NaN	SA17A	749073	Republican
3	C00410118	P20002978	Bachmann, Michelle	BLEVINS, DARONDA	PIGGOTT	AR	7.24548e+08	NONE	RETIRED	250.0	2011-8-01	NaN	NaN	NaN	SA17A	749073	Republican
4	C00410118	P20002978	Bachmann, Michelle	WARDENBURG, HAROLD	HOT SPRINGS NATION	AR	7.19016e+08	NONE	RETIRED	300.0	2011-6-20	NaN	NaN	NaN	SA17A	736166	Republican

# 查看老兵(捐献者职业)主要支持谁  ：查看老兵们捐赠给谁的钱最多

# 1.将老兵对应的行数据取出

df['contbr_occupation'] == 'DISABLED VETERAN'

old_bing = df.loc[df['contbr_occupation'] == 'DISABLED VETERAN']

# 2.根据候选人分组

old_bing.groupby(by='cand_nm')['contb_receipt_amt'].sum()

cand_nm

Cain, Herman       300.00

Obama, Barack     4205.00

Paul, Ron         2425.49

Santorum, Rick     250.00

Name: contb_receipt_amt, dtype: float64

df['contb_receipt_amt'].max()

1944042.43

#捐赠金额最大的人的职业以及捐献额  .通过query("查询条件来查找捐献人职业")

df.query('contb_receipt_amt == 1944042.43')

.dataframe tbody tr th:only-of-type {
vertical-align: middle;
}

.dataframe tbody tr th {

    vertical-align: top;

}

.dataframe thead th {

    text-align: right;

}

	cmte_id	cand_id	cand_nm	contbr_nm	contbr_city	contbr_st	contbr_zip	contbr_employer	contbr_occupation	contb_receipt_amt	contb_receipt_dt	receipt_desc	memo_cd	memo_text	form_tp	file_num	party
176127	C00431445	P80003338	Obama, Barack	OBAMA VICTORY FUND 2012 - UNITEMIZED	CHICAGO	IL	60680	NaN	NaN	1944042.43	2011-12-31	NaN	X	*	SA18	763233	Democrat

pandas分组聚合案例的更多相关文章

Pandas 分组聚合
# 导入相关库 import numpy as np import pandas as pd 创建数据 index = pd.Index(data=["Tom", "Bo ...
Python Pandas分组聚合
Pycharm 鼠标移动到函数上,CTRL+Q可以快速查看文档,CTR+P可以看基本的参数. apply(),applymap()和map() apply()和applymap()是DataFrame ...
Pandas 分组聚合：分组、分组对象操作
1.概述 1.1 group语法 df.groupby(self, by=None, axis=0, level=None, as_index: bool=True, sort: bool=True, ...
DataAnalysis-Pandas分组聚合
title: Pandas分组聚合 tags: 数据分析 python categories: DataAnalysis toc: true date: 2020-02-10 16:28:49 Des ...
pandas分组和聚合
Pandas分组与聚合分组 (groupby) 对数据集进行分组,然后对每组进行统计分析 SQL能够对数据进行过滤,分组聚合 pandas能利用groupby进行更加复杂的分组运算分组运算过程:s ...
Pandas分组运算（groupby）修炼
Pandas分组运算(groupby)修炼 Pandas的groupby()功能很强大,用好了可以方便的解决很多问题,在数据处理以及日常工作中经常能施展拳脚. 今天,我们一起来领略下groupby() ...
34.分组聚合操作—bucket
主要知识点: 学习聚合知识一.准备数据 1.家电卖场案例背景建立index 以一个家电卖场中的电视销售数据为背景,来对各种品牌,各种颜色的电视的销量和销售额,进行各种各样角度的分析 ...
白日梦的Elasticsearch实战笔记，ES账号免费借用、32个查询案例、15个聚合案例、7个查询优化技巧。
目录一.导读二.福利:账号借用三._search api 搜索api 3.1.什么是query string search? 3.2.什么是query dsl? 3.3.干货!32个查询案例! ...
白日梦的Elasticsearch实战笔记，32个查询案例、15个聚合案例、7个查询优化技巧。
目录一.导读三._search api 搜索api 3.1.什么是query string search? 3.2.什么是query dsl? 3.3.干货!32个查询案例! 四.聚合分析 4.1 ...

随机推荐

git恢复彻底删除的分支
由于一时疏忽,错误的删除了未发布正式的开发分支,经查资料已恢复分支,特此记录查看Git日志 git reflog |grep 'filter_or_gwf' 以下日志为已删除分支 filter_or ...
【记录】git error:bad signature 解决方法
今天提交git 的时候出现 bad signature 错误,意思是git下的index文件损坏了,需要重新生成下 error: bad signature fatal: index file cor ...
TensorFlow学习笔记1：graph、session和op
graph即tf.Graph(),session即tf.Session(),很多人经常将两者混淆,其实二者完全不是同一个东西. graph定义了计算方式,是一些加减乘除等运算的组合,类似于一个函数.它 ...
2、Jmeter测试
一.测试流程 1.添加本次测试计划 (右键-->添加-->Threads(Users)-->线程组) 2.设置线程数 (所谓线程数就是并发用户数) 3.在线程组内添加请求(右键--& ...
OGG-01169
OGG-01169 Oracle GoldenGate Delivery for Oracle, dwarer.prm: Encountered an update where all key c ...
前端每日实战：91# 视频演示如何用纯 CSS 创作一个行驶中的火车 loader
效果预览按下右侧的"点击预览"按钮可以在当前页面预览,点击链接可以全屏预览. https://codepen.io/comehope/pen/RBLWzJ 可交互视频此视频是可 ...
kettle 通过JDBC 连接SQL Server（Error occurred while trying to connect to the database）
在连接数据(MS SQLServer 2008)发现:Error occurred while trying to connect to the database 然后找资料看,都不是问题所在,最后一 ...
Day46（列表标签，表格标签，表单标签，css的引入方式，css选择器）
一.列表标签列表标签分为三种. 1.无序列表<ul>,无序列表中的每一项是<li> 英文单词解释如下: ul:unordered list,“无序列表”的意思. li:lis ...
php中美元符号是什么意思
php中$符号是变量符号: 把$符号加上字符串,这个字符串就是一个变量名或对象名. 其实PHP采用的是C语言的语法,但是也有一些区别,$符号加上字符串,这就是一个变量名或对象名. 例如下面的代码:(推 ...
2A3T我的PMP备考及考试心得20181208
2018年的下半年由于工作不是很忙,所以生活中有更好的精力去做些自己的事情.出于工作需要,我决定考个证书充实下自己,在各大网站搜索解惑后决定考PMP,并报了个培训班一.PMP考试简介共200道选择 ...

pandas分组聚合案例

美国2012年总统候选人政治献金数据分析

pandas分组聚合案例的更多相关文章

随机推荐

热门专题