分布式学习材料Distributed System Prerequisite List
接下的内容按几个大类来列:
1. 文件系统
a. GFS – The Google File System
b. HDFS
1) The Hadoop Distributed File System
2) The Hadoop Distributed File System: Architecture And Design
c. XFS – The Tencent File System
2. 数据库系统
a. BigTable – BigTable: A Distributed Storage System for Structured Data
b. HBase – The Apache HBase Reference Guide
c. Dynamo – Dynamo: Amazon’s Highly Available Key-Value Store
d. Megastore – Megastore: Providing Scalable, Highly Available Storage for Interactive Services
e. Spanner – Spanner: Google’s Globally-Distributed Database
f. Azure – Windows Azure Storage: A Highly Available Cloud Storage Service with Strong Consistency
g. Percolator – Large-scale Incremental Processing Using Distributed Transactions and Notifications
3. 机群/资源管理系统
a. Omega – Omega: Flexible, Scalable Schedulers for Large Compute Clusters
b. Autopilot – Autopilot: Automatic Data Center Management
c. Yarn
1) Architecture of Next Generation Apache Hadoop MapReduce Framework
2) The Next Generation of Apache Hadoop Mapreduce
3) Introducing Apache Hadoop YARN
d. Mesos – A Platform for Fine-Grained Resource Sharing in the Data Center
4. 计算框架:
a. MapReduce – MapReduce: Simplified Data Processing on Large Clusters
b. Storm – Storm: Distributed and Fault-Tolerant Realtime Computaion
c. Spark – Spark: Cluster Computing with Working Sets
d. Impala – Cloudera Impala: Real-Time Querie in Apache Hadoop
e. Dremel – Dremel: Interactive Analysis of Web-Scale Datasets
f. Hive/Stinger
1) Hive: A Warehousing Solution Over a MapReduce Framework
2) Hive: A Petabyte Scale Data Warehouse Using Hadoop
3) The Stinger Initiative: Making Apache Hive 100 Times Faster
4) Stinger, Interactive Query for Apache Hive
g. FlumeJava/Crunch
1) FlumeJava: Easy, Efficient Data-Parellel Pipelines
2) Introducing Crunch: Easy MapReduce Pipelines for Apache Hadoop
h. Tez
1) Apache Hadoop Tez
2) Apache Tez: A New Chapter in Hadoop Data Processing
g. Presto – Presto: Interacting with petabytes of data at Facebook
5. 分布式一致性
a. Paxos – Paxos Made Simple
b. Zookeeper
1) Zookeeper: A Distributed Coordination Service for Distributes Applications
2) Zookeeper: Wait-free Coordination for Internet-scale Systems
c. Chubby – The Chubby Lock Service for Loosely-coupled Distributed Systems
d. Raft – In Search of an Understandable Consensus Algorithm
6. 其它
a. SequenceFile – Sequence File Format
b. SSTable
1) SSTable and Log Structured Storage: LevelDB
2) SSTable Storage Format
c. RCFile – RCFile: A Fast and Space-efficient Data Placement Structure in MapReduce-based Warehouse Systems
d. ORCFile – ORC File Format
e. Parquet – Parquet: Columnar Storage for The People
分布式学习材料Distributed System Prerequisite List的更多相关文章
- 分布式系统(Distributed System)资料
这个资料关于分布式系统资料,作者写的太好了.拿过来以备用 网址:https://github.com/ty4z2008/Qix/blob/master/ds.md 希望转载的朋友,你可以不用联系我.但 ...
- 分布式学习系列【dubbo入门实践】
分布式学习系列[dubbo入门实践] dubbo架构 组成部分:provider,consumer,registry,monitor: provider,consumer注册,订阅类似于消息队列的注册 ...
- 译《Time, Clocks, and the Ordering of Events in a Distributed System》
Motivation <Time, Clocks, and the Ordering of Events in a Distributed System>大概是在分布式领域被引用的最多的一 ...
- Note: Time clocks and the ordering of events in a distributed system
http://research.microsoft.com/en-us/um/people/lamport/pubs/time-clocks.pdf 分布式系统的时钟同步是一个非常困难的问题,this ...
- [源码解析] PyTorch 分布式(14) --使用 Distributed Autograd 和 Distributed Optimizer
[源码解析] PyTorch 分布式(14) --使用 Distributed Autograd 和 Distributed Optimizer 目录 [源码解析] PyTorch 分布式(14) - ...
- KASS分布式文件系统(Kass File System)
KASS分布式文件系统(Kass File System),简称KFS,是开始公司自主研发的分布式文件存储服务平台.KFS系统架构及功能服务类似Hadoop/GFS/DFS,它通过HTTP-WEB为上 ...
- Linux C编程语言学习材料
C语言作为最基础的编程语言,30年虚弱的患病率. 无论是准备做 PHP/Java/Python/Golang 开发学习.C语言都是基础的,我们非常多基础非常小的互联网执行的开源软件服务都是C语言构筑, ...
- Aysnc-callback with future in distributed system
Aysnc-callback with future in distributed system
- wxWidgets刚開始学习的人导引(6)——wxWidgets学习材料清单
wxWidgets刚開始学习的人导引全文件夹 PDF版及附件下载 1 前言2 下载.安装wxWidgets3 wxWidgets应用程序初体验4 wxWidgets学习资料及利用方法指导5 用wx ...
随机推荐
- 汽车4S店经验指标完成情况报表制作分享
集团公司一般为了加强下属的经营管理,以及项经营指标完情况,需要制定一些报表.我们平时也经常遇到这种情况,而这些报表要包括什么内容呢?该怎么制作呢?用什么制作呢?今天小编就以4s店为例,分享给大家一个报 ...
- Stanford机器学习笔记-8. 支持向量机(SVMs)概述
8. Support Vector Machines(SVMs) Content 8. Support Vector Machines(SVMs) 8.1 Optimization Objection ...
- [No000052]大蒜怎么吃最美容?吃大蒜的功效及禁忌
大蒜是最常见的香辛调味料,它被称为天然抗生素,富含大蒜素等多种营养物质和抗氧化剂,具有多种美肤美容作用. 大蒜的5种美容功效 1.除皱.大蒜里的某些成分,有类似维生素E与维生素C的抗氧化.防衰老特性, ...
- eclipse大括号高亮显示---颜色很淡,改为显眼的颜色
window -> preferences -> java(or c++)-> editor -> matching brackets highight, color改为红色
- java 接口(上)
1.接口中的方法都是抽象方法.而普通的抽象类里面不一定都是抽象方法.抽象类中必须有抽象方法,同时也可以有非抽象方法.继承抽象父类的子类中,如果依然有抽象方法,那么这个子类也是抽象类.即只要类中有抽象方 ...
- Python的高级特性11:拓展基本数据类型(dict)
字典的创建有两种方式,如果出现In [26]这样的赋值方式就会报错. In [17]: s['name'] = 'alex' In [18]: s['sex'] = 'male' In [19]: s ...
- javascript中的双向队列
1.概念 我们知道队列是一种先进先出的结构,只能在队伍的开头添加元素,队伍的结尾删除元素.双向队列的概念就是同时允许在队伍的开头和结尾添加和删除元素.在javascript中有一个处理数组的方法Arr ...
- 快速编写代码zencode
#是 id .是class $是数字 {}是标签中内容 *个数 ^上一级
- myeclipse 8.5离线安装python插件
看到网上很多教程扯了一大堆,好麻烦的样子. 1)下载pyhon开发插件,PyDev 2.2.0.zip 我在百度137708820网盘里已分享,链接http://pan.baidu.com/s/1mg ...
- 清北学堂2017NOIP冬令营入学测试P4749 C’s problem(c)
P4746 C's problem(c) 时间: 1000ms / 空间: 655360KiB / Java类名: Main 背景 冬令营入学测试 描述 题目描述 小C是一名数学家,由于它自制力比较差 ...