Facebook技术架构
MySQL,Multifeed (a
custom distributed system which takes the tens of thousands of updates from friends and picks the most relevant), Thrift, Memcached,Operations.
Much of Facebook’s interactive features are powered by AJAX,
Horizontal scalability enabled via load balancing (to pick a web server to handle the request, other purposes: to protect DoD)
to separate “write” databases from “read” to enhance the scalability of its application architecture:“Page Routing” but
most of us in the industry call “Layer 7 Switching” or “Application Switching”
Modern applications must be deployed and delivered collaboratively with infrastructure if they are to scale and support growth in an operationally and financially efficient manner.
Facebook message:
Layered
Service/API Driven
Distributed
Separate Application Logic
Stateless (State is kept in a database ties, caching tier or other services)
Scalable Component Services
Full Stack Ops(all kinds of tools)
Celled (A cell consists ofZooKeeper
controllers, an application server cluster, and ametadata
store. ) ZooKeeper. ZooKeeper is used for high availability, sharding, failover, and services discovery.
Real-time analytics System
HBase - 20 Billion Events/Day
Hbase + Scribe + Ptail + Puma
php(frontend) + java(backend)
Thrift
Software: http://royal.pingdom.com/2010/06/18/the-software-behind-facebook/
PHP+Linux+MySQL(primarily as a key-value persistent storage)
Haystack, a highly scalable object store used to serve Facebook’s immense amount of photos, or Scribe, a logging system that can operate at the scale of Facebook
Memcached between web servers and MySQL
HipHop converted PHP into C++ Code
Haystack is Facebook’s high-performance photo storage/retrieval system (strictly speaking, Haystack
is an object store
BigPipe is a dynamic web page serving
system that Facebook has developed.
Facebook uses Cassandra for its Inbox search
Scribe is a flexible logging system that Facebook uses for a multitude of purposes internally.
Facebook uses Hadoop & Hive for data analysis
Thrift is an internally developed cross-language framework that ties all of these different languages (PHP, Erlang,
Java and C++) together, making it possible for them to talk to each other.
Varnish is an HTTP accelerator which can act as a load balancer and also cache content which can then be served lightning-fast.
Gradual releases and dark launches
XHProf->Profiling
like many other big sites, Facebook uses a CDN to help serve static content
You can get the code right, you can get the products right, but you need to get the culture right first. If you don't get the culture right then your company won't scale.
Overall architecture has 4 main components: Load Balancer, Web Servers (written in PHP), Services (fast, complicated, search, ad, scribe), Memcached
(fast, simple), Databases (slow, persistent).
There are no product owners at Facebook
http://highscalability.com/blog/2010/6/10/the-four-meta-secrets-of-scaling-at-facebook.html
http://www.infoq.com/presentations/Scale-at-Facebook
参考:http://www.infoq.com/presentations/Facebook-Software-Stack
Facebook技术架构的更多相关文章
- Hive技术架构
一.Hive概念 Facebook为了解决海量日志数据的分析而开发了Hive,Hive是一种用SQL语句来读写.管理存储在分布式存储设备上的大数据集的数据仓库框架. 1. 数据是存储在HDFS上的,H ...
- 聚光灯下的熊猫TV技术架构演进
2015年开始的百播大战,熊猫TV是其中比较特别的一员. 说熊猫TV是含着金钥匙出生的公子哥不为过.还未上线,就频频曝光,科技号,微博稿,站上风口浪尖.内测期间更是有不少淘宝店高价倒卖邀请码,光内测时 ...
- Instagram的技术架构
http://blogread.cn/it/article/5497 Instagram 被 Facebook 以10亿美金收购.团队规模:13 人.而在被Facebook收购前的一个月,整个团队才7 ...
- 软件架构设计学习总结(3):QQ空间技术架构之详解
QQ空间作为腾讯海量互联网服务产品,经过近七年的发展,实现了从十万级到亿级同时在线的飞跃.在这个过程中,QQ空间团队遇到了哪些技术挑战?其站点前后台架构随着业务规模的变化又进行了怎样的演进与变迁?成长 ...
- 【熊猫TV】《程序员》:聚光灯下的熊猫TV技术架构演进
2015年开始的百播大战,熊猫TV是其中比较特别的一员. 说熊猫TV是含着金钥匙出生的公子哥不为过.还未上线,就频频曝光,科技号,微博稿,站上风口浪尖.内测期间更是有不少淘宝店高价倒卖邀请码,光内测时 ...
- 宜人贷PaaS数据服务平台Genie:技术架构及功能
上篇:架构及组件 一.数据平台的发展 1.1 背景介绍 随着数据时代的到来,数据量和数据复杂度的增加推动了数据工程领域的快速发展.为了满足各类数据获取/计算等需求,业内涌现出了诸多解决方案.但大部分方 ...
- [置顶]
QQ空间技术架构之深刻揭密
QQ空间作为腾讯海量互联网服务产品,经过近七年的发展,实现了从十万级到亿级同时在线的飞跃.在这个过程中,QQ空间团队遇到了哪些技术挑战?其站点前后台架构随着业务规模的变化又进行了怎样的演进与变迁?成长 ...
- QQ空间技术架构之深刻揭秘
QQ空间技术架构之深刻揭秘 来源: 腾讯大讲堂 发布时间: 2012-05-17 17:24 阅读: 7822 次 推荐: 4 [收藏] QQ 空间作为腾讯海量互联网服务产品,经过近七年 ...
- Web高级征程:《大型网站技术架构》读书笔记系列
一.此书到底何方神圣? <大型网站技术架构:核心原理与案例分析>通过梳理大型网站技术发展历程,剖析大型网站技术架构模式,深入讲述大型互联网架构设计的核心原理,并通过一组典型网站技术架构设计 ...
随机推荐
- PL/SQL 编写规范
大小写风格 所有数据库关键字和保留字均大写; 缩进风格 使用空格, 缩进2格(前边空两个格, 后边要与SQL语句的一致, 比如下面:) SELECT * FROM TABLE 空格及换行 1行只写1条 ...
- HTML字符实体
常用实体符号:
- 基本分类方法——KNN(K近邻)算法
在这篇文章 http://www.cnblogs.com/charlesblc/p/6193867.html 讲SVM的过程中,提到了KNN算法.有点熟悉,上网一查,居然就是K近邻算法,机器学习的入门 ...
- C#_拆箱跟装箱
Net的类型分为两种,一种是值类型,另一种是引用类型.这两个类型的本质区别,值类型数据是分配在栈中,而引用类型数据分配在堆上.那么如果要把一个值类型数据放到堆上,就需要装箱操作:反之,把一个放在堆上的 ...
- Hbase之使用多Get实例返回数据
import org.apache.hadoop.hbase.Cell; import org.apache.hadoop.hbase.CellUtil; import org.apache.hado ...
- widnow.open
http://blog.csdn.net/chenyanggo/article/details/7443051
- MATLAB 编程风格指南及注意事项
MATLAB编程风格指南Richard Johnson 著Genial 译MATLAB 编程风格指南Richard JohnsonVersion 1.5,Oct. 2002版权: Datatool 所 ...
- DialogFragment 自定义弹窗
layout文件 <?xml version="1.0" encoding="utf-8"?> <RelativeLayout xmlns:a ...
- x^y=(x&~y)|(~x&y)证明
我见过最棒的证明是文氏图:(首先要知道二元布尔代数是集合的特殊情况,所以把X和Y当作两个集合,结论成立,那么在二元布尔代数里面也成立.)左边的圈是X,右边的圈是Y.如果是OR 也就是取或,中间的白色的 ...
- Webdriver - Selenium Grid Configuration
Grid parameter: role = <hub|node> (default is no grid, just run an RC/webdriver server). When ...