Facebook技术架构
MySQL,Multifeed (a
custom distributed system which takes the tens of thousands of updates from friends and picks the most relevant), Thrift, Memcached,Operations.
Much of Facebook’s interactive features are powered by AJAX,
Horizontal scalability enabled via load balancing (to pick a web server to handle the request, other purposes: to protect DoD)
to separate “write” databases from “read” to enhance the scalability of its application architecture:“Page Routing” but
most of us in the industry call “Layer 7 Switching” or “Application Switching”
Modern applications must be deployed and delivered collaboratively with infrastructure if they are to scale and support growth in an operationally and financially efficient manner.
Facebook message:
Layered
Service/API Driven
Distributed
Separate Application Logic
Stateless (State is kept in a database ties, caching tier or other services)
Scalable Component Services
Full Stack Ops(all kinds of tools)
Celled (A cell consists ofZooKeeper
controllers, an application server cluster, and ametadata
store. ) ZooKeeper. ZooKeeper is used for high availability, sharding, failover, and services discovery.
Real-time analytics System
HBase - 20 Billion Events/Day
Hbase + Scribe + Ptail + Puma
php(frontend) + java(backend)
Thrift
Software: http://royal.pingdom.com/2010/06/18/the-software-behind-facebook/
PHP+Linux+MySQL(primarily as a key-value persistent storage)
Haystack, a highly scalable object store used to serve Facebook’s immense amount of photos, or Scribe, a logging system that can operate at the scale of Facebook
Memcached between web servers and MySQL
HipHop converted PHP into C++ Code
Haystack is Facebook’s high-performance photo storage/retrieval system (strictly speaking, Haystack
is an object store
BigPipe is a dynamic web page serving
system that Facebook has developed.
Facebook uses Cassandra for its Inbox search
Scribe is a flexible logging system that Facebook uses for a multitude of purposes internally.
Facebook uses Hadoop & Hive for data analysis
Thrift is an internally developed cross-language framework that ties all of these different languages (PHP, Erlang,
Java and C++) together, making it possible for them to talk to each other.
Varnish is an HTTP accelerator which can act as a load balancer and also cache content which can then be served lightning-fast.
Gradual releases and dark launches
XHProf->Profiling
like many other big sites, Facebook uses a CDN to help serve static content
You can get the code right, you can get the products right, but you need to get the culture right first. If you don't get the culture right then your company won't scale.
Overall architecture has 4 main components: Load Balancer, Web Servers (written in PHP), Services (fast, complicated, search, ad, scribe), Memcached
(fast, simple), Databases (slow, persistent).
There are no product owners at Facebook
http://highscalability.com/blog/2010/6/10/the-four-meta-secrets-of-scaling-at-facebook.html
http://www.infoq.com/presentations/Scale-at-Facebook
参考:http://www.infoq.com/presentations/Facebook-Software-Stack
Facebook技术架构的更多相关文章
- Hive技术架构
一.Hive概念 Facebook为了解决海量日志数据的分析而开发了Hive,Hive是一种用SQL语句来读写.管理存储在分布式存储设备上的大数据集的数据仓库框架. 1. 数据是存储在HDFS上的,H ...
- 聚光灯下的熊猫TV技术架构演进
2015年开始的百播大战,熊猫TV是其中比较特别的一员. 说熊猫TV是含着金钥匙出生的公子哥不为过.还未上线,就频频曝光,科技号,微博稿,站上风口浪尖.内测期间更是有不少淘宝店高价倒卖邀请码,光内测时 ...
- Instagram的技术架构
http://blogread.cn/it/article/5497 Instagram 被 Facebook 以10亿美金收购.团队规模:13 人.而在被Facebook收购前的一个月,整个团队才7 ...
- 软件架构设计学习总结(3):QQ空间技术架构之详解
QQ空间作为腾讯海量互联网服务产品,经过近七年的发展,实现了从十万级到亿级同时在线的飞跃.在这个过程中,QQ空间团队遇到了哪些技术挑战?其站点前后台架构随着业务规模的变化又进行了怎样的演进与变迁?成长 ...
- 【熊猫TV】《程序员》:聚光灯下的熊猫TV技术架构演进
2015年开始的百播大战,熊猫TV是其中比较特别的一员. 说熊猫TV是含着金钥匙出生的公子哥不为过.还未上线,就频频曝光,科技号,微博稿,站上风口浪尖.内测期间更是有不少淘宝店高价倒卖邀请码,光内测时 ...
- 宜人贷PaaS数据服务平台Genie:技术架构及功能
上篇:架构及组件 一.数据平台的发展 1.1 背景介绍 随着数据时代的到来,数据量和数据复杂度的增加推动了数据工程领域的快速发展.为了满足各类数据获取/计算等需求,业内涌现出了诸多解决方案.但大部分方 ...
- [置顶]
QQ空间技术架构之深刻揭密
QQ空间作为腾讯海量互联网服务产品,经过近七年的发展,实现了从十万级到亿级同时在线的飞跃.在这个过程中,QQ空间团队遇到了哪些技术挑战?其站点前后台架构随着业务规模的变化又进行了怎样的演进与变迁?成长 ...
- QQ空间技术架构之深刻揭秘
QQ空间技术架构之深刻揭秘 来源: 腾讯大讲堂 发布时间: 2012-05-17 17:24 阅读: 7822 次 推荐: 4 [收藏] QQ 空间作为腾讯海量互联网服务产品,经过近七年 ...
- Web高级征程:《大型网站技术架构》读书笔记系列
一.此书到底何方神圣? <大型网站技术架构:核心原理与案例分析>通过梳理大型网站技术发展历程,剖析大型网站技术架构模式,深入讲述大型互联网架构设计的核心原理,并通过一组典型网站技术架构设计 ...
随机推荐
- Android获取窗体信息的Util方法
package com.wangyi.tools; import android.app.Activity; import android.util.DisplayMetrics; public cl ...
- C++大数类模板
友情提示:使用该模板的注意了,在大数减法里有一个小错误,导致减法可能会出错 // 原来的写法,将t1.len错写成了len ] == && t1.len > ) { t1.len ...
- 2013/7/17 HNU_训练赛5
sgu 542 Gena vs Petya sgu 543 Cafe 题意:有N组人需要被分配到某些固定了人数的桌子上,其中ai表示第i组有多少个人,安排作为需要符合如下安排:某一组的人员不能够单独在 ...
- Nginx基础知识————生成自签名ca 证书 使nginx 支持https
创建服务器私钥,命令会让你输入一个口令: $ openssl genrsa -des3 -out server.key 1024 创建签名请求的证书(CSR): $ openssl req -new ...
- 快速认识ELK中的L - Logstash
快速认识ELK中的L - Logstash 原创 2016-12-07 杜亦舒 简介 Logstash 是一个开源的数据采集引擎. Logstash 就像是一个管子,左面接数据源接收数据,右面接存储目 ...
- mysql连接字符串
MySQL中 concat 函数使用方法:CONCAT(str1,str2,…)
- 20160808_Shell书
1. http://item.jd.com/11075150.html 2.
- python操作mongodb之五大量写操作
import pymongo #库名 db = pymongo.MongoClient('192.168.30.252',27017).bulk_example #test集合插入 db.test.i ...
- sql cast()和convert()
19.CAST()函数和CONVERT()函数 CAST()函数可以将某种数据类型的表达式转化为另一种数据类型 CONVERT()函数也可以将制定的数据类型转换为另一种数据类型 19.1 CAST() ...
- VC++时间函数总结
目录 第1章基本概念 1 1.1 基本概念 1 1.2 时间表示法 2 第2章 Win32 API 3 2.1 获取 3 2.1.1 时间间隔 3 2.1.2 时刻 ...