Facebook技术架构
MySQL,Multifeed (a
custom distributed system which takes the tens of thousands of updates from friends and picks the most relevant), Thrift, Memcached,Operations.
Much of Facebook’s interactive features are powered by AJAX,
Horizontal scalability enabled via load balancing (to pick a web server to handle the request, other purposes: to protect DoD)
to separate “write” databases from “read” to enhance the scalability of its application architecture:“Page Routing” but
most of us in the industry call “Layer 7 Switching” or “Application Switching”
Modern applications must be deployed and delivered collaboratively with infrastructure if they are to scale and support growth in an operationally and financially efficient manner.
Facebook message:
Layered
Service/API Driven
Distributed
Separate Application Logic
Stateless (State is kept in a database ties, caching tier or other services)
Scalable Component Services
Full Stack Ops(all kinds of tools)
Celled (A cell consists ofZooKeeper
controllers, an application server cluster, and ametadata
store. ) ZooKeeper. ZooKeeper is used for high availability, sharding, failover, and services discovery.
Real-time analytics System
HBase - 20 Billion Events/Day
Hbase + Scribe + Ptail + Puma
php(frontend) + java(backend)
Thrift
Software: http://royal.pingdom.com/2010/06/18/the-software-behind-facebook/
PHP+Linux+MySQL(primarily as a key-value persistent storage)
Haystack, a highly scalable object store used to serve Facebook’s immense amount of photos, or Scribe, a logging system that can operate at the scale of Facebook
Memcached between web servers and MySQL
HipHop converted PHP into C++ Code
Haystack is Facebook’s high-performance photo storage/retrieval system (strictly speaking, Haystack
is an object store
BigPipe is a dynamic web page serving
system that Facebook has developed.
Facebook uses Cassandra for its Inbox search
Scribe is a flexible logging system that Facebook uses for a multitude of purposes internally.
Facebook uses Hadoop & Hive for data analysis
Thrift is an internally developed cross-language framework that ties all of these different languages (PHP, Erlang,
Java and C++) together, making it possible for them to talk to each other.
Varnish is an HTTP accelerator which can act as a load balancer and also cache content which can then be served lightning-fast.
Gradual releases and dark launches
XHProf->Profiling
like many other big sites, Facebook uses a CDN to help serve static content
You can get the code right, you can get the products right, but you need to get the culture right first. If you don't get the culture right then your company won't scale.
Overall architecture has 4 main components: Load Balancer, Web Servers (written in PHP), Services (fast, complicated, search, ad, scribe), Memcached
(fast, simple), Databases (slow, persistent).
There are no product owners at Facebook
http://highscalability.com/blog/2010/6/10/the-four-meta-secrets-of-scaling-at-facebook.html
http://www.infoq.com/presentations/Scale-at-Facebook
参考:http://www.infoq.com/presentations/Facebook-Software-Stack
Facebook技术架构的更多相关文章
- Hive技术架构
一.Hive概念 Facebook为了解决海量日志数据的分析而开发了Hive,Hive是一种用SQL语句来读写.管理存储在分布式存储设备上的大数据集的数据仓库框架. 1. 数据是存储在HDFS上的,H ...
- 聚光灯下的熊猫TV技术架构演进
2015年开始的百播大战,熊猫TV是其中比较特别的一员. 说熊猫TV是含着金钥匙出生的公子哥不为过.还未上线,就频频曝光,科技号,微博稿,站上风口浪尖.内测期间更是有不少淘宝店高价倒卖邀请码,光内测时 ...
- Instagram的技术架构
http://blogread.cn/it/article/5497 Instagram 被 Facebook 以10亿美金收购.团队规模:13 人.而在被Facebook收购前的一个月,整个团队才7 ...
- 软件架构设计学习总结(3):QQ空间技术架构之详解
QQ空间作为腾讯海量互联网服务产品,经过近七年的发展,实现了从十万级到亿级同时在线的飞跃.在这个过程中,QQ空间团队遇到了哪些技术挑战?其站点前后台架构随着业务规模的变化又进行了怎样的演进与变迁?成长 ...
- 【熊猫TV】《程序员》:聚光灯下的熊猫TV技术架构演进
2015年开始的百播大战,熊猫TV是其中比较特别的一员. 说熊猫TV是含着金钥匙出生的公子哥不为过.还未上线,就频频曝光,科技号,微博稿,站上风口浪尖.内测期间更是有不少淘宝店高价倒卖邀请码,光内测时 ...
- 宜人贷PaaS数据服务平台Genie:技术架构及功能
上篇:架构及组件 一.数据平台的发展 1.1 背景介绍 随着数据时代的到来,数据量和数据复杂度的增加推动了数据工程领域的快速发展.为了满足各类数据获取/计算等需求,业内涌现出了诸多解决方案.但大部分方 ...
- [置顶]
QQ空间技术架构之深刻揭密
QQ空间作为腾讯海量互联网服务产品,经过近七年的发展,实现了从十万级到亿级同时在线的飞跃.在这个过程中,QQ空间团队遇到了哪些技术挑战?其站点前后台架构随着业务规模的变化又进行了怎样的演进与变迁?成长 ...
- QQ空间技术架构之深刻揭秘
QQ空间技术架构之深刻揭秘 来源: 腾讯大讲堂 发布时间: 2012-05-17 17:24 阅读: 7822 次 推荐: 4 [收藏] QQ 空间作为腾讯海量互联网服务产品,经过近七年 ...
- Web高级征程:《大型网站技术架构》读书笔记系列
一.此书到底何方神圣? <大型网站技术架构:核心原理与案例分析>通过梳理大型网站技术发展历程,剖析大型网站技术架构模式,深入讲述大型互联网架构设计的核心原理,并通过一组典型网站技术架构设计 ...
随机推荐
- Android Studio常见问题 -- AndroidManifest.xml 覆盖问题
问题如下 D:\source-code\AndroidStudio\MyApplication\app\src\main\AndroidManifest.xmlError:(14, 9) Attrib ...
- Codeforces 713C Sonya and Problem Wihtout a Legend
题意:给一个序列,可以进行若干次操作,每次操作选择一个数让它+1或-1,问最少要几次操作使得序列变为严格单调递增序列. 题解:首先考虑非严格递增序列,则每个数字最终变成的数字一定是该数组中的某个数.那 ...
- 【Todo】Java新技术学习笔记-from某技术分析
看到这篇文章:http://mt.sohu.com/20160806/n462923089.shtml <十余年技术大牛告诉你,这些Java新技术不可错过> 虽然讲的比较泛,但是里面提到的 ...
- POJ 2418 各种二叉排序树
题意很明确,统计各个字符串所占总串数的百分比,暴力的话肯定超时,看了书上的题解后发现这题主要是用二叉排序树来做,下面附上n种树的代码. 简单的二叉排序树,不作任何优化(C语言版的): #include ...
- GO语言中间的derfer
defer Go语言中有种不错的设计,即延迟(defer)语句,你可以在函数中添加多个defer语句.当函数执行到最后时,这些defer语句会按照逆序执行, 最后该函数返回.特别是当你在进行一些打开资 ...
- SecureCRT命令行文字和背景颜色设置
先看设置后的效果图,这是个人比较喜欢的配色(整体色调偏暗): 具体设置方法为:
- Python核心编程-描述符
python中,什么描述符.描述符就是实现了"__get__"."__set__"或"__delete__" 方法中至少一个的对象.什么是非 ...
- linux 重命名文件和文件夹
linux下重命名文件或文件夹的命令mv既可以重命名,又可以移动文件或文件夹. 例子:将目录A重命名为B mv A B 例子:将/a目录移动到/b下,并重命名为c mv /a /b/c 其实在文本模式 ...
- iOS AVCaptureVideoDataOutputSampleBufferDelegate 录制视频
iOS AVCaptureVideoDataOutputSampleBufferDelegate 录制视频 应用场景: 使用AVFoundation提供的API, 我们可以从 AVCaptureVid ...
- dede 调用四级导航
一.修改文件:\include\taglib目录下的channel.lib.php,请将以下代码全部复制替换上述文件 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 ...