Facebook技术架构
MySQL,Multifeed (a
custom distributed system which takes the tens of thousands of updates from friends and picks the most relevant), Thrift, Memcached,Operations.
Much of Facebook’s interactive features are powered by AJAX,
Horizontal scalability enabled via load balancing (to pick a web server to handle the request, other purposes: to protect DoD)
to separate “write” databases from “read” to enhance the scalability of its application architecture:“Page Routing” but
most of us in the industry call “Layer 7 Switching” or “Application Switching”
Modern applications must be deployed and delivered collaboratively with infrastructure if they are to scale and support growth in an operationally and financially efficient manner.
Facebook message:
Layered
Service/API Driven
Distributed
Separate Application Logic
Stateless (State is kept in a database ties, caching tier or other services)
Scalable Component Services
Full Stack Ops(all kinds of tools)
Celled (A cell consists ofZooKeeper
controllers, an application server cluster, and ametadata
store. ) ZooKeeper. ZooKeeper is used for high availability, sharding, failover, and services discovery.
Real-time analytics System
HBase - 20 Billion Events/Day
Hbase + Scribe + Ptail + Puma
php(frontend) + java(backend)
Thrift
Software: http://royal.pingdom.com/2010/06/18/the-software-behind-facebook/
PHP+Linux+MySQL(primarily as a key-value persistent storage)
Haystack, a highly scalable object store used to serve Facebook’s immense amount of photos, or Scribe, a logging system that can operate at the scale of Facebook
Memcached between web servers and MySQL
HipHop converted PHP into C++ Code
Haystack is Facebook’s high-performance photo storage/retrieval system (strictly speaking, Haystack
is an object store
BigPipe is a dynamic web page serving
system that Facebook has developed.
Facebook uses Cassandra for its Inbox search
Scribe is a flexible logging system that Facebook uses for a multitude of purposes internally.
Facebook uses Hadoop & Hive for data analysis
Thrift is an internally developed cross-language framework that ties all of these different languages (PHP, Erlang,
Java and C++) together, making it possible for them to talk to each other.
Varnish is an HTTP accelerator which can act as a load balancer and also cache content which can then be served lightning-fast.
Gradual releases and dark launches
XHProf->Profiling
like many other big sites, Facebook uses a CDN to help serve static content
You can get the code right, you can get the products right, but you need to get the culture right first. If you don't get the culture right then your company won't scale.
Overall architecture has 4 main components: Load Balancer, Web Servers (written in PHP), Services (fast, complicated, search, ad, scribe), Memcached
(fast, simple), Databases (slow, persistent).
There are no product owners at Facebook
http://highscalability.com/blog/2010/6/10/the-four-meta-secrets-of-scaling-at-facebook.html
http://www.infoq.com/presentations/Scale-at-Facebook
参考:http://www.infoq.com/presentations/Facebook-Software-Stack
Facebook技术架构的更多相关文章
- Hive技术架构
一.Hive概念 Facebook为了解决海量日志数据的分析而开发了Hive,Hive是一种用SQL语句来读写.管理存储在分布式存储设备上的大数据集的数据仓库框架. 1. 数据是存储在HDFS上的,H ...
- 聚光灯下的熊猫TV技术架构演进
2015年开始的百播大战,熊猫TV是其中比较特别的一员. 说熊猫TV是含着金钥匙出生的公子哥不为过.还未上线,就频频曝光,科技号,微博稿,站上风口浪尖.内测期间更是有不少淘宝店高价倒卖邀请码,光内测时 ...
- Instagram的技术架构
http://blogread.cn/it/article/5497 Instagram 被 Facebook 以10亿美金收购.团队规模:13 人.而在被Facebook收购前的一个月,整个团队才7 ...
- 软件架构设计学习总结(3):QQ空间技术架构之详解
QQ空间作为腾讯海量互联网服务产品,经过近七年的发展,实现了从十万级到亿级同时在线的飞跃.在这个过程中,QQ空间团队遇到了哪些技术挑战?其站点前后台架构随着业务规模的变化又进行了怎样的演进与变迁?成长 ...
- 【熊猫TV】《程序员》:聚光灯下的熊猫TV技术架构演进
2015年开始的百播大战,熊猫TV是其中比较特别的一员. 说熊猫TV是含着金钥匙出生的公子哥不为过.还未上线,就频频曝光,科技号,微博稿,站上风口浪尖.内测期间更是有不少淘宝店高价倒卖邀请码,光内测时 ...
- 宜人贷PaaS数据服务平台Genie:技术架构及功能
上篇:架构及组件 一.数据平台的发展 1.1 背景介绍 随着数据时代的到来,数据量和数据复杂度的增加推动了数据工程领域的快速发展.为了满足各类数据获取/计算等需求,业内涌现出了诸多解决方案.但大部分方 ...
- [置顶]
QQ空间技术架构之深刻揭密
QQ空间作为腾讯海量互联网服务产品,经过近七年的发展,实现了从十万级到亿级同时在线的飞跃.在这个过程中,QQ空间团队遇到了哪些技术挑战?其站点前后台架构随着业务规模的变化又进行了怎样的演进与变迁?成长 ...
- QQ空间技术架构之深刻揭秘
QQ空间技术架构之深刻揭秘 来源: 腾讯大讲堂 发布时间: 2012-05-17 17:24 阅读: 7822 次 推荐: 4 [收藏] QQ 空间作为腾讯海量互联网服务产品,经过近七年 ...
- Web高级征程:《大型网站技术架构》读书笔记系列
一.此书到底何方神圣? <大型网站技术架构:核心原理与案例分析>通过梳理大型网站技术发展历程,剖析大型网站技术架构模式,深入讲述大型互联网架构设计的核心原理,并通过一组典型网站技术架构设计 ...
随机推荐
- [转载] Linux 文件系统结构介绍
原文: https://linux.cn/article-6132-weibo.html Linux中的文件是什么?它的文件系统又是什么?那些配置文件又在哪里?我下载好的程序保存在哪里了?在 Linu ...
- html5 的draggable属性使用<转载收藏>
在HTML5中,已经支持在浏览器与其他应用程序之间的数据互相拖动,同时也大大简化了有关于拖放方面的代码. 实现拖放的步骤 在HTML5中要想实现拖放操作,至少要经过两个步骤: 将想要拖放的对象元素的d ...
- poj2826An Easy Problem?!
链接 繁琐细节题. 1.线段无交点时,ans=0; 2.如图 假设过p3.y的水平线与p1p2相交 因为雨是垂直下落的,左图的情况是无法收集到雨水的,而这种情况有一种简便的判定方式 cross(p1- ...
- Java中List Set Map 是否有序等总结
1.Collection List Set Map 区别记忆 这些都代表了Java中的集合,这里主要从其元素是否有序,是否可重复来进行区别记忆,以便恰当地使用,当然还存在同步方面的差异,见上一篇相关文 ...
- Android中Activity、Service和线程之间的通信
Activity.Service和线程应该是Android编程中最常见的几种类了,几乎大多数应用程序都会涉及到这几个类的编程,自然而然的,也就会涉及到三者之间的相互通信,本文就试图简单地介绍一下这三者 ...
- 转:不是技术牛人,如何拿到国内IT巨头的Offer
转自:http://blog.csdn.net/lsldd/article/details/13506263 不久前,byvoid面阿里星计划的面试结果截图泄漏,引起无数IT屌丝的羡慕敬仰.看看这些牛 ...
- Phoenix - Hbase与SQL
Phoenix - Hbase与SQL 2016-10-23 杜亦舒 Phoenix是什么 简单来说,Phoenix 是一个可以让我们通过SQL的方式操作HBase数据库的框架. HBase是一个No ...
- icp算法的一些参考资料
1.综述:迭代最近点算法综述,介绍了svd分解和四元数法,其中 svd法:http://blog.csdn.net/kfqcome/article/details/9358853 四元数法:http: ...
- json遍历key value
http://blog.csdn.net/lanshengsheng2012/article/details/17679487 public static void main(String[] arg ...
- java中运算符的解析和计算
package com.LBH; import javax.script.ScriptEngine; import javax.script.ScriptEngineManager; import j ...