今天研究Memcached的Java的Client,使用XMemcached 1.3.5,做个简单的测试,并介绍如何与Spring集成。




相关链接:

Memcached笔记——(一)安装&常规错误&监控

Memcached笔记——(二)XMemcached&Spring集成


Memcached笔记——(三)Memcached使用总结


Memcached笔记——(四)应对高并发攻击






一、Memcached Client简要介绍


Memcached Client目前有3种:

这三种Client一直存在各种争议:

  • Memcached Client for Java 比 SpyMemcached更稳定、更早、更广泛;
  • SpyMemcached 比 Memcached Client for Java更高效;
  • XMemcached 比 SpyMemcache并发效果更好。

用数据来说话,参考官方性能对比:

Memcached Client for Java:https://github.com/gwhalin/Memcached-Java-Client/wiki/PERFORMANCE


XMemcached:http://xmemcached.googlecode.com/svn/trunk/benchmark/benchmark.html




二、XMemcached特性


XMemcached特性:

  • 高性能
  • 支持完整的memcached文本协议,二进制协议。
  • 支持JMX,可以通过MBean调整性能参数、动态添加/移除server、查看统计等。
  • 支持客户端统计
  • 支持memcached节点的动态增减。
  • 支持memcached分布:余数分布和一致性哈希分布。
  • 更多的性能调整选项。

此外,XMemcached更容易与Spring集成。而且,属于中国原创!




三、XMemcached简单实现




MemcachedClientBuilder是MemcachedClient核心接口,用来控制Client的构建(build()方法)和关闭(shutdown()方法)。


XMemcachedClientBuilder一般通过构造方法配置地址列表,通常还要配置权重,代码如下:

  1. public XMemcachedClientBuilder(List<InetSocketAddress> addressList) {
  2. if (addressList != null) {
  3. for (InetSocketAddress addr : addressList) {
  4. this.addressMap.put(addr,
    null);
  5. }
  6. }
  7. }
  8. public XMemcachedClientBuilder(List<InetSocketAddress> addressList,
  9. int[] weights) {
  10. if (addressList != null) {
  11. for (InetSocketAddress addr : addressList) {
  12. this.addressMap.put(addr,
    null);
  13. }
  14. }
  15. this.weights = weights;
  16. }
	public XMemcachedClientBuilder(List<InetSocketAddress> addressList) {
if (addressList != null) {
for (InetSocketAddress addr : addressList) {
this.addressMap.put(addr, null);
}
}
} public XMemcachedClientBuilder(List<InetSocketAddress> addressList,
int[] weights) {
if (addressList != null) {
for (InetSocketAddress addr : addressList) {
this.addressMap.put(addr, null);
}
}
this.weights = weights;
}

不过这哥们如果用this()可以省点代码, 还有给加点注释吧!


此外,还需要设置连接池大小,使用二进制协议/文本协议等。

通过build()方法获得MemcachedClient

然后就可以通过Memcached进行set、get、replace、delete等Memcached操作了!


上代码:

  1. import static junit.framework.Assert.*;
  2. import java.io.IOException;
  3. import java.util.concurrent.TimeoutException;
  4. import net.rubyeye.xmemcached.MemcachedClient;
  5. import net.rubyeye.xmemcached.MemcachedClientBuilder;
  6. import net.rubyeye.xmemcached.XMemcachedClientBuilder;
  7. import net.rubyeye.xmemcached.command.BinaryCommandFactory;
  8. import net.rubyeye.xmemcached.exception.MemcachedException;
  9. import net.rubyeye.xmemcached.utils.AddrUtil;
  10. import org.junit.Test;
  11. public class MemcachedClientTest {
  12. @Test
  13. public void test() {
  14. MemcachedClientBuilder builder = new XMemcachedClientBuilder(
  15. AddrUtil.getAddresses("10.11.155.26:11211 10.11.155.41:11211 10.10.76.31:11211 10.10.76.35:11211"),
  16. new int[] {
    1,
    1, 1,
    1 });
  17. // 设置连接池大小,即客户端个数
  18. builder.setConnectionPoolSize(50);
  19. // 宕机报警
  20. builder.setFailureMode(true);
  21. // 使用二进制文件
  22. builder.setCommandFactory(new BinaryCommandFactory());
  23. MemcachedClient memcachedClient = null;
  24. try {
  25. memcachedClient = builder.build();
  26. try {
  27. // 设置/获取
  28. memcachedClient.set("zlex",
    36000,
    "set/get");
  29. assertEquals("set/get", memcachedClient.get("zlex"));
  30. // 替换
  31. memcachedClient.replace("zlex",
    36000,
    "replace");
  32. assertEquals("replace", memcachedClient.get("zlex"));
  33. // 移除
  34. memcachedClient.delete("zlex");
  35. assertNull(memcachedClient.get("zlex"));
  36. } catch (TimeoutException e) {
  37. // TODO Auto-generated catch block
  38. e.printStackTrace();
  39. } catch (InterruptedException e) {
  40. // TODO Auto-generated catch block
  41. e.printStackTrace();
  42. } catch (MemcachedException e) {
  43. // TODO Auto-generated catch block
  44. e.printStackTrace();
  45. }
  46. } catch (IOException e) {
  47. // TODO Auto-generated catch block
  48. e.printStackTrace();
  49. } finally {
  50. if (memcachedClient !=
    null) {
  51. try {
  52. memcachedClient.shutdown();
  53. } catch (IOException e) {
  54. // TODO Auto-generated catch block
  55. e.printStackTrace();
  56. }
  57. }
  58. }
  59. }
  60. }
import static junit.framework.Assert.*;

import java.io.IOException;
import java.util.concurrent.TimeoutException; import net.rubyeye.xmemcached.MemcachedClient;
import net.rubyeye.xmemcached.MemcachedClientBuilder;
import net.rubyeye.xmemcached.XMemcachedClientBuilder;
import net.rubyeye.xmemcached.command.BinaryCommandFactory;
import net.rubyeye.xmemcached.exception.MemcachedException;
import net.rubyeye.xmemcached.utils.AddrUtil; import org.junit.Test; public class MemcachedClientTest {
@Test
public void test() {
MemcachedClientBuilder builder = new XMemcachedClientBuilder(
AddrUtil.getAddresses("10.11.155.26:11211 10.11.155.41:11211 10.10.76.31:11211 10.10.76.35:11211"),
new int[] { 1, 1, 1, 1 }); // 设置连接池大小,即客户端个数
builder.setConnectionPoolSize(50); // 宕机报警
builder.setFailureMode(true); // 使用二进制文件
builder.setCommandFactory(new BinaryCommandFactory()); MemcachedClient memcachedClient = null;
try {
memcachedClient = builder.build();
try {
// 设置/获取
memcachedClient.set("zlex", 36000, "set/get");
assertEquals("set/get", memcachedClient.get("zlex")); // 替换
memcachedClient.replace("zlex", 36000, "replace");
assertEquals("replace", memcachedClient.get("zlex")); // 移除
memcachedClient.delete("zlex");
assertNull(memcachedClient.get("zlex"));
} catch (TimeoutException e) {
// TODO Auto-generated catch block
e.printStackTrace();
} catch (InterruptedException e) {
// TODO Auto-generated catch block
e.printStackTrace();
} catch (MemcachedException e) {
// TODO Auto-generated catch block
e.printStackTrace();
} } catch (IOException e) {
// TODO Auto-generated catch block
e.printStackTrace();
} finally {
if (memcachedClient != null) {
try {
memcachedClient.shutdown();
} catch (IOException e) {
// TODO Auto-generated catch block
e.printStackTrace();
}
}
}
}
}

四、XMemcached与Spring集成


XMemcached与Spring集成可以参考http://code.google.com/p/xmemcached/wiki/Spring_Integration,这里只说最常用的方法。


memcached.properties做基本配置:

  1. #连接池大小即客户端个数
  2. memcached.connectionPoolSize=50
  3. memcached.failureMode=true
  4. #server1
  5. memcached.server1.host=10.11.155.26
  6. memcached.server1.port=11211
  7. memcached.server1.weight=4
  8. #server2
  9. memcached.server2.host=10.11.155.41
  10. memcached.server2.port=11211
  11. memcached.server2.weight=3
  12. #server3
  13. memcached.server3.host=10.10.76.31
  14. memcached.server3.port=11211
  15. memcached.server3.weight=2
  16. #server4
  17. memcached.server4.host=10.10.76.35
  18. memcached.server4.port=11211
  19. memcached.server4.weight=1
#连接池大小即客户端个数
memcached.connectionPoolSize=50
memcached.failureMode=true
#server1
memcached.server1.host=10.11.155.26
memcached.server1.port=11211
memcached.server1.weight=4
#server2
memcached.server2.host=10.11.155.41
memcached.server2.port=11211
memcached.server2.weight=3
#server3
memcached.server3.host=10.10.76.31
memcached.server3.port=11211
memcached.server3.weight=2
#server4
memcached.server4.host=10.10.76.35
memcached.server4.port=11211
memcached.server4.weight=1

XML配置文件:

  1. <?xml
    version="1.0"
    encoding="UTF-8"?>
  2. <beans
  3. xmlns="http://www.springframework.org/schema/beans"
  4. xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
  5. xmlns:context="http://www.springframework.org/schema/context"
  6. xmlns:p="http://www.springframework.org/schema/p"
  7. xsi:schemaLocation="http://www.springframework.org/schema/beans http://www.springframework.org/schema/beans/spring-beans.xsd
  8. http://www.springframework.org/schema/context http://www.springframework.org/schema/context/spring-context.xsd">
  9. <!-- http://code.google.com/p/xmemcached/wiki/Spring_Integration -->
  10. <context:property-placeholder
    location="memcached.properties"
    />
  11. <bean
  12. id="memcachedClientBuilder"
  13. class="net.rubyeye.xmemcached.XMemcachedClientBuilder"
  14. p:connectionPoolSize="${memcached.connectionPoolSize}"
  15. p:failureMode="${memcached.failureMode}">
  16. <!-- XMemcachedClientBuilder have two arguments.First is server list,and
  17. second is weights array. -->
  18. <constructor-arg>
  19. <list>
  20. <bean
    class="java.net.InetSocketAddress">
  21. <constructor-arg>
  22. <value>${memcached.server1.host}</value>
  23. </constructor-arg>
  24. <constructor-arg>
  25. <value>${memcached.server1.port}</value>
  26. </constructor-arg>
  27. </bean>
  28. <bean
    class="java.net.InetSocketAddress">
  29. <constructor-arg>
  30. <value>${memcached.server2.host}</value>
  31. </constructor-arg>
  32. <constructor-arg>
  33. <value>${memcached.server2.port}</value>
  34. </constructor-arg>
  35. </bean>
  36. <bean
    class="java.net.InetSocketAddress">
  37. <constructor-arg>
  38. <value>${memcached.server3.host}</value>
  39. </constructor-arg>
  40. <constructor-arg>
  41. <value>${memcached.server3.port}</value>
  42. </constructor-arg>
  43. </bean>
  44. <bean
    class="java.net.InetSocketAddress">
  45. <constructor-arg>
  46. <value>${memcached.server4.host}</value>
  47. </constructor-arg>
  48. <constructor-arg>
  49. <value>${memcached.server4.port}</value>
  50. </constructor-arg>
  51. </bean>
  52. </list>
  53. </constructor-arg>
  54. <constructor-arg>
  55. <list>
  56. <value>${memcached.server1.weight}</value>
  57. <value>${memcached.server2.weight}</value>
  58. <value>${memcached.server3.weight}</value>
  59. <value>${memcached.server4.weight}</value>
  60. </list>
  61. </constructor-arg>
  62. <property
    name="commandFactory">
  63. <bean
    class="net.rubyeye.xmemcached.command.TextCommandFactory"
    />
  64. </property>
  65. <property
    name="sessionLocator">
  66. <bean
    class="net.rubyeye.xmemcached.impl.KetamaMemcachedSessionLocator"
    />
  67. </property>
  68. <property
    name="transcoder">
  69. <bean
    class="net.rubyeye.xmemcached.transcoders.SerializingTranscoder"
    />
  70. </property>
  71. </bean>
  72. <!-- Use factory bean to build memcached client -->
  73. <bean
  74. id="memcachedClient"
  75. factory-bean="memcachedClientBuilder"
  76. factory-method="build"
  77. destroy-method="shutdown"
    />
  78. </beans>
<?xml version="1.0" encoding="UTF-8"?>
<beans
xmlns="http://www.springframework.org/schema/beans"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xmlns:context="http://www.springframework.org/schema/context"
xmlns:p="http://www.springframework.org/schema/p"
xsi:schemaLocation="http://www.springframework.org/schema/beans http://www.springframework.org/schema/beans/spring-beans.xsd
http://www.springframework.org/schema/context http://www.springframework.org/schema/context/spring-context.xsd">
<!-- http://code.google.com/p/xmemcached/wiki/Spring_Integration -->
<context:property-placeholder location="memcached.properties" />
<bean
id="memcachedClientBuilder"
class="net.rubyeye.xmemcached.XMemcachedClientBuilder"
p:connectionPoolSize="${memcached.connectionPoolSize}"
p:failureMode="${memcached.failureMode}">
<!-- XMemcachedClientBuilder have two arguments.First is server list,and
second is weights array. -->
<constructor-arg>
<list>
<bean class="java.net.InetSocketAddress">
<constructor-arg>
<value>${memcached.server1.host}</value>
</constructor-arg>
<constructor-arg>
<value>${memcached.server1.port}</value>
</constructor-arg>
</bean>
<bean class="java.net.InetSocketAddress">
<constructor-arg>
<value>${memcached.server2.host}</value>
</constructor-arg>
<constructor-arg>
<value>${memcached.server2.port}</value>
</constructor-arg>
</bean>
<bean class="java.net.InetSocketAddress">
<constructor-arg>
<value>${memcached.server3.host}</value>
</constructor-arg>
<constructor-arg>
<value>${memcached.server3.port}</value>
</constructor-arg>
</bean>
<bean class="java.net.InetSocketAddress">
<constructor-arg>
<value>${memcached.server4.host}</value>
</constructor-arg>
<constructor-arg>
<value>${memcached.server4.port}</value>
</constructor-arg>
</bean>
</list>
</constructor-arg>
<constructor-arg>
<list>
<value>${memcached.server1.weight}</value>
<value>${memcached.server2.weight}</value>
<value>${memcached.server3.weight}</value>
<value>${memcached.server4.weight}</value>
</list>
</constructor-arg>
<property name="commandFactory">
<bean class="net.rubyeye.xmemcached.command.TextCommandFactory" />
</property>
<property name="sessionLocator">
<bean class="net.rubyeye.xmemcached.impl.KetamaMemcachedSessionLocator" />
</property>
<property name="transcoder">
<bean class="net.rubyeye.xmemcached.transcoders.SerializingTranscoder" />
</property>
</bean>
<!-- Use factory bean to build memcached client -->
<bean
id="memcachedClient"
factory-bean="memcachedClientBuilder"
factory-method="build"
destroy-method="shutdown" />
</beans>

这里的memcachedClientBuilder节点完成MemcachedClientBuilder,然后通过memcachedClient节点配置factory-method,调用MemcachedClientBuilder的build()方法产生MemcachedClient,并配置destroy-method进行关闭。


不过我还是疑惑,这里的异常由谁来处理?Spring容器吗? 或者需要另一个代理Bean包装一下?




有了Spring容器支持,我们不需要在代码中进行配置,也不需要重复调用build()跟shutdown()方法,这些操作交给Spring来完成。

代码如下:

  1. import static junit.framework.Assert.*;
  2. import java.util.concurrent.TimeoutException;
  3. import net.rubyeye.xmemcached.MemcachedClient;
  4. import net.rubyeye.xmemcached.exception.MemcachedException;
  5. import org.junit.Before;
  6. import org.junit.Test;
  7. import org.springframework.context.ApplicationContext;
  8. import org.springframework.context.support.ClassPathXmlApplicationContext;
  9. public class MemcachedSpringTest {
  10. private ApplicationContext app;
  11. private MemcachedClient memcachedClient;
  12. @Before
  13. public void init() {
  14. app = new ClassPathXmlApplicationContext("applicationContext.xml");
  15. memcachedClient = (MemcachedClient) app.getBean("memcachedClient");
  16. }
  17. @Test
  18. public void test() {
  19. try {
  20. // 设置/获取
  21. memcachedClient.set("zlex",
    36000,
    "set/get");
  22. assertEquals("set/get", memcachedClient.get("zlex"));
  23. // 替换
  24. memcachedClient.replace("zlex",
    36000,
    "replace");
  25. assertEquals("replace", memcachedClient.get("zlex"));
  26. // 移除
  27. memcachedClient.delete("zlex");
  28. assertNull(memcachedClient.get("zlex"));
  29. } catch (TimeoutException e) {
  30. // TODO Auto-generated catch block
  31. e.printStackTrace();
  32. } catch (InterruptedException e) {
  33. // TODO Auto-generated catch block
  34. e.printStackTrace();
  35. } catch (MemcachedException e) {
  36. // TODO Auto-generated catch block
  37. e.printStackTrace();
  38. }
  39. }
  40. }
import static junit.framework.Assert.*;

import java.util.concurrent.TimeoutException;

import net.rubyeye.xmemcached.MemcachedClient;
import net.rubyeye.xmemcached.exception.MemcachedException; import org.junit.Before;
import org.junit.Test;
import org.springframework.context.ApplicationContext;
import org.springframework.context.support.ClassPathXmlApplicationContext; public class MemcachedSpringTest { private ApplicationContext app;
private MemcachedClient memcachedClient; @Before
public void init() {
app = new ClassPathXmlApplicationContext("applicationContext.xml");
memcachedClient = (MemcachedClient) app.getBean("memcachedClient");
} @Test
public void test() {
try {
// 设置/获取
memcachedClient.set("zlex", 36000, "set/get");
assertEquals("set/get", memcachedClient.get("zlex")); // 替换
memcachedClient.replace("zlex", 36000, "replace");
assertEquals("replace", memcachedClient.get("zlex")); // 移除
memcachedClient.delete("zlex");
assertNull(memcachedClient.get("zlex"));
} catch (TimeoutException e) {
// TODO Auto-generated catch block
e.printStackTrace();
} catch (InterruptedException e) {
// TODO Auto-generated catch block
e.printStackTrace();
} catch (MemcachedException e) {
// TODO Auto-generated catch block
e.printStackTrace();
}
}
}

相关链接:

Memcached笔记——(一)安装&常规错误&监控

Memcached笔记——(二)XMemcached&Spring集成


Memcached笔记——(三)Memcached使用总结


Memcached笔记——(四)应对高并发攻击


Memcached笔记——(二)XMemcached&Spring集成的更多相关文章

  1. Memcached理解笔2---XMemcached&Spring集成

    一.Memcached Client简要介绍 Memcached Client目前有3种: Memcached Client for Java SpyMemcached XMemcached 这三种C ...

  2. 160530、memcached集群(spring集成的配置)

    第一步:在linux机或windows机上安装memcached服务端(server) linux中安装memcached:centos中命令 yum -y install memcached 如果没 ...

  3. Spring+SpringMVC+MyBatis+easyUI整合进阶篇(十二)Spring集成Redis缓存

    作者:13 GitHub:https://github.com/ZHENFENG13 版权声明:本文为原创文章,未经允许不得转载. 整合Redis 本来以为类似的Redis教程和整合代码应该会很多,因 ...

  4. mybatis笔记<二> 整合spring

    mybatis与spring整合需要添加几个jar包,mybatis-spring, spring-context, spring-jdbc 1. spring ioc只要一个jar包就ok 2. 我 ...

  5. 二)spring 集成 ehcache jgroups 集群

    依赖 <dependency> <groupId>org.springframework</groupId> <artifactId>spring-co ...

  6. 二、spring集成ibatis进行数据源事务管理拦截器环境配置

    1.dataSource-applicationContext.xml文件配置理解:(spring1.2.8+ibatis1.5.3)1.1)配置数据源 DriverManagerDataSource ...

  7. SpringBoot学习笔记二之Spring整合Mybatis

    原文链接: https://www.toutiao.com/i6803235766274097678/ 在learn-admin-component子工程中加入搭建环境所需要的具体依赖(因为比较长配置 ...

  8. Memcached笔记——(四)应对高并发攻击【转】

    http://snowolf.iteye.com/blog/1677495 近半个月过得很痛苦,主要是产品上线后,引来无数机器用户恶意攻击,不停的刷新产品各个服务入口,制造垃圾数据,消耗资源.他们的最 ...

  9. Memcached笔记——(四)应对高并发攻击

    近半个月过得很痛苦,主要是产品上线后,引来无数机器用户恶意攻击,不停的刷新产品各个服务入口,制造垃圾数据,消耗资源.他们的最好成绩,1秒钟可以并发6次,赶在Database入库前,Cache进行Mis ...

随机推荐

  1. MySQL--OPTIMIZE TABLE碎片整理

    参考:http://blog.51yip.com/mysql/1222.html BLOB和TEXT值会引起一些性能问题,特别是在执行了大量的删除操作时.删除操作会在数据表中留下很大的空洞,以后填入这 ...

  2. tif图片压缩

    tif图片在ImageIo.read获取时,返回为空,导致无法使用,百度了很久,很多人说jai可以,便去看了下,总结如下: public static void CompressPic(String ...

  3. 创建Git仓库

    创建Git仓库 一.什么是版本仓库 什么是版本库呢?版本库又名仓库,英文名repository,你可以简单理解成一个目录,这个目录里面的所有文件都可以被Git管理起来,每个文件的修改.删除,Git都能 ...

  4. OpenCV On Android环境配置最新&最全指南(Eclipse篇)

    简介 本教程是经过本人多次踩坑,并参考网上众多OpenCV On Android的配置教程总结而来,尽希望能帮助学习移动图像处理的朋友们少走弯路.这也是本人第一次在简书上发布文章,如有不足,希望各位d ...

  5. 你必须知道的基本位运算技巧(状压DP、搜索优化都会用到)

    一. 位操作基础 基本的位操作符有与.或.异或.取反.左移.右移这6种,它们的运算规则如下所示: 符号 描述 运算规则 & 与 两个位都为1时,结果才为1 | 或 两个位都为0时,结果才为0 ...

  6. [原]procexp替换任务管理器

    2019-09-14更新:本文已经在新博客重新整理发布,请各位读者移步. process explorer有个功能是替换任务管理器,它是怎么实现的呢???   windows有个注册表项HKEY_LO ...

  7. 03.pipeline实现项目自动编译docker镜像自动打包

    https://jenkins.io/zh/doc/book/pipeline/ 官方教程,可以中文.Jenkinsfile就是把pipeline内容保存到文件,然后提交到svn等版本控制库中.安装b ...

  8. mysql琐碎操作杂记

    1.索引相关 查看表索引 show index from `user` 查看sql的执行计划 explain select * from where user 2.存储过程相关 查看存储过程 show ...

  9. android viewgrop(实现了事件监听/手动滑动)

    package com.example.myviewgroup; import android.content.Context;import android.os.Handler;import and ...

  10. Android 5.0 5.1 webview 闪退问题

    自定义webview /** * 处理Android 5.0 5.1 webview 闪退 */ class MyWebView : WebView { companion object{ priva ...