Tomcat反带和集群

Nginx|Apache反带用户请求到Tomcat

• LNMT：

client -->http --> nginx --> reverse_proxy --> http --> tomcat (http connector)

location ~* \.(jsp|do)$ {
proxy_pass http://web1.evescn.com:8080;
}

　　

• LAMT：

client --> http --> httpd --> reverse_proxy --> {http|ajp} --> tomcat {http connector|ajp connector}

　　

反代模块：
    主：proxy_module
    子：proxy_module_http, proxy_module_ajp

　　

proxy_module_http:
    <VirtualHost *:80>
        ServerName web1.evescn.com
        ProxyVia On
        ProxyRequests Off    # 开启反向代理时，需要关闭正向代理
        ProxyPreserveHost On # 直接反带用户请求的虚拟主机名
        <Proxy *>
            Require all granted
        </Proxy>
        ProxyPass / http://172.16.100.67:8080/
        ProxyPassReverse / http://172.16.100.67:8080/
        <Location />
            Require all granted
        </Location>
    </VirtualHost>

　　

proxy_module_ajp:
    <VirtualHost *:80>
        ServerName web1.evescn.com
        ProxyVia On
        ProxyRequests Off
        ProxyPreserveHost On
        <Proxy *>
            Require all granted
        </Proxy>
        ProxyPass /status !
        ProxyPass / ajp://172.16.100.67:8009/
        ProxyPassReverse / ajp://172.16.100.67:8009/
        <Location />
            Require all granted
        </Location>
    </VirtualHost>

　　

• LNAMT：

client -->http --> nginx -->  httpd --> reverse_proxy --> {http|ajp} --> tomcat {http connector|ajp connector}

　　

Tomcat会话保持

session sticky
    source ip
    cookie
session cluster:
session server
    kv: memcached, redis

　　

Tomcat集群

• (1) LB tomcat

nginx tomcats （upsteam模块）
apache tomcats　　

• (2) LB tomcat cluster
• (3) LB tomcat

session server
    memcached

　　

• apache: tomcats

(1) apache:
        mod_proxy
        mod_proxy_http
        mod_proxy_balancer

    tomcat:
        http connector
(2) apache:
        mod_proxy
        mod_proxy_ajp
        mod_proxy_balancer
    tomcat:
        ajp connector
(3) apache:
        mod_jk
    tomcat:
        ajp connector

　　

• 第一种方法的实现：

<proxy balancer://lbcluster1>
    BalancerMember http://172.16.100.68:8080 loadfactor=10 route=TomcatA
    BalancerMember http://172.16.100.69:8080 loadfactor=10 route=TomcatB
</proxy>

<VirtualHost *:80>
    ServerName web1.evescn.com
    ProxyVia On
    ProxyRequests Off
    ProxyPreserveHost On
    <Proxy *>
        Require all granted
    </Proxy>
    ProxyPass / balancer://lbcluster1/
    ProxyPassReverse / balancer://lbcluster1/
    <Location />
        Require all granted
    </Location>
</VirtualHost>

　　如果需要会话绑定：

Header add Set-Cookie "ROUTEID=.%{BALANCER_WORKER_ROUTE}e; path=/" env=BALANCER_ROUTE_CHANGED
<proxy balancer://lbcluster1>
    BalancerMember http://172.16.100.68:8080 loadfactor=10 route=TomcatA
    BalancerMember http://172.16.100.69:8080 loadfactor=10 route=TomcatB
	ProxySet stickysession=ROUTEID
</proxy>

<VirtualHost *:80>
    ServerName web1.evescn.com
    ProxyVia On
    ProxyRequests Off
    ProxyPreserveHost On
    <Proxy *>
        Require all granted
    </Proxy>
    ProxyPass / balancer://lbcluster1/
    ProxyPassReverse / balancer://lbcluster1/
    <Location />
        Require all granted
    </Location>
</VirtualHost>

　　

• 第二种方法的实现：

#Header add Set-Cookie "ROUTEID=.%{BALANCER_WORKER_ROUTE}e; path=/" env=BALANCER_ROUTE_CHANGED
<proxy balancer://lbcluster1>
    BalancerMember ajp://172.16.100.68:8009 loadfactor=10 route=TomcatA
    BalancerMember ajp://172.16.100.69:8009 loadfactor=10 route=TomcatB
    ProxySet stickysession=ROUTEID
</proxy>

<VirtualHost *:80>
    ServerName web1.evescn.com
    ProxyVia On
    ProxyRequests Off
    ProxyPreserveHost On
    <Proxy *>
        Require all granted
    </Proxy>
    ProxyPass / balancer://lbcluster1/
    ProxyPassReverse / balancer://lbcluster1/
    <Location />
        Require all granted
    </Location>
</VirtualHost>

　　

• 补充:mod_proxy_balancer模块内置的manager：

<Location /balancer-manager>
	SetHandler balancer-manager
	Proxypass !
	Order Deny,Allow
	Allow from all
</Location>

　　

• 第三种方式：

mod_jk：额外编译安装

　　

(1) 反向代理
	模块配置文件：mod_jk.conf
		LoadModule  jk_module  modules/mod_jk.so
		JkWorkersFile  /etc/httpd/conf.d/workers.properties
		JkLogFile  logs/mod_jk.log
		JkLogLevel  debug
		JkMount  /*  TomcatA
		JkMount  /status/  stat1

	workers配置文件：workers.properties
		worker.list=TomcatA,stat1
		worker.TomcatA.port=8009
		worker.TomcatA.host=172.16.100.68
		worker.TomcatA.type=ajp13
		worker.TomcatA.lbfactor=1
		worker.stat1.type = status

	注意：status的访问要做访问控制；

　　

(2) 负载均衡
	模块配置文件：mod_jk.conf
		LoadModule  jk_module  modules/mod_jk.so
		JkWorkersFile  /etc/httpd/conf.d/workers.properties
		JkLogFile  logs/mod_jk.log
		JkLogLevel  debug
		JkMount  /*  lbcluster1
		JkMount  /status/  stat1

	workers配置文件：workers.properties
		worker.list = lbcluster1,stat1
		worker.TomcatA.type = ajp13
		worker.TomcatA.host = 172.16.100.68
		worker.TomcatA.port = 8009
		worker.TomcatA.lbfactor = 1
		worker.TomcatB.type = ajp13
		worker.TomcatB.host = 172.16.100.69
		worker.TomcatB.port = 8009
		worker.TomcatB.lbfactor = 1
		worker.lbcluster1.type = lb
		worker.lbcluster1.sticky_session = 0
		worker.lbcluster1.balance_workers = TomcatA, TomcatB
		worker.stat1.type = status

　　

• Session Cluster：

session manager：会话管理器

    StandardManager
    PersistentManager：
    FileStore
    JDBC
    DeltaManager
    BackupManager

　　

构建步骤：
(1) 各节点配置使用deltamaanager：
    <Cluster className="org.apache.catalina.ha.tcp.SimpleTcpCluster"
                 channelSendOptions="8">

          <Manager className="org.apache.catalina.ha.session.DeltaManager"
                   expireSessionsOnShutdown="false"
                   notifyListenersOnReplication="true"/>

          <Channel className="org.apache.catalina.tribes.group.GroupChannel">
            <Membership className="org.apache.catalina.tribes.membership.McastService"
                        address="228.0.1.7"
                        port="45564"
                        frequency="500"
                        dropTime="3000"/>
            <Receiver className="org.apache.catalina.tribes.transport.nio.NioReceiver"
                      address="auto"
                      port="4000"
                      autoBind="100"
                      selectorTimeout="5000"
                      maxThreads="6"/>

            <Sender className="org.apache.catalina.tribes.transport.ReplicationTransmitter">
              <Transport className="org.apache.catalina.tribes.transport.nio.PooledParallelSender"/>
            </Sender>
            <Interceptor className="org.apache.catalina.tribes.group.interceptors.TcpFailureDetector"/>
            <Interceptor className="org.apache.catalina.tribes.group.interceptors.MessageDispatch15Interceptor"/>
          </Channel>

          <Valve className="org.apache.catalina.ha.tcp.ReplicationValve"
                 filter=""/>
          <Valve className="org.apache.catalina.ha.session.JvmRouteBinderValve"/>

          <Deployer className="org.apache.catalina.ha.deploy.FarmWarDeployer"
                    tempDir="/tmp/war-temp/"
                    deployDir="/tmp/war-deploy/"
                    watchDir="/tmp/war-listen/"
                    watchEnabled="false"/>

          <ClusterListener className="org.apache.catalina.ha.session.ClusterSessionListener"/>
    </Cluster>

(2) 为需要使用session cluster的webapps开启session distribution的功能：
   	WEB-INF/web.xml中添加
   		<distributable/>