http://docs.ceph.com/docs/master/radosgw/s3/objectops/#initiate-multi-part-upload

根据分片上传的API描述,因为对同一个文件需要多个upload的HTTP请求。那么很显然,存在多个RGW负载均衡的场景下,不同的HTTP请求会被负载均衡到不同的RGW上。

那么这是否会导致RGW不能把文件分片正确的合并为一个大文件的问题呢(也就是说 文件分片是否必须被上传到同一个RGW)?

验证步骤:

1. 使用 s3 java sdk 。 TransferManager.upload()方法上传大文件aws-java-sdk-1.11.69.zip

2. 查看nginx access.log 中 http请求的partNumber 分布情况, 确认是否正确负载均衡(测试场境为2个RGW组成负载均衡)

RGW1 :

113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=2 HTTP/1.1"   "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=1 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=9 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=3 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=6 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=11 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
183.2.198.253 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=18 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=14 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=12 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=20 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=19 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=25 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=27 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=29 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=24 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=32 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=30 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=33 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=40 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=36 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=41 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=43 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=47 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=42 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=46 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"

RGW2 :

113.106.251.85 - - [/Dec/::: +] "POST /my-new-bucket/aws-java-sdk-1.11.69.zip?uploads HTTP/1.1"   "-" "aw-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_part/1.11.69"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=10 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=8 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=5 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=4 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=7 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=13 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=15 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=16 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=17 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
183.2.198.253 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=23 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=22 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=26 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=21 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=28 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=35 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
183.2.198.253 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=34 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=37 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=39 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=38 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=44 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=45 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=31 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "POST /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11"

3. s3cmd ls 查看文件是否上传成功

结论: 多个RGW在负载均衡场景下,已经正确处理分片文件上传功能。

CephRGW 在多个RGW负载均衡场景下,RGW 大文件并发分片上传功能验证的更多相关文章

  1. asp.net core中负载均衡场景下http重定向https的问题

    上周欣喜地发现,微软官方终于针对 asp.net core 在使用负载均衡的情况下从 http 强制重定向至 https 的问题提供了解决方法. app.UseForwardedHeaders(new ...

  2. 负载均衡配置下的不同服务器【Linux】文件同步问题

    负载均衡配置下的不同服务器[Linux]文件同步问题2017年04月13日 22:04:28 守望dfdfdf 阅读数:2468 标签: linux负载均衡服务器 更多个人分类: 工作 问题编辑版权声 ...

  3. RGW 负载均衡和高可用的几个方案对比

    注:在RGW网关主机网卡已经是10Gb的情况下,如下三个方案没有引入LVS:如果RGW是Gb网卡,可以考虑引入LVS做流量负载均衡. RGW部署采用 fastcgi+nginx 扩展性和可配置性更强. ...

  4. Windows平台分布式架构实践 - 负载均衡(下)

    概述 我们在上一篇Windows平台分布式架构实践 - 负载均衡中讨论了Windows平台下通过NLB(Network Load Balancer) 来实现网站的负载均衡,并且通过压力测试演示了它的效 ...

  5. Windows平台下利用APM来做负载均衡方案 - 负载均衡(下)

    概述 我们在上一篇Windows平台分布式架构实践 - 负载均衡中讨论了Windows平台下通过NLB(Network Load Balancer) 来实现网站的负载均衡,并且通过压力测试演示了它的效 ...

  6. 网络负载均衡环境下wsHttpBinding+Message Security+Windows Authentication的常见异常

    提高Windows Communication Foundation (WCF) 应用程序负载能力的方法之一就是通过把它们部署到负载均衡的服务器场中. 其中可以使用标准的负载均衡技术, Windows ...

  7. logstash+redis收集负载均衡模式下多台服务器的多个web日志

    一.logstash的简介 一般我们看日志来解决问题的时候要么 tail+grep 要么 把日志下载下来再搜索,可以应付不多的主机和应用不多的部署场景.但对于多机多应用部署就不合适了.这里的多机多应用 ...

  8. 【转载】Windows平台下利用APM来做负载均衡方案 - 负载均衡(下)

    概述 我们在上一篇Windows平台分布式架构实践 - 负载均衡中讨论了Windows平台下通过NLB(Network Load Balancer) 来实现网站的负载均衡,并且通过压力测试演示了它的效 ...

  9. .Net微服务实战之负载均衡(下)

    系列文章 .Net微服务实战之技术选型篇 .Net微服务实战之技术架构分层篇 .Net微服务实战之DevOps篇 .Net微服务实战之负载均衡(上) .Net微服务实战之CI/CD .Net微服务实战 ...

随机推荐

  1. 第二篇 Entity Framework Plus 之 Query Future

    从性能的角度出发,能够减少 增,删,改,查,跟数据库打交道次数,肯定是对性能会有所提升的(这里单纯是数据库部分). 今天主要怎样减少Entity Framework查询跟数据库打交道的次数,来提高查询 ...

  2. Java transient关键字

    Volatile修饰的成员变量在每次被线程访问时,都强迫从主内存中重读该成员变量的值.而且,当成员变量发生变化时,强迫线程将变化值回写到主内存.这样在任何时刻,两个不同的线程总是看到某个成员变量的同一 ...

  3. android Fragments介绍

    Fragments是Android3.0引入的概念,译为片段.碎片,为了解决不同屏幕分辩率的动态和灵活UI设计. Fragment表现Activity中UI的一个行为或者一部分.可以将多个fragme ...

  4. iOS 升级HTTPS通过ATS你所要知道的

    由于苹果规定2017年1月1日以后,所有APP都要使用HTTPS进行网络请求,否则无法上架,因此研究了一下在iOS中使用HTTPS请求的实现.网上搜索了一些比较有用资料,大家可以参考下 苹果强制升级的 ...

  5. webView 自适应高度 document.body 属性

    前段时间开发遇到webView 高度自适应问题,用最初的方法无效,找了些资料,记录下. 1.若网页中含有< !DOCTYPE html PUBLIC "-//W3C//DTD XHTM ...

  6. linux shell程序

    shell程序介绍 1.查看我们的Linux(centos6.5为例)有多少我们可以使用的shell: [root@localhost bin]# cat /etc/shells /bin/sh /b ...

  7. 使用c/c++扩展python

    用python脚本写应用比较方便,但有时候由于种种原因需要扩展python(比如给程序提供python接口等). 之前一直想整理下,今天终于坐下来把这件事情给做了,这里记录下,也方便我以后查阅. 说明 ...

  8. 前端开发---ppt展示页面评论区展示

    1. 工程地址:https://github.com/digitalClass/web_page 网站发布地址: http://115.28.30.25:8029/ 2. 由于后端同学希望按照 sta ...

  9. Html --用简单的<hr>实现多样化分割效果

    最基本的:<hr width=300 size=1 color=#5151A2 align=center noshade>. <!--其中 width 规定线条的长度,还可以是百分比 ...

  10. PHP语法(三):控制结构(For循环/If/Switch/While)

    相关链接: PHP语法(一):基础和变量 PHP语法(二):数据类型.运算符和函数 PHP语法(三):控制结构(For循环/If/Switch/While) 本文我来总结几个PHP常用的控制结构,先来 ...