CephRGW 在多个RGW负载均衡场景下,RGW 大文件并发分片上传功能验证
http://docs.ceph.com/docs/master/radosgw/s3/objectops/#initiate-multi-part-upload
根据分片上传的API描述,因为对同一个文件需要多个upload的HTTP请求。那么很显然,存在多个RGW负载均衡的场景下,不同的HTTP请求会被负载均衡到不同的RGW上。
那么这是否会导致RGW不能把文件分片正确的合并为一个大文件的问题呢(也就是说 文件分片是否必须被上传到同一个RGW)?
验证步骤:
1. 使用 s3 java sdk 。 TransferManager.upload()方法上传大文件aws-java-sdk-1.11.69.zip

2. 查看nginx access.log 中 http请求的partNumber 分布情况, 确认是否正确负载均衡(测试场境为2个RGW组成负载均衡)
RGW1 :
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=2 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=1 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=9 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=3 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=6 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=11 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
183.2.198.253 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=18 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=14 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=12 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=20 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=19 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=25 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=27 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=29 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=24 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=32 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=30 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=33 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=40 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=36 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=41 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=43 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=47 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=42 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=46 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
RGW2 :
113.106.251.85 - - [/Dec/::: +] "POST /my-new-bucket/aws-java-sdk-1.11.69.zip?uploads HTTP/1.1" "-" "aw-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_part/1.11.69"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=10 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=8 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=5 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=4 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=7 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=13 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=15 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=16 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=17 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
183.2.198.253 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=23 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=22 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=26 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=21 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=28 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=35 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
183.2.198.253 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=34 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=37 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=39 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=38 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=44 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=45 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=31 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "POST /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11"
3. s3cmd ls 查看文件是否上传成功

结论: 多个RGW在负载均衡场景下,已经正确处理分片文件上传功能。
CephRGW 在多个RGW负载均衡场景下,RGW 大文件并发分片上传功能验证的更多相关文章
- asp.net core中负载均衡场景下http重定向https的问题
上周欣喜地发现,微软官方终于针对 asp.net core 在使用负载均衡的情况下从 http 强制重定向至 https 的问题提供了解决方法. app.UseForwardedHeaders(new ...
- 负载均衡配置下的不同服务器【Linux】文件同步问题
负载均衡配置下的不同服务器[Linux]文件同步问题2017年04月13日 22:04:28 守望dfdfdf 阅读数:2468 标签: linux负载均衡服务器 更多个人分类: 工作 问题编辑版权声 ...
- RGW 负载均衡和高可用的几个方案对比
注:在RGW网关主机网卡已经是10Gb的情况下,如下三个方案没有引入LVS:如果RGW是Gb网卡,可以考虑引入LVS做流量负载均衡. RGW部署采用 fastcgi+nginx 扩展性和可配置性更强. ...
- Windows平台分布式架构实践 - 负载均衡(下)
概述 我们在上一篇Windows平台分布式架构实践 - 负载均衡中讨论了Windows平台下通过NLB(Network Load Balancer) 来实现网站的负载均衡,并且通过压力测试演示了它的效 ...
- Windows平台下利用APM来做负载均衡方案 - 负载均衡(下)
概述 我们在上一篇Windows平台分布式架构实践 - 负载均衡中讨论了Windows平台下通过NLB(Network Load Balancer) 来实现网站的负载均衡,并且通过压力测试演示了它的效 ...
- 网络负载均衡环境下wsHttpBinding+Message Security+Windows Authentication的常见异常
提高Windows Communication Foundation (WCF) 应用程序负载能力的方法之一就是通过把它们部署到负载均衡的服务器场中. 其中可以使用标准的负载均衡技术, Windows ...
- logstash+redis收集负载均衡模式下多台服务器的多个web日志
一.logstash的简介 一般我们看日志来解决问题的时候要么 tail+grep 要么 把日志下载下来再搜索,可以应付不多的主机和应用不多的部署场景.但对于多机多应用部署就不合适了.这里的多机多应用 ...
- 【转载】Windows平台下利用APM来做负载均衡方案 - 负载均衡(下)
概述 我们在上一篇Windows平台分布式架构实践 - 负载均衡中讨论了Windows平台下通过NLB(Network Load Balancer) 来实现网站的负载均衡,并且通过压力测试演示了它的效 ...
- .Net微服务实战之负载均衡(下)
系列文章 .Net微服务实战之技术选型篇 .Net微服务实战之技术架构分层篇 .Net微服务实战之DevOps篇 .Net微服务实战之负载均衡(上) .Net微服务实战之CI/CD .Net微服务实战 ...
随机推荐
- WinForm拖动没有标题栏窗体的方法
建立窗体的名称修改为:Form_HoverTree 文后附有源码下载. 主要代码: Point _HoverTreePosition; public Form_HoverTree() { Initia ...
- 如何写出安全的API接口?接口参数加密签名设计思路
开发中经常用到接口,尤其是在面向服务的soa架构中,数据交互全是用的接口. 几年以前我认为,我写个接口,不向任何人告知我的接口地址,我的接口就是安全的,现在回想真是too young,too simp ...
- 利用TortoiseSVN获取最新版本的OpenCV源码
转自: http://blog.csdn.net/vsooda/article/details/7555969 1.下载安装TortoiseSVN:http://tortoisesvn.net/dow ...
- ABP Zero示例项目登录报错“Empty or invalid anti forgery header token.”问题解决
ABP Zero项目,登录时出现如图"Empty or invalid anti forgery header token."错误提示的解决方法: 在 WebModule.cs的P ...
- ThinkPHP 整合Bootstrap Ajax分页
ThinkPHP Ajax分页代码 publicfunction index() { $where=array(); $name = I('name'); if(!empty($name)){ $wh ...
- MS SQL按IN()内容排序
需求:MMSQL查询结果,按查询条件中关键字IN内的列举信息的顺序一一对应排序. 分析:使用CHARINDEX 函数. 解决方法: SELECT * FROM Product WHERE 1=1 AN ...
- IIS服务器和xampp中的appche服务器端口冲突解决办法
今天在启动xampp中的appche的时候,发现以前能起来的现在起不来了.想到可能是最近配置的系统自带的IIS服务器把appche的端口给占用了. (appche和iis的默认端口号都是:80:) 问 ...
- android universal-image-loader的使用
全局配置 android-image-loader的使用 public class Application extends Application { @Override public void on ...
- H5 表格标签基本使用
<!DOCTYPE html><html lang="en"><head> <meta charset="UTF-8" ...
- sublime text 输入法候选词不跟随光标
可以使用imesupport 插件解决 百度 : 搜狗 sublime 不跟 光标 找到这篇文章, 原始作者 http://qianduanblog.com/post/sublime-text-3-p ...