CephRGW 在多个RGW负载均衡场景下,RGW 大文件并发分片上传功能验证
http://docs.ceph.com/docs/master/radosgw/s3/objectops/#initiate-multi-part-upload
根据分片上传的API描述,因为对同一个文件需要多个upload的HTTP请求。那么很显然,存在多个RGW负载均衡的场景下,不同的HTTP请求会被负载均衡到不同的RGW上。
那么这是否会导致RGW不能把文件分片正确的合并为一个大文件的问题呢(也就是说 文件分片是否必须被上传到同一个RGW)?
验证步骤:
1. 使用 s3 java sdk 。 TransferManager.upload()方法上传大文件aws-java-sdk-1.11.69.zip

2. 查看nginx access.log 中 http请求的partNumber 分布情况, 确认是否正确负载均衡(测试场境为2个RGW组成负载均衡)
RGW1 :
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=2 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=1 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=9 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=3 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=6 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=11 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
183.2.198.253 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=18 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=14 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=12 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=20 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=19 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=25 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=27 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=29 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=24 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=32 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=30 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=33 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=40 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=36 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=41 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=43 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=47 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=42 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=46 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
RGW2 :
113.106.251.85 - - [/Dec/::: +] "POST /my-new-bucket/aws-java-sdk-1.11.69.zip?uploads HTTP/1.1" "-" "aw-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_part/1.11.69"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=10 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=8 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=5 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=4 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=7 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=13 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=15 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=16 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=17 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
183.2.198.253 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=23 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=22 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=26 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=21 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=28 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=35 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
183.2.198.253 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=34 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=37 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=39 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=38 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=44 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=45 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=31 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "POST /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11"
3. s3cmd ls 查看文件是否上传成功

结论: 多个RGW在负载均衡场景下,已经正确处理分片文件上传功能。
CephRGW 在多个RGW负载均衡场景下,RGW 大文件并发分片上传功能验证的更多相关文章
- asp.net core中负载均衡场景下http重定向https的问题
上周欣喜地发现,微软官方终于针对 asp.net core 在使用负载均衡的情况下从 http 强制重定向至 https 的问题提供了解决方法. app.UseForwardedHeaders(new ...
- 负载均衡配置下的不同服务器【Linux】文件同步问题
负载均衡配置下的不同服务器[Linux]文件同步问题2017年04月13日 22:04:28 守望dfdfdf 阅读数:2468 标签: linux负载均衡服务器 更多个人分类: 工作 问题编辑版权声 ...
- RGW 负载均衡和高可用的几个方案对比
注:在RGW网关主机网卡已经是10Gb的情况下,如下三个方案没有引入LVS:如果RGW是Gb网卡,可以考虑引入LVS做流量负载均衡. RGW部署采用 fastcgi+nginx 扩展性和可配置性更强. ...
- Windows平台分布式架构实践 - 负载均衡(下)
概述 我们在上一篇Windows平台分布式架构实践 - 负载均衡中讨论了Windows平台下通过NLB(Network Load Balancer) 来实现网站的负载均衡,并且通过压力测试演示了它的效 ...
- Windows平台下利用APM来做负载均衡方案 - 负载均衡(下)
概述 我们在上一篇Windows平台分布式架构实践 - 负载均衡中讨论了Windows平台下通过NLB(Network Load Balancer) 来实现网站的负载均衡,并且通过压力测试演示了它的效 ...
- 网络负载均衡环境下wsHttpBinding+Message Security+Windows Authentication的常见异常
提高Windows Communication Foundation (WCF) 应用程序负载能力的方法之一就是通过把它们部署到负载均衡的服务器场中. 其中可以使用标准的负载均衡技术, Windows ...
- logstash+redis收集负载均衡模式下多台服务器的多个web日志
一.logstash的简介 一般我们看日志来解决问题的时候要么 tail+grep 要么 把日志下载下来再搜索,可以应付不多的主机和应用不多的部署场景.但对于多机多应用部署就不合适了.这里的多机多应用 ...
- 【转载】Windows平台下利用APM来做负载均衡方案 - 负载均衡(下)
概述 我们在上一篇Windows平台分布式架构实践 - 负载均衡中讨论了Windows平台下通过NLB(Network Load Balancer) 来实现网站的负载均衡,并且通过压力测试演示了它的效 ...
- .Net微服务实战之负载均衡(下)
系列文章 .Net微服务实战之技术选型篇 .Net微服务实战之技术架构分层篇 .Net微服务实战之DevOps篇 .Net微服务实战之负载均衡(上) .Net微服务实战之CI/CD .Net微服务实战 ...
随机推荐
- C# WCF服务端搭建和客户端调用
1) 打开Visual Studio 2012,在菜单上点击文件->新建->项目->WCF服务应用程序.在弹出界面的"名称"对应的文本框中输入"WcfS ...
- Jedis的使用
Redis是常用的key-value存储服务器,Java使用Redis有很多方法,其中官方推荐的是Jedis. 使用Jedis,首先是下载jedis-x.x.x.jar文件并导入工程,然后运行Redi ...
- POI操作Excel
POI和Excel简介 JAVA中操作Excel的有两种比较主流的工具包: JXL 和 POI .jxl 只能操作Excel 95, 97, 2000也即以.xls为后缀的excel.而poi可以操作 ...
- ASP.NET中后台数据和前台控件的绑定
关于ASP.NET中后台数据库和前台的数据控件的绑定问题 最近一直在学习个知识点,自己创建了SQL Server数据库表,想在ASP.NET中连接数据库,并把数据库中的数据显示在前台,注意,这里的数据 ...
- HTML5 Canvas绘制转盘抽奖
新项目:完整的Canvas转盘抽奖代码 https://github.com/givebest/GB-canvas-turntable 演示 http://blog.givebest.cn/GB-ca ...
- 通过Wireshark抓包进行Cookie劫持
首先在目标A机器上运行Wireshark并开启浏览器,开启前关闭其他占用网络的软件,这里我拿51CTO.com做测试. 正常登陆51CTO用户中心,此时使用 http.cookie and http. ...
- 使用Kotlin对ViewGroup的视图进行函数使操作
原文标题:Functional operations over Views in ViewGroup using Kotlin 原文链接:http://antonioleiva.com/functio ...
- RecyclerView 的介绍以及多布局的实例
RecyclerView 的使用以及多布局的实例 RecyclerView 是在Android5.0之后推出的,是一个比ListView更加灵活更加高效的适配器类型控件.但是RecyclerView不 ...
- ISP路由表分发中的AS与BGP
➠更多技术干货请戳:听云博客 摘要 本文面向,初级网络工程师,数据挖掘工程师,涉及EGP(外部网关协议; Exterior Gateway Protocol),IGP(内部网关协议; Interior ...
- android textview 自动换行 整齐排版
一.问题在哪里? textview显示长文字时会进行自动折行,如果遇到一些特殊情况,自动折行会杯具成这个样子: 上述特殊情况包括: 1)全角/半角符号混排(一般是数字.字母.汉字混排) 2)全角/半角 ...