CephRGW 在多个RGW负载均衡场景下,RGW 大文件并发分片上传功能验证
http://docs.ceph.com/docs/master/radosgw/s3/objectops/#initiate-multi-part-upload
根据分片上传的API描述,因为对同一个文件需要多个upload的HTTP请求。那么很显然,存在多个RGW负载均衡的场景下,不同的HTTP请求会被负载均衡到不同的RGW上。
那么这是否会导致RGW不能把文件分片正确的合并为一个大文件的问题呢(也就是说 文件分片是否必须被上传到同一个RGW)?
验证步骤:
1. 使用 s3 java sdk 。 TransferManager.upload()方法上传大文件aws-java-sdk-1.11.69.zip

2. 查看nginx access.log 中 http请求的partNumber 分布情况, 确认是否正确负载均衡(测试场境为2个RGW组成负载均衡)
RGW1 :
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=2 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=1 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=9 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=3 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=6 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=11 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
183.2.198.253 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=18 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=14 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=12 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=20 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=19 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=25 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=27 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=29 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=24 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=32 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=30 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=33 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=40 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=36 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=41 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=43 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=47 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=42 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=46 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
RGW2 :
113.106.251.85 - - [/Dec/::: +] "POST /my-new-bucket/aws-java-sdk-1.11.69.zip?uploads HTTP/1.1" "-" "aw-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_part/1.11.69"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=10 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=8 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=5 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=4 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=7 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=13 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=15 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=16 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=17 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
183.2.198.253 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=23 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=22 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=26 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=21 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=28 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=35 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
183.2.198.253 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=34 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=37 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=39 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=38 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=44 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=45 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=31 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "POST /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11"
3. s3cmd ls 查看文件是否上传成功

结论: 多个RGW在负载均衡场景下,已经正确处理分片文件上传功能。
CephRGW 在多个RGW负载均衡场景下,RGW 大文件并发分片上传功能验证的更多相关文章
- asp.net core中负载均衡场景下http重定向https的问题
上周欣喜地发现,微软官方终于针对 asp.net core 在使用负载均衡的情况下从 http 强制重定向至 https 的问题提供了解决方法. app.UseForwardedHeaders(new ...
- 负载均衡配置下的不同服务器【Linux】文件同步问题
负载均衡配置下的不同服务器[Linux]文件同步问题2017年04月13日 22:04:28 守望dfdfdf 阅读数:2468 标签: linux负载均衡服务器 更多个人分类: 工作 问题编辑版权声 ...
- RGW 负载均衡和高可用的几个方案对比
注:在RGW网关主机网卡已经是10Gb的情况下,如下三个方案没有引入LVS:如果RGW是Gb网卡,可以考虑引入LVS做流量负载均衡. RGW部署采用 fastcgi+nginx 扩展性和可配置性更强. ...
- Windows平台分布式架构实践 - 负载均衡(下)
概述 我们在上一篇Windows平台分布式架构实践 - 负载均衡中讨论了Windows平台下通过NLB(Network Load Balancer) 来实现网站的负载均衡,并且通过压力测试演示了它的效 ...
- Windows平台下利用APM来做负载均衡方案 - 负载均衡(下)
概述 我们在上一篇Windows平台分布式架构实践 - 负载均衡中讨论了Windows平台下通过NLB(Network Load Balancer) 来实现网站的负载均衡,并且通过压力测试演示了它的效 ...
- 网络负载均衡环境下wsHttpBinding+Message Security+Windows Authentication的常见异常
提高Windows Communication Foundation (WCF) 应用程序负载能力的方法之一就是通过把它们部署到负载均衡的服务器场中. 其中可以使用标准的负载均衡技术, Windows ...
- logstash+redis收集负载均衡模式下多台服务器的多个web日志
一.logstash的简介 一般我们看日志来解决问题的时候要么 tail+grep 要么 把日志下载下来再搜索,可以应付不多的主机和应用不多的部署场景.但对于多机多应用部署就不合适了.这里的多机多应用 ...
- 【转载】Windows平台下利用APM来做负载均衡方案 - 负载均衡(下)
概述 我们在上一篇Windows平台分布式架构实践 - 负载均衡中讨论了Windows平台下通过NLB(Network Load Balancer) 来实现网站的负载均衡,并且通过压力测试演示了它的效 ...
- .Net微服务实战之负载均衡(下)
系列文章 .Net微服务实战之技术选型篇 .Net微服务实战之技术架构分层篇 .Net微服务实战之DevOps篇 .Net微服务实战之负载均衡(上) .Net微服务实战之CI/CD .Net微服务实战 ...
随机推荐
- 兼容SQLSERVER、Oracle、MYSQL、SQLITE的超级DBHelper
本示例代码的关键是利用.net库自带的DbProviderFactory来生产数据库操作对象. 从下图中,可以看到其的多个核心方法,这些方法将在我们的超级DBHelper中使用. 仔细研究,你会发现每 ...
- 如何在SpringBoot中使用JSP ?但强烈不推荐,果断改Themeleaf吧
做WEB项目,一定都用过JSP这个大牌.Spring MVC里面也可以很方便的将JSP与一个View关联起来,使用还是非常方便的.当你从一个传统的Spring MVC项目转入一个Spring Boot ...
- python之最强王者(11)——异常(exception)
1.Python 异常处理 python提供了两个非常重要的功能来处理python程序在运行中出现的异常和错误.你可以使用该功能来调试python程序. 异常处理: 本站Python教程会具体介绍. ...
- mysql 用户管理和权限设置
用户管理 mysql>use mysql; 查看 mysql> select host,user,password from user ; 创建 mysql> create user ...
- GJM : Unity3D HIAR 目录导航
感谢您的阅读.喜欢的.有用的就请大哥大嫂们高抬贵手"推荐一下"吧!你的精神支持是博主强大的写作动力以及转载收藏动力.欢迎转载! 版权声明:本文原创发表于 [请点击连接前往] ,未经 ...
- 【原】JAVA开发环境搭建
1.JDK下载并安装,以jdk-7u45-windows-i586.exe为例(注意JDK的安装和JRE的安装是分开的) 2.“我的电脑”右键属性,找到“高级系统设置”,找到“高级”tab下的“环境变 ...
- 【IOS开发笔记02】学生管理系统
端到端的机会 虽然现在身处大公司,但是因为是内部创业团队,产品.native.前端.服务器端全部坐在一起开发,大家很容易做零距离交流,也因为最近内部有一个前端要转岗过来,于是手里的前端任务好像可以抛一 ...
- JavaScript执行环境
执行环境(Execution Context,也称为"执行上下文")是JavaScript中最为重要的一个概念.执行环境定义了变量或函数有权访问的其它数据,决定了各自的行为.当Ja ...
- Javascript绝不要使用在文档加载之后使用 document.write(), 怎么理解?
在文档加载之后使用 document.write(),会覆盖该文档. 需满足两个条件: 1.在函数内部调用document.write(): 2.通过按钮响应调用函数: 举 ...
- iOS xml文件的解析方式 XMLDictionary,GDataXMLNode,NSXMLParser
iOS9之后,默认网络请求是https,所有我们要设置一下网络安全,具体设置如下 1.第三方类库 XMLDictionary 下载地址: https://github.com/nicklockwood ...