CephRGW 在多个RGW负载均衡场景下,RGW 大文件并发分片上传功能验证
http://docs.ceph.com/docs/master/radosgw/s3/objectops/#initiate-multi-part-upload
根据分片上传的API描述,因为对同一个文件需要多个upload的HTTP请求。那么很显然,存在多个RGW负载均衡的场景下,不同的HTTP请求会被负载均衡到不同的RGW上。
那么这是否会导致RGW不能把文件分片正确的合并为一个大文件的问题呢(也就是说 文件分片是否必须被上传到同一个RGW)?
验证步骤:
1. 使用 s3 java sdk 。 TransferManager.upload()方法上传大文件aws-java-sdk-1.11.69.zip
2. 查看nginx access.log 中 http请求的partNumber 分布情况, 确认是否正确负载均衡(测试场境为2个RGW组成负载均衡)
RGW1 :
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=2 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=1 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=9 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=3 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=6 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=11 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
183.2.198.253 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=18 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=14 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=12 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=20 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=19 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=25 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=27 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=29 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=24 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=32 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=30 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=33 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=40 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=36 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=41 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=43 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=47 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=42 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=46 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
RGW2 :
113.106.251.85 - - [/Dec/::: +] "POST /my-new-bucket/aws-java-sdk-1.11.69.zip?uploads HTTP/1.1" "-" "aw-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_part/1.11.69"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=10 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=8 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=5 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=4 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=7 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 comonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=13 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=15 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHDr7Tu&partNumber=16 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 cozonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=17 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
183.2.198.253 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=23 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=22 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=26 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=21 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=28 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=35 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
183.2.198.253 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
10.25.195.3 - - [/Dec/::: +] "GET / HTTP/1.1" "-" "Zabbix"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=34 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=37 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=39 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=38 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=44 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=45 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "PUT /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu&partNumber=31 HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11 com.amazonaws.services.s3.transfer.TransferManager_multipart/1.11.69"
113.106.251.85 - - [/Dec/::: +] "POST /my-new-bucket/aws-java-sdk-1.11.69.zip?uploadId=2%7EF5IExqk7TopXwLcATEkUHcp_GJDr7Tu HTTP/1.1" "-" "aws-sdk-java/1.11.69 Windows_8.1/6.3 Java_HotSpot(TM)_Client_VM/25.11-b03/1.8.0_11"
3. s3cmd ls 查看文件是否上传成功
结论: 多个RGW在负载均衡场景下,已经正确处理分片文件上传功能。
CephRGW 在多个RGW负载均衡场景下,RGW 大文件并发分片上传功能验证的更多相关文章
- asp.net core中负载均衡场景下http重定向https的问题
上周欣喜地发现,微软官方终于针对 asp.net core 在使用负载均衡的情况下从 http 强制重定向至 https 的问题提供了解决方法. app.UseForwardedHeaders(new ...
- 负载均衡配置下的不同服务器【Linux】文件同步问题
负载均衡配置下的不同服务器[Linux]文件同步问题2017年04月13日 22:04:28 守望dfdfdf 阅读数:2468 标签: linux负载均衡服务器 更多个人分类: 工作 问题编辑版权声 ...
- RGW 负载均衡和高可用的几个方案对比
注:在RGW网关主机网卡已经是10Gb的情况下,如下三个方案没有引入LVS:如果RGW是Gb网卡,可以考虑引入LVS做流量负载均衡. RGW部署采用 fastcgi+nginx 扩展性和可配置性更强. ...
- Windows平台分布式架构实践 - 负载均衡(下)
概述 我们在上一篇Windows平台分布式架构实践 - 负载均衡中讨论了Windows平台下通过NLB(Network Load Balancer) 来实现网站的负载均衡,并且通过压力测试演示了它的效 ...
- Windows平台下利用APM来做负载均衡方案 - 负载均衡(下)
概述 我们在上一篇Windows平台分布式架构实践 - 负载均衡中讨论了Windows平台下通过NLB(Network Load Balancer) 来实现网站的负载均衡,并且通过压力测试演示了它的效 ...
- 网络负载均衡环境下wsHttpBinding+Message Security+Windows Authentication的常见异常
提高Windows Communication Foundation (WCF) 应用程序负载能力的方法之一就是通过把它们部署到负载均衡的服务器场中. 其中可以使用标准的负载均衡技术, Windows ...
- logstash+redis收集负载均衡模式下多台服务器的多个web日志
一.logstash的简介 一般我们看日志来解决问题的时候要么 tail+grep 要么 把日志下载下来再搜索,可以应付不多的主机和应用不多的部署场景.但对于多机多应用部署就不合适了.这里的多机多应用 ...
- 【转载】Windows平台下利用APM来做负载均衡方案 - 负载均衡(下)
概述 我们在上一篇Windows平台分布式架构实践 - 负载均衡中讨论了Windows平台下通过NLB(Network Load Balancer) 来实现网站的负载均衡,并且通过压力测试演示了它的效 ...
- .Net微服务实战之负载均衡(下)
系列文章 .Net微服务实战之技术选型篇 .Net微服务实战之技术架构分层篇 .Net微服务实战之DevOps篇 .Net微服务实战之负载均衡(上) .Net微服务实战之CI/CD .Net微服务实战 ...
随机推荐
- Entity Framework Extended Library
扩展了实体框架的功能类库. https://github.com/loresoft/EntityFramework.Extended 1批量更新/删除 1)删除 //delete all users ...
- jQuery+CSS3文字跑马灯特效
jQuery+CSS3文字跑马灯特效是一款将跑马灯背景制作为3D立方体效果,文字在上面移动时,就像是文字投影到墙壁上,在转角出会改变运动方向. 效果展示 http://hovertree.com/te ...
- ASP.NET从MVC5升级到MVC6 RC2 总目录 - 发布在RC2Release之后
序言 随着MVC6RC2的推出,MVC6的脚步越来越近了.但是在我们的手里,有大批量的MVC5的项目.如何将MVC5升级到MVC6,将是一个很大的课题.微软官方暂时没有一个升级指导,或者一个迁移工具, ...
- jquery+ajax+struts2
AJAX 是与服务器交换数据的艺术,它在不重载全部页面的情况下,实现了对部分网页的更新.编写常规的 AJAX 代码并不容易,因为不同的浏览器对 AJAX 的实现并不相同.这意味着您必须编写额外的代码对 ...
- Sencha ExtJS 6 Widget Grid 入门
最近由于业务需要,研究了一下Sencha ExtJS 6 ,虽然UI和性能上据相关资料说都有提升,但是用起来确实不太顺手,而且用Sencha cmd工具进行测试和发布,很多内部细节都是隐藏的,出了问题 ...
- 你知道JavaScript中的结果值是什么吗?
你知道JavaScript中的每条语句.甚至表达式都有一个结果值吗? 当你在浏览器中测试代码时,经常会在控制台的输出结果的最后面多出一条,大部分为undefined,这个undefined就是一个结果 ...
- jquery 点击查看更多箭头变化,文字变化,超出带滚动条。
从网上好了好久,没找到自己要的,自己写了一下. <!DOCTYPE html> <html> <head> <meta charset="utf-8 ...
- 通过Wireshark抓包进行Cookie劫持
首先在目标A机器上运行Wireshark并开启浏览器,开启前关闭其他占用网络的软件,这里我拿51CTO.com做测试. 正常登陆51CTO用户中心,此时使用 http.cookie and http. ...
- Android 自定义控件之继承ViewGroup创建新容器
欢迎大家来学习本节内容,前几节我们已经学习了其他几种自定义控件,分别是Andriod 自定义控件之音频条及 Andriod 自定义控件之创建可以复用的组合控件还没有学习的同学请先去学习下,因为本节将使 ...
- hexo+next博客添加搜索
1.为什么添加algolia搜索 第一当然是可以方便的查找所需文章,第二点就是之前常用的swiftype插件不再免费.我的个人博客是这个月初搭建完成的,这时候swiftype已经不再免费,而且只开放企 ...