六、java操作swift对象存储（resultful方式实现）
系列导航
六、java操作swift对象存储（resultful方式实现）
上一节讲了如何通过swift官方的样例操作swift对象存储，官方样例中，种类还是有点少工作中不够用，但是swift集群的调用支持resultful这就给我们提供了另一种调用swift的方法。那么都支持那些操作类型呢请看下表。
一、 RESTful API 总结
资源类型 URL GET PUT POST DELETE HEAD
账户 /account/ 获取容器列表 - - - 获取账户元数据
容器 /account/container 获取对象列表 创建容器 更新容器元数据 删除容器 获取容器元数据
对象 /account/container/object 获取对象内容和元数据 创建、更新或拷贝对象 更新对象元数据 删除对象 获取对象元数据
了解了以上知识后下面进入代码部分java使用resultful方式操作swift对象存储。
二、pom.xml依赖
<dependencies>
<!-- https://mvnrepository.com/artifact/org.apache.httpcomponents/httpcore -->
<dependency>
<groupId>org.apache.httpcomponents</groupId>
<artifactId>httpcore</artifactId>
<version>4.3.3</version>
</dependency> <!-- https://mvnrepository.com/artifact/org.apache.httpcomponents/httpclient -->
<dependency>
<groupId>org.apache.httpcomponents</groupId>
<artifactId>httpclient</artifactId>
<version>4.3.6</version>
</dependency> <!--JSONArray-->
<dependency>
<groupId>commons-beanutils</groupId>
<artifactId>commons-beanutils</artifactId>
<version>1.9.3</version>
</dependency>
<dependency>
<groupId>commons-collections</groupId>
<artifactId>commons-collections</artifactId>
<version>3.2.1</version>
</dependency>
<dependency>
<groupId>commons-lang</groupId>
<artifactId>commons-lang</artifactId>
<version>2.6</version>
</dependency>
<dependency>
<groupId>commons-logging</groupId>
<artifactId>commons-logging</artifactId>
<version>1.1.1</version>
</dependency>
<dependency>
<groupId>net.sf.ezmorph</groupId>
<artifactId>ezmorph</artifactId>
<version>1.0.6</version>
</dependency> <dependency>
<groupId>org.json</groupId>
<artifactId>json</artifactId>
<version>20180130</version>
</dependency>
三、方法类ResultFulBase.java
package swift.base; import java.io.BufferedOutputStream;
import java.io.File;
import java.io.FileInputStream;
import java.io.FileOutputStream;
import java.io.IOException;
import java.io.InputStream;
import java.io.OutputStream; import org.apache.commons.codec.binary.Base64;
import org.apache.commons.codec.digest.DigestUtils;
import org.apache.http.Header;
import org.apache.http.HttpEntity;
import org.apache.http.HttpResponse;
import org.apache.http.HttpStatus;
import org.apache.http.client.methods.HttpDelete;
import org.apache.http.client.methods.HttpGet;
import org.apache.http.client.methods.HttpPut;
import org.apache.http.entity.ByteArrayEntity;
import org.apache.http.entity.FileEntity;
import org.apache.http.entity.InputStreamEntity;
import org.apache.http.impl.client.DefaultHttpClient;
import org.apache.http.util.EntityUtils; //resultFul接口方式实现基础操作(tempauth认证方式)
public class ResultFulBase { //访问swift的url地址
public static String X_Storage_Url = ""; //访问swift的令牌
public static String X_Auth_Token = ""; //分割符
private static final String separator = System.getProperty("file.separator"); public ResultFulBase(String url, String port, String user, String passwd) {
get_AUTH(url, port, user, passwd);
} //获取X-Storage-Url 和 X-Auth-Token begin
//curl http://127.0.0.1:8080/auth/v1.0 -v -H 'X-Storage-User: admin:admin' -H 'X-Storage-Pass: admin'
public void get_AUTH(String url, String port, String user, String passwd) {
try {
HttpGet req = new HttpGet("http://" + url + ":" + port + "/auth/v1.0");
req.addHeader("X-Storage-User", user);
req.addHeader("X-Storage-Pass", passwd); DefaultHttpClient httpclient = new DefaultHttpClient();
HttpResponse rsp = httpclient.execute(req);
System.out.println("----------------------------------------");
System.out.println(rsp.getStatusLine());
Header[] headers = rsp.getAllHeaders();
for (int i = 0; i < headers.length; i++) {
System.out.println(headers[i]);
}
System.out.println("----------------------------------------"); Header h1 = rsp.getFirstHeader("X-Storage-Url");
Header h2 = rsp.getFirstHeader("X-Auth-Token");
X_Storage_Url = h1.getValue();
X_Auth_Token = h2.getValue();
System.out.println(h1.getValue() + "---------" + h2.getValue());
System.out.println("----------------------------------------");
//获取X-Storage-Url 和 X-Auth-Token end
} catch (Exception e) {
e.printStackTrace();
}
} //查看账户信息
//curl http://127.0.0.1:8080/v1/AUTH_admin -v -H 'X-Auth-Token: AUTH_tkf44c48c200e34f14850f6a8e3bc63f36'
public void get_acount_info() {
try {
HttpGet req = new HttpGet(X_Storage_Url);
req.addHeader("X-Auth-Token", X_Auth_Token);
DefaultHttpClient httpclient = new DefaultHttpClient();
HttpResponse rsp = httpclient.execute(req); System.out.println("----------------------------------------");
System.out.println(rsp.getStatusLine());
Header[] headers = rsp.getAllHeaders();
for (int i = 0; i < headers.length; i++) {
System.out.println(headers[i]);
}
System.out.println("----------------------------------------");
} catch (Exception e) {
e.printStackTrace();
}
} //创建 container（container2为创建的容器名称） 按照默认策略创建容器
//curl http://127.0.0.1:8080/v1/AUTH_admin/container2 -X PUT -H "X-Auth_Token: AUTH_tkf44c48c200e34f14850f6a8e3bc63f36"
public void create_container(String containerName) {
try {
HttpPut req = new HttpPut(X_Storage_Url + "/" + containerName);
req.addHeader("X-Auth-Token", X_Auth_Token);
DefaultHttpClient httpclient = new DefaultHttpClient();
HttpResponse rsp = httpclient.execute(req); System.out.println("----------------------------------------");
System.out.println(rsp.getStatusLine());
Header[] headers = rsp.getAllHeaders();
for (int i = 0; i < headers.length; i++) {
System.out.println(headers[i]);
}
System.out.println("----------------------------------------");
} catch (Exception e) {
e.printStackTrace();
}
} //创建 container（containerpolicy2为创建的容器名称） 按照存储策略创建容器
//curl http://127.0.0.1:8080/v1/AUTH_admin/containerpolicy2 -X PUT -H "X-Auth_Token: AUTH_tk7c21eddae31d449db36a5e8596d0cb71" -H "X-Storage-Policy: silver" //Policy是存储策略的名称
public void create_container(String containerName, String Policy) {
try {
HttpPut req = new HttpPut(X_Storage_Url + "/" + containerName);
req.addHeader("X-Auth-Token", X_Auth_Token);
req.addHeader("X-Storage-Policy", Policy);
DefaultHttpClient httpclient = new DefaultHttpClient();
HttpResponse rsp = httpclient.execute(req); System.out.println("----------------------------------------");
System.out.println(rsp.getStatusLine());
Header[] headers = rsp.getAllHeaders();
for (int i = 0; i < headers.length; i++) {
System.out.println(headers[i]);
}
System.out.println("----------------------------------------");
} catch (Exception e) {
e.printStackTrace();
}
} //获取AUTH_admin账户下的容器container1的对象列表
//curl http://127.0.0.1:8080/v1/AUTH_admin/container1 -X GET -H "X-Auth_Token: AUTH_tkf44c48c200e34f14850f6a8e3bc63f36"
public void get_container_object_list(String containerName) {
try {
HttpGet req = new HttpGet(X_Storage_Url + "/" + containerName);
req.addHeader("X-Auth-Token", X_Auth_Token);
DefaultHttpClient httpclient = new DefaultHttpClient();
HttpResponse rsp = httpclient.execute(req); System.out.println("----------------------------------------");
HttpEntity entity = rsp.getEntity();
if (entity != null) {
String result = EntityUtils.toString(entity);
String[] objectList = result.split("\n");
for (int i = 0; i < objectList.length; i++) {
System.out.println("--" + objectList[i]);
}
}
System.out.println("----------------------------------------");
} catch (Exception e) {
e.printStackTrace();
}
} //获取容器下指定条数的对象列表（有的容器下对象太多，对象都拿出来服务器压力很大）
//limit 整数n，指明返回结果只包含n个值
public void get_container_object_limit_list(String containerName, int limit) {
try {
HttpGet req = new HttpGet(X_Storage_Url + "/" + containerName + "/?limit=" + limit); req.addHeader("X-Auth-Token", X_Auth_Token);
DefaultHttpClient httpclient = new DefaultHttpClient();
HttpResponse rsp = httpclient.execute(req); System.out.println("----------------------------------------");
HttpEntity entity = rsp.getEntity();
if (entity != null) {
String result = EntityUtils.toString(entity);
String[] objectList = result.split("\n");
for (int i = 0; i < objectList.length; i++) {
System.out.println("--" + objectList[i]);
}
}
System.out.println("----------------------------------------");
} catch (Exception e) {
e.printStackTrace();
}
} //获取符合查询条件的对象列表
//marker 字符串x，返回名称比这个特定的字符串x大的container列表 >=
//end_marker 字符串x，返回名称比这个特定字符串小的container列表 <
// 注： 对于md5码 对比的是 第一个字母（经验观察，不是官网内容）
public void get_container_object_marker_list(String containerName, String marker, String end_marker) {
try {
HttpGet req = new HttpGet(X_Storage_Url + "/" + containerName + "/?marker=" + marker + "&end_marker=" + end_marker); req.addHeader("X-Auth-Token", X_Auth_Token);
DefaultHttpClient httpclient = new DefaultHttpClient();
HttpResponse rsp = httpclient.execute(req); System.out.println("----------------------------------------");
HttpEntity entity = rsp.getEntity();
if (entity != null) {
String result = EntityUtils.toString(entity);
String[] objectList = result.split("\n");
for (int i = 0; i < objectList.length; i++) {
System.out.println("--" + objectList[i]);
}
}
System.out.println("----------------------------------------");
} catch (Exception e) {
e.printStackTrace();
}
} //创建、更新或拷贝对象
//curl http://127.0.0.1:8080/v1/AUTH_admin/container1/1.txt -X PUT -T 1.txt -H "X-Auth_Token: AUTH_tkf44c48c200e34f14850f6a8e3bc63f36"
public void create_object(String containerName, String objectName, String filePath) {
try {
HttpPut req = new HttpPut(X_Storage_Url + "/" + containerName + "/" + objectName);
req.addHeader("X-Auth-Token", X_Auth_Token); File file = new File(filePath);
FileEntity entity1 = new FileEntity(file, "text/plain; charset=\"UTF-8\"");
req.addHeader("Content-Type", "image/jpeg");
req.addHeader("Content-Type", "text/plain; charset=\"UTF-8\"");
req.setEntity(entity1); DefaultHttpClient httpclient = new DefaultHttpClient();
HttpResponse rsp = httpclient.execute(req); System.out.println("----------------------------------------");
System.out.println(rsp.getStatusLine());
Header[] headers = rsp.getAllHeaders();
for (int i = 0; i < headers.length; i++) {
System.out.println(headers[i]);
}
System.out.println("----------------------------------------"); } catch (Exception e) {
e.printStackTrace();
}
} //创建对象及Meta
//curl http://127.0.0.1:8080/v1/AUTH_admin/container1/1.txt -X PUT -T 1.txt -H "X-Auth_Token: AUTH_tkf44c48c200e34f14850f6a8e3bc63f36"
public void create_object_meta(String containerName, String objectName, String filePath) {
try {
HttpPut req = new HttpPut(X_Storage_Url + "/" + containerName + "/" + objectName);
req.addHeader("X-Auth-Token", X_Auth_Token);
req.addHeader("X-Object-Meta-idNum", "123123123"); File file = new File(filePath);
FileEntity entity1 = new FileEntity(file, "text/plain; charset=\"UTF-8\"");
req.addHeader("Content-Type", "image/jpeg");
req.addHeader("Content-Type", "text/plain; charset=\"UTF-8\"");
req.setEntity(entity1); DefaultHttpClient httpclient = new DefaultHttpClient();
HttpResponse rsp = httpclient.execute(req); System.out.println("----------------------------------------");
System.out.println(rsp.getStatusLine());
Header[] headers = rsp.getAllHeaders();
for (int i = 0; i < headers.length; i++) {
System.out.println(headers[i]);
}
System.out.println("----------------------------------------"); } catch (Exception e) {
e.printStackTrace();
}
} //获取对象内容和元数据
//curl http://127.0.0.1:8080/v1/AUTH_admin/container1/2.txt -X GET -H "X-Auth_Token: AUTH_tkf44c48c200e34f14850f6a8e3bc63f36"
public void get_container_object(String containerName, String objectName, String path) {
try {
HttpGet req = new HttpGet(X_Storage_Url + "/" + containerName + "/" + objectName);
req.addHeader("X-Auth-Token", X_Auth_Token);
DefaultHttpClient httpclient = new DefaultHttpClient();
HttpResponse rsp = httpclient.execute(req);
if (HttpStatus.SC_OK == rsp.getStatusLine().getStatusCode()) {
HttpEntity entity = rsp.getEntity();
if (entity != null) {
InputStream input = entity.getContent();
write(input, path);
}
} Header[] headers = rsp.getAllHeaders();
for (int i = 0; i < headers.length; i++) {
System.out.println(headers[i]);
}
System.out.println("----------------------------------------");
} catch (Exception e) {
e.printStackTrace();
}
} //判断文件是否存在
//curl http://127.0.0.1:8080/v1/AUTH_admin/container1/2.txt -X GET -H "X-Auth_Token: AUTH_tkf44c48c200e34f14850f6a8e3bc63f36"
public boolean exist_container_object(String containerName, String objectName) {
boolean result = false;
try {
HttpGet req = new HttpGet(X_Storage_Url + "/" + containerName + "/" + objectName);
req.addHeader("X-Auth-Token", X_Auth_Token);
DefaultHttpClient httpclient = new DefaultHttpClient();
HttpResponse rsp = httpclient.execute(req);
if (HttpStatus.SC_OK == rsp.getStatusLine().getStatusCode()) {
HttpEntity entity = rsp.getEntity();
if (entity != null) {
result = true;
}
}
} catch (Exception e) {
e.printStackTrace();
}
return result;
} //删除对象
// curl http://127.0.0.1:8080/v1/AUTH_admin/container1/2.txt -X DELETE -H "X-Auth_Token: AUTH_tkf44c48c200e34f14850f6a8e3bc63f36"
public void delete_object(String containerName, String objectName) {
try {
HttpDelete req = new HttpDelete(X_Storage_Url + "/" + containerName + "/" + objectName);
req.addHeader("X-Auth-Token", X_Auth_Token);
DefaultHttpClient httpclient = new DefaultHttpClient();
HttpResponse rsp = httpclient.execute(req);
Header[] headers = rsp.getAllHeaders();
for (int i = 0; i < headers.length; i++) {
System.out.println(headers[i]);
}
System.out.println("----------------------------------------");
} catch (Exception e) {
e.printStackTrace();
}
} //写文件
private void write(InputStream is, String path) {
try {
OutputStream stream = new BufferedOutputStream(new FileOutputStream(path));
int bufferSize = 1024;
byte[] buffer = new byte[bufferSize];
int len = 0;
while ((len = is.read(buffer)) != -1) {
stream.write(buffer, 0, len);
}
stream.close();
} catch (IOException e) {
throw new RuntimeException(e.getMessage(), e);
} } //以文件地址方式向容器中放入数据，数据名称为文件的md5码
public void create_md5_object(String containerName, String filePath) {
try {
String objectName = " "; objectName = DigestUtils.md5Hex(new FileInputStream(filePath));
System.out.println(objectName); HttpPut req = new HttpPut(X_Storage_Url + "/" + containerName + "/" + objectName);
req.addHeader("X-Auth-Token", X_Auth_Token); File file = new File(filePath); FileInputStream fileInputStream = new FileInputStream(file);
InputStreamEntity reqEntity = new InputStreamEntity(fileInputStream, file.length()); req.addHeader("Content-Type", "application/octet-stream");
req.setEntity(reqEntity); DefaultHttpClient httpclient = new DefaultHttpClient();
HttpResponse rsp = httpclient.execute(req); System.out.println("----------------------------------------");
System.out.println(rsp.getStatusLine());
Header[] headers = rsp.getAllHeaders();
for (int i = 0; i < headers.length; i++) {
System.out.println(headers[i]);
}
System.out.println("----------------------------------------"); } catch (Exception e) {
e.printStackTrace();
}
} //以文件base64编码方式向容器中放入数据，数据名称为文件的md5码
public void create_base64_object(String containerName, String base64String) {
try {
String objectName = " "; objectName = DigestUtils.md5Hex(base64String);
System.out.println(objectName); HttpPut req = new HttpPut(X_Storage_Url + "/" + containerName + "/" + objectName);
req.addHeader("X-Auth-Token", X_Auth_Token); byte[] content = Base64.decodeBase64(base64String); ByteArrayEntity reqEntity = new ByteArrayEntity(content);
req.addHeader("Content-Type", "application/octet-stream");
req.setEntity(reqEntity); DefaultHttpClient httpclient = new DefaultHttpClient();
HttpResponse rsp = httpclient.execute(req); System.out.println("----------------------------------------");
System.out.println(rsp.getStatusLine());
Header[] headers = rsp.getAllHeaders();
for (int i = 0; i < headers.length; i++) {
System.out.println(headers[i]);
}
System.out.println("----------------------------------------"); } catch (Exception e) {
e.printStackTrace();
}
} //以文件base64编码方式向容器中放入数据，数据名称为文件的md5码
public void create_base64_object(String containerName, String base64String, String objectName) {
try {
HttpPut req = new HttpPut(X_Storage_Url + "/" + containerName + "/" + objectName);
req.addHeader("X-Auth-Token", X_Auth_Token); byte[] content = Base64.decodeBase64(base64String); ByteArrayEntity reqEntity = new ByteArrayEntity(content);
req.addHeader("Content-Type", "application/octet-stream");
req.setEntity(reqEntity); DefaultHttpClient httpclient = new DefaultHttpClient();
HttpResponse rsp = httpclient.execute(req); System.out.println("----------------------------------------");
System.out.println(rsp.getStatusLine());
Header[] headers = rsp.getAllHeaders();
for (int i = 0; i < headers.length; i++) {
System.out.println(headers[i]);
}
System.out.println("----------------------------------------"); } catch (Exception e) {
e.printStackTrace();
}
} //以文件base64编码方式向容器中放入数据，数据名称为文件的md5码
public void create_base64_object(String containerName, String base64String, String objectName, String metaData) {
try {
HttpPut req = new HttpPut(X_Storage_Url + "/" + containerName + "/" + objectName);
req.addHeader("X-Auth-Token", X_Auth_Token);
req.addHeader("X-Object-Meta-idNum", metaData); byte[] content = Base64.decodeBase64(base64String); ByteArrayEntity reqEntity = new ByteArrayEntity(content);
req.addHeader("Content-Type", "application/octet-stream");
req.setEntity(reqEntity); DefaultHttpClient httpclient = new DefaultHttpClient();
HttpResponse rsp = httpclient.execute(req); System.out.println("----------------------------------------");
System.out.println(rsp.getStatusLine());
Header[] headers = rsp.getAllHeaders();
for (int i = 0; i < headers.length; i++) {
System.out.println(headers[i]);
}
System.out.println("----------------------------------------"); } catch (Exception e) {
e.printStackTrace();
}
} //写入Temp-URL-Key
public void create_key(String key) {
try {
HttpPut req = new HttpPut(X_Storage_Url);
req.addHeader("X-Auth-Token", X_Auth_Token);
req.addHeader("Content-Type", "image/jpeg"); req.addHeader("X-Account-Meta-Temp-Url-Key", key);
req.addHeader("Content-Type", "text/plain; charset=\"UTF-8\""); DefaultHttpClient httpclient = new DefaultHttpClient();
HttpResponse rsp = httpclient.execute(req); System.out.println("----------------------------------------");
System.out.println(rsp.getStatusLine());
Header[] headers = rsp.getAllHeaders();
for (int i = 0; i < headers.length; i++) {
System.out.println(headers[i]);
}
System.out.println("----------------------------------------"); } catch (Exception e) {
e.printStackTrace();
}
} }
四、方法调用的主类ResultFulBaseMain.java
package swift.main; import swift.base.ResultFulBase; //resultFulBase.Java的调用测试
public class ResultFulBaseMain { /**
* @param args
*/
public static void main(String[] args) {
ResultFulBase resultFulBase = new ResultFulBase("192.168.0.1", "8080", "admin:admin", "admin"); //一、获取连接swift的连接和令牌
resultFulBase.get_AUTH("192.168.0.1","8080","admin:admin","admin"); //二、查看账户信息
resultFulBase.get_acount_info(); //三、按照默认存储策略创建容器
resultFulBase.create_container("containerName1"); //四、指定存储策略创建容器
resultFulBase.create_container("containerName2","silver"); //五、查看容器下对象列表
resultFulBase.get_container_object_list("containerName1"); //六、获取容器下指定条数的对象列表
resultFulBase.get_container_object_limit_list("containerName1",2); //七、获取符合查询条件的对象列表
resultFulBase.get_container_object_marker_list("containerName1","1","9"); //八、创建对象
resultFulBase.create_object("containerName2","1.txt","E://1.txt"); //九、创建对象及对象的属性Meta
resultFulBase.create_object_meta("containerName2","2.txt","E://2.txt"); //十、获取对象内容和元数据
resultFulBase.get_container_object("containerName2","2.txt","E://99.txt"); //十一、判断文件是否存在 boolean flag = resultFulBase.exist_container_object("containerName2","2.txt" );
System.out.println(flag); flag = resultFulBase.exist_container_object("containerName2","4.txt" );
System.out.println(flag); //十二、删除对象
resultFulBase.delete_object("containerName2","1.txt" ) ; //十三、以文件地址方式向容器中放入数据，数据名称为文件的md5码
resultFulBase.create_md5_object("containerName2","E://1.txt"); //十四、以文件base64编码方式向容器中放入数据，数据名称为文件的md5码
resultFulBase.create_base64_object("containerName2","txbb01d60aaa174f26b20e5-005eec4823"); //十五、写入Temp-URL-Key
resultFulBase.create_key("1233"); } }
六、java操作swift对象存储（resultful方式实现）的更多相关文章
- Hbase深入学习(六) Java操作HBase
Hbase深入学习(六) ―― Java操作HBase 本文讲述如何用hbase shell命令和hbase java api对hbase服务器进行操作. 先看以下读取一行记录hbase是如何进行工作 ...
- openstack-r版(rocky)搭建基于centos7.4 的openstack swift对象存储服务 四
openstack-r版(rocky)搭建基于centos7.4 的openstack swift对象存储服务 一 openstack-r版(rocky)搭建基于centos7.4 的openstac ...
- openstack-r版(rocky)搭建基于centos7.4 的openstack swift对象存储服务 三
openstack-r版(rocky)搭建基于centos7.4 的openstack swift对象存储服务 一 openstack-r版(rocky)搭建基于centos7.4 的openstac ...
- openstack-r版(rocky)搭建基于centos7.4 的openstack swift对象存储服务 二
openstack-r版(rocky)搭建基于centos7.4 的openstack swift对象存储服务 一 openstack-r版(rocky)搭建基于centos7.4 的openstac ...
- openstack-r版(rocky)搭建基于centos7.4 的openstack swift对象存储服务 一
openstack-r版(rocky)搭建基于centos7.4 的openstack swift对象存储服务 一 openstack-r版(rocky)搭建基于centos7.4 的openstac ...
- swift对象存储
swift对象存储 简介 OpenStack Object Storage(Swift)是OpenStack开源云计算项目的子项目之一,被称为对象存储,提供了强大的扩展性.冗余和持久性.对象存储,用于 ...
- 九、Swift对象存储服务(双节点搭建)
九.Swift对象存储服务(双节点搭建) 要求:Controoler节点需要2块空盘 Compute节点需要再加2块空盘 本次搭建采用Controller 和 Compute双节点节点做swift组件 ...
- Golang 调用 aws-sdk 操作 S3对象存储
Golang 调用 aws-sdk 操作 S3对象存储 前言 因为业务问题,要写一个S3对象存储管理代码,由于一直写Go,所以这次采用了Go,Go嘛,快,自带多线程,这种好处就不用多说了吧. 基础的功 ...
- swift对象存储安装
对象存储服务概览 OpenStack对象存储是一个多租户的对象存储系统,它支持大规模扩展,可以以低成本来管理大型的非结构化数据,通过RESTful HTTP 应用程序接口. 它包含下列组件: 代理服务 ...
- Java操作Sqoop对象
Windows下使用Eclipse工具操作Sqoop1.4.6对象 Sqoop是用来在关系型数据库与Hadoop之间进行数据的导入导出,Windows下使用Eclipse工具操作时,需要先搭建好Had ...
随机推荐
- 快速入门：使用 .NET Aspire 组件实现缓存
前言 云原生应用程序通常需要各种类型的可扩展缓存解决方案来提高性能..NET Aspire 组件简化了连接到流行的缓存服务(例如 Redis)的过程,今天小编就为大家简单介绍一下如何使用 .NET A ...
- springboot——入门案例
真简单啊 springboot 学了入门案例,有感而发 首先是一个自带的配置文件: package com.example.springboot_01; import org.springframew ...
- 文档理解的新时代：LayOutLM模型的全方位解读
一.引言 在现代文档处理和信息提取领域,机器学习模型的作用日益凸显.特别是在自然语言处理(NLP)技术快速发展的背景下,如何让机器更加精准地理解和处理复杂文档成为了一个挑战.文档不仅包含文本信息,还包 ...
- Scrapy如何在爬虫类中导入settings配置
假设我们在settings.py定义了一个IP地址池 ##### 自定义设置 IP_PROXY_POOL = ( "127.0.0.1:6789", "127.0.0.1 ...
- ElasticSearch之Get index API
获取指定索引的基本信息. 命令样例如下: curl -X GET "https://localhost:9200/testindex_001?pretty" --cacert $E ...
- 【OpenCV】在 Mac OS 上使用 EmguCV
前言 OpenCV是一个基于Apache2.0许可(开源)发行的跨平台计算机视觉和机器学习软件库,它具有C++,Python,Java和MATLAB接口,并支持Windows,Linux,Androi ...
- 某物流客户Elasticsearch集群性能优化案例
客户背景 客户使用ES来进行数据存储.快速查询业务订单记录,但是经常会出现业务高峰期ES集群的cpu负载.内存使用均较高,查询延迟大,导致前端业务访问出现大量超时的情况,极大影响其客户使用体验. 部分 ...
- 掌握语义内核(Semantic Kernel)：如何精进你的提示词工程
在人工智能的海洋里,大型语言模型(LLM AI)是高速发展的一艘巨轮,而有效地与其沟通和指导其行为的锚,正是提示语(prompts).提示语是我们提供给模型的输入或查询,以期获取特定的响应.当今,提示 ...
- Java 并发编程（四）同步工具类
本文使用的 JDK 版本为 JDK 8 基本同步工具类 闭锁(CountDownLatch) 闭锁是一种工具类,可以延迟线程的进度直到其到达终止状态.闭锁的作用相当与一扇门:在闭锁的状态到达之前,这扇 ...
- Programming abstractions in C阅读笔记：p181-p183
<Programming Abstractions In C>学习第61天,p181-p183总结. 一.技术总结 1.linear search algorithm 2.lexicogr ...