数据筛选和API优化
筛选数据
需求：如果数据库中存在OrderNum相同，且IsDefault不同的记录，那么IsDefault值为0的记录将替换值为1的记录（IsDefault值为1的记录不展示）。
由于查出来的数据不多，100条以内，所以我是直接全部查询到List内存中，然后在内存中进行数据过滤的操作，思来想去都觉得我如下的实现方式很low，但是我一时又没想到好的办法，不知道大家有没有好的办法？
var newList = list.ToList();
//筛选出哪些排序号有重复
var orderNumList = newList.GroupBy(g => g.OrderNum).Select(g => new { orderNum = g.Key, count = g.Count() }).Where(g => g.count > ).Select(s => s.orderNum).ToList();
var cfList = newList.Where(w => orderNumList.Contains(w.OrderNum)); //获取有重复排序号的记录 var cfDefaultList = cfList.Where(w => w.IsDefault); //默认模块记录
var cfNoDefaultList = cfList.Where(w => w.IsDefault == false); //非默认模块记录 var intersectedList = from d in cfDefaultList join f in cfNoDefaultList on d.OrderNum equals f.OrderNum where d.IsDefault!= f.IsDefault select d; var newIntersectedList = intersectedList.Distinct().ToArray(); //排序号相同，既存在默认记录也存在非默认记录的数据 if (newIntersectedList != null && newIntersectedList.Length > )
{
for (int i = ; i < newIntersectedList.Length; i++)
{
if (newList.Contains(newIntersectedList[i]))
{
newList.Remove(newIntersectedList[i]);
}
}
}
newList = newList.OrderBy(x => x.OrderNum).ToList();
以上的newList就代码截图中的数据。
优化API接口
有一个API接口经常卡顿，而且很不稳定，快的时候2~3秒，慢的时候10秒去了。
接口需求：根据社区ID获取优惠券记录。
分析：
- 负责给API接口提供数据的系统中，缺少许多索引，存在许多慢查询视图。
- 原来的LINQ实现方式是在内存中分页，响应速度太慢。
- 并发请求的情况下，资源占用。
优化思路：
1、使用缓存
同一个社区的人在同一时间所看到的优惠券记录应该是一样的，而且我们应该允许脏读，我们在12306上面买火车票的时候，经常也会看到显示有票，但是下单又没有了，可能是使用了缓存，那么我们这里其实同样的可以采用缓存来缓解并发问题。
在WebAPI上面加缓存，那么又分为客户端缓存和服务器缓存。而我们知道，在ASP.NET WebForm和ASP.NET MVC中都是有页面输出缓存的，而在WebAPI中默认没有，从NuGet上面下载WebApi.OutputCache.V2，然后再API接口上添加
[CacheOutput(ClientTimeSpan = )]//, ServerTimeSpan = 5
我这里没法直接使用服务器输出缓存，那是因为无法捕获缓存变量参数。因为我们API接口的请求参数是string appParam，字符串类型的，它是一个json对象进过base64位编码，然后再进过url编码生成的字符串。
我们只能解析后，获取社区ID，然后根据社区ID来设置缓存，把社区ID+ pageIndex就作为缓存的Key，考虑到需要缓存的数据量很小，这里我直接使用.NET自带的缓存，引入命名空间：System.Web.Caching;
private static System.Web.Caching.Cache ObjCache = HttpRuntime.Cache;
/// <summary>
/// 设置当前指定Key的Cache值,并限定过期时间
/// </summary>
/// <param name="Key">缓存Key</param>
/// <param name="Obj">缓存的值</param>
/// <param name="TimeOuts">超时时间（秒）</param>
public static void SetCacheSeconds(string Key, object Obj, double TimeOuts)
{
ObjCache.Insert(Key, Obj, null, System.DateTime.Now.AddSeconds(TimeOuts), TimeSpan.Zero);
}
/// <summary>
/// 获取当前指定Key的Cache值
/// </summary>
/// <param name="Key">缓存Key</param>
/// <returns>缓存的值</returns>
public static object GetCache(string Key)
{
return ObjCache[Key];
}
缓存操作类Cache完整代码如下：
/*==================================
* Author:
* CreateTime：2014-7-15 17:26:29
* Description：Cache操作类
===================================*/
using System;
using System.Collections.Generic;
using System.Linq;
using System.Text;
using System.Web.Caching;
using System.Runtime.CompilerServices;
using System.Web;
using System.Security.Policy; namespace SSY.Util
{
/// <summary>
/// 缓存处理相关类
/// </summary>
public class Cache
{
private static System.Web.Caching.Cache ObjCache = HttpRuntime.Cache;
private static short TimeOut = ; #region 清除指定键值的缓存
/// <summary>
/// 清除指定键值的缓存
/// </summary>
/// <param name="Key">要清除的缓存的key值</param>
public static void Clear(string Key)
{
if (ObjCache[Key] != null)
{
ObjCache.Remove(Key);
}
}
#endregion #region 返回系统中缓存的个数
/// <summary>
/// 返回系统中缓存的个数
/// </summary>
/// <returns>缓存个数</returns>
public static int Count()
{
return ObjCache.Count;
}
#endregion #region 获取当前指定Key的Cache值
/// <summary>
/// 获取当前指定Key的Cache值
/// </summary>
/// <param name="Key">缓存Key</param>
/// <returns>缓存的值</returns>
public static object GetCache(string Key)
{
return ObjCache[Key];
}
#endregion #region 设置当前指定Key的Cache值
/// <summary>
/// 设置当前指定Key的Cache值
/// </summary>
/// <param name="Key">缓存Key</param>
/// <param name="Obj">缓存的值</param>
public static void SetCache(string Key, object Obj)
{
ObjCache.Insert(Key, Obj);
}
#endregion #region 设置当前指定Key的Cache值,并限定过期时间
/// <summary>
/// 设置当前指定Key的Cache值,并限定过期时间
/// </summary>
/// <param name="Key">缓存Key</param>
/// <param name="Obj">缓存的值</param>
/// <param name="TimeOuts">超时时间（分钟）</param>
public static void SetCache(string Key, object Obj, int TimeOuts)
{
ObjCache.Insert(Key, Obj, null, System.DateTime.Now.AddMinutes((double)TimeOuts), TimeSpan.Zero);
}
/// <summary>
/// 设置当前指定Key的Cache值,并限定过期时间
/// </summary>
/// <param name="Key">缓存Key</param>
/// <param name="Obj">缓存的值</param>
/// <param name="TimeOuts">超时时间（秒）</param>
public static void SetCacheSeconds(string Key, object Obj, double TimeOuts)
{
ObjCache.Insert(Key, Obj, null, System.DateTime.Now.AddSeconds(TimeOuts), TimeSpan.Zero);
}
#endregion #region 设置当前指定Key的Cache值,依赖文件过期
/// <summary>
/// 设置当前指定Key的Cache值,依赖文件过期
/// </summary>
/// <param name="Key">缓存Key</param>
/// <param name="Obj">缓存的值</param>
/// <param name="Files">相对地址，例如"~/files.xml"</param>
public static void SetCache(string Key, object Obj, string Files)
{
CacheDependency cacheDep = new CacheDependency(System.Web.HttpContext.Current.Server.MapPath(Files),System.DateTime.Now);
SetCache(Key, Obj, TimeOut, cacheDep, CacheItemPriority.High);
}
#endregion #region 设置当前指定Key的Cache值
/// <summary>
/// 设置当前指定Key的Cache值
/// </summary>
/// <param name="Key">缓存Key</param>
/// <param name="Obj">缓存的值</param>
/// <param name="Priority">撤销缓存的优先值，此参数的值取自枚举变量“CacheItemPriority”，优先级低的数据项将先被删除。此参数主要用在缓存退出对象时.</param>
public static void SetCache(string Key, object Obj, CacheItemPriority Priority)
{
SetCache(Key, Obj, TimeOut, null, Priority);
}
#endregion #region 设置当前指定Key的Cache值
/// <summary>
/// 设置当前指定Key的Cache值
/// </summary>
/// <param name="Key">缓存Key</param>
/// <param name="Obj">缓存的值</param>
/// <param name="TimeOuts">一个TimeSpan，表示缓存参数将在多长时间以后被删除</param>
/// <param name="CacheDep">缓存的依赖项,需要一个CacheDependency，可初始化一个</param>
/// <param name="Priority">撤销缓存的优先值，此参数的值取自枚举变量“CacheItemPriority”，优先级低的数据项将先被删除。此参数主要用在缓存退出对象时</param>
public static void SetCache(string Key, object Obj, int TimeOuts, CacheDependency CacheDep, CacheItemPriority Priority)
{
ObjCache.Insert(Key, Obj, CacheDep, System.DateTime.MaxValue, TimeSpan.FromHours((double)TimeOuts), Priority, null);
}
#endregion
}
}
修改API接口代码：
#region added by zouqj 2017-3-7
var result = Util.Cache.GetCache(CommunityID+ pageIndex) as Result<List<GetAvailableCouponsModel>>;
if (result==null) //不存在则写入缓存
{
//组装参数
Dictionary<string, string> inParams = new Dictionary<string, string>();
inParams.Add("UserId", userId);
inParams.Add("PageIndex", pageIndex);
inParams.Add("PageSize", pageSize);
inParams.Add("CommunityID", CommunityID+ pageIndex);
...
RequestParam RequestParam = GetRequestParam(methodName, inParams, AuthenticationId);
var jsonContent = JsonConvert.SerializeObject(RequestParam);
result = DoPost<List<GetAvailableCouponsModel>>(jsonContent, PostUrl); Util.Cache.SetCacheSeconds(CommunityID, result, ); //写入缓存
}
return result;
2、改为存储过程实现
因为这个接口的业务逻辑比较复杂，之前的Linq代码写了好长一大串，获取的记录数很多，而且还是在内存中进行分页实现，所以我将原来的LINQ实现代码修改为分页存储过程实现。
存储过程代码如下：
------------------------------------------创建领券中心存储过程 created by zouqj-2017-3-1-----------------------------------
IF EXISTS(Select Name From Sysobjects Where Name='usp_GetAvailableCoupons' And Xtype='P')
DROP PROCEDURE usp_GetAvailableCoupons
GO
CREATE PROC usp_GetAvailableCouponsl
(
@PageIndex int, --页码
@PageSize int, --每页容纳的记录数
@Sort NVARCHAR(50), --排序字段及规则,不用加order by
@hostName nvarchar(100),--服务器地址
@CommunityID UNIQUEIDENTIFIER, --社区
@IsGetCount BIT --是否得到记录总数，1为得到记录总数，0为不得到记录总数，返回记录集
)
AS
-------------------------------定义变量-----------------------
declare @strSql NVARCHAR(max);
DECLARE @dt datetime2(7) --查询时间
SET @dt=GETDATE();
set nocount on;
----------------------------------------SQL开始--------------------------------------------无分类
IF @IsGetCount=1
BEGIN SET @strSql=N'SELECT COUNT(*) FROM (SELECT DISTINCT t.CampaignID from
(SELECT
c.ID AS CampaignID
FROM MK_Campaign c WITH ( NOLOCK ) INNER JOIN MK_CouponConfig f WITH ( NOLOCK ) ON c.ID=f.CampaignID
INNER JOIN MK_Coupon p WITH ( NOLOCK ) ON f.CouponID=p.ID
WHERE f.CouponGetType=2 AND f.ReceiveStartTime <=@dt AND f.ReceiveEndTime>= @dt
AND c.State=4 --执行中
AND p.WholeNetwork=1 --全网优惠
UNION ALL
SELECT
a.[ID] AS CampaignID
FROM [dbo].[MK_Campaign] AS a WITH ( NOLOCK )
INNER JOIN [dbo].[MK_CouponConfig] AS b WITH ( NOLOCK ) ON a.[ID] = b.[CampaignID]
AND (b.[ReceiveStartTime] <= @dt) AND (b.[ReceiveEndTime] >= @dt) AND (2 = b.[CouponGetType]) AND (4 = a.[State])
INNER JOIN [dbo].[MK_Coupon] AS c WITH ( NOLOCK ) ON b.[CouponID] = c.[ID]
INNER JOIN [dbo].[MK_CouponRestriction] AS d WITH ( NOLOCK ) ON c.[ID] = d.[CompainID]
LEFT OUTER JOIN [dbo].[MK_CouponRestrictCategory] AS e WITH ( NOLOCK ) ON d.[ID] = e.[CouponRestrictionID]
LEFT OUTER JOIN [dbo].[MK_CouponRestrictionOrg] AS f WITH ( NOLOCK ) ON d.[ID] = f.[CouponRestrictionID]
INNER JOIN [dbo].[ViewOrganizationCommunityForInterface] AS v ON f.[OrgID] = v.[ID]
where v.CommunityID=@CommunityID and 1 = d.[Type]
UNION ALL
SELECT
a.ID AS CampaignID
FROM MK_Campaign a WITH ( NOLOCK )
INNER JOIN MK_CouponConfig b WITH ( NOLOCK ) ON a.ID=b.CampaignID AND (b.[ReceiveStartTime] <= @dt) AND (b.[ReceiveEndTime] >=@dt)
INNER JOIN [dbo].[MK_Coupon] AS c WITH ( NOLOCK ) ON b.[CouponID] = c.[ID] and (2 = b.[CouponGetType]) AND (4 = a.[State])
INNER JOIN [dbo].[MK_CouponRestriction] AS d WITH ( NOLOCK ) ON c.[ID] = d.[CompainID] AND (2 = d.[Type])
LEFT OUTER JOIN MK_CouponRestrictionProduct AS e WITH ( NOLOCK ) ON d.[ID] = e.[CouponRestrictionID]
LEFT OUTER JOIN SL_Product AS f WITH ( NOLOCK ) ON (e.ProductID = f.ID)
INNER JOIN ViewOrganizationCommunityForInterface v ON v.ID=f.PublisherID
where v.CommunityID=@CommunityID
) t
) AS tt'
----------------------------------------------------------------------------------
END
ELSE
BEGIN
SET @strSql=N'SELECT DISTINCT t.* from(
SELECT
c.ID AS CampaignID,
c.Name AS CampaignName,
f.ValidityStartTime AS CampaignStartTime,
f.ValidityEndTime AS CampaignEndTime,
p.Name AS CouponsName,
p.Price AS CouponsAmount,
(CASE WHEN p.IsLimited =1 THEN 1 ELSE 2 END) AS IsLimited,
p.FullAmount AS MinAmount,
f.ValidityEndTime AS CouponsEndTime,
f.ValidityStartTime AS CouponsStartTime,
(CASE WHEN f.IsRepeateGet =1 THEN 1 ELSE 2 END) AS IsCanRepeatedReceive,
f.ReceiveAddress AS ReceiveAddress,
f.ReceiveEndTime AS ReceiveEndTime,
f.ReceiveStartTime AS ReceiveStartTime,
f.ReceiveMode AS ReceiveMethod,
f.ProvideNum AS ReceiveNum,
p.CreateTime AS CreateTime,
p.Price AS Price,
f.RemainCouponNum AS RemainCouponNum,
f.ID AS CouponConfigId,
p.WholeNetwork AS CouponsType,
(CASE WHEN f.IconUrl IS NULL THEN N'''' WHEN f.IconUrl=N'''' THEN N'''' ELSE @hostName+f.IconUrl END) AS IconUrl
FROM MK_Campaign c WITH ( NOLOCK )
INNER JOIN MK_CouponConfig f WITH ( NOLOCK ) ON c.ID=f.CampaignID
INNER JOIN MK_Coupon p WITH ( NOLOCK ) ON f.CouponID=p.ID
WHERE f.CouponGetType=2 AND f.ReceiveStartTime <= @dt AND f.ReceiveEndTime>= @dt AND c.State=4 AND p.WholeNetwork=1 --全网优惠
--
UNION ALL
SELECT a.[ID] AS CampaignID,
a.[Name] AS CampaignName,
b.[ValidityStartTime] AS CampaignStartTime,
b.[ValidityEndTime] AS CampaignEndTime,
c.[Name] AS CouponsName,
c.[Price] AS CouponsAmount,
CASE WHEN (c.[IsLimited] = 1) THEN 1 ELSE 2 END AS IsLimited,
c.[FullAmount] AS MinAmount,
b.[ValidityEndTime] AS CouponsEndTime,
b.[ValidityStartTime] AS CouponsStartTime,
CASE WHEN (b.[IsRepeateGet] = 1) THEN 1 ELSE 2 END AS IsCanRepeatedReceive,
b.[ReceiveAddress] AS [ReceiveAddress],
b.[ReceiveEndTime] AS [ReceiveEndTime],
b.[ReceiveStartTime] AS [ReceiveStartTime],
b.[ReceiveMode] AS ReceiveMethod,
b.[ProvideNum] AS ReceiveNum,
c.[CreateTime] AS CreateTime,
c.[Price] AS Price,
b.[RemainCouponNum] AS RemainCouponNum,
b.[ID] AS CouponConfigId,
e.[Type] AS CouponsType,
CASE WHEN (b.[IconUrl] = N'''' OR b.[IconUrl] IS NULL) THEN N'''' ELSE @hostName+b.[IconUrl] END AS IconUrl
FROM [dbo].[MK_Campaign] AS a WITH ( NOLOCK )
INNER JOIN [dbo].[MK_CouponConfig] AS b WITH ( NOLOCK ) ON a.[ID] = b.[CampaignID] AND (b.[ReceiveStartTime] <= @dt) AND (b.[ReceiveEndTime] >= @dt) AND (2 = b.[CouponGetType]) AND (4 = a.[State])
INNER JOIN [dbo].[MK_Coupon] AS c WITH ( NOLOCK ) ON b.[CouponID] = c.[ID]
INNER JOIN [dbo].[MK_CouponRestriction] AS d WITH ( NOLOCK ) ON c.[ID] = d.[CompainID]
LEFT OUTER JOIN [dbo].[MK_CouponRestrictCategory] AS e WITH ( NOLOCK ) ON d.[ID] = e.[CouponRestrictionID]
LEFT OUTER JOIN [dbo].[MK_CouponRestrictionOrg] AS f WITH ( NOLOCK ) ON d.[ID] = f.[CouponRestrictionID]
INNER JOIN [dbo].[ViewOrganizationCommunityForInterface] AS v ON f.[OrgID] = v.[ID]
where v.CommunityID=@CommunityID and 1 = d.[Type]
UNION ALL
SELECT
a.ID AS CampaignID,
a.Name AS CampaignName,
b.ValidityStartTime AS CampaignStartTime,
b.ValidityEndTime AS CampaignEndTime,
c.Name AS CouponsName,
c.Price AS CouponsAmount,
(CASE WHEN c.IsLimited=1 then 1 else 2 END) AS IsLimited,
c.FullAmount AS MinAmount,
b.ValidityEndTime AS CouponsEndTime,
b.ValidityStartTime AS CouponsStartTime,
(case when b.IsRepeateGet=1 then 1 else 2 END) AS IsCanRepeatedReceive,
b.ReceiveAddress AS ReceiveAddress,
b.ReceiveEndTime AS ReceiveEndTime,
b.ReceiveStartTime AS ReceiveStartTime,
b.ReceiveMode AS ReceiveMethod,
b.ProvideNum AS ReceiveNum,
c.CreateTime AS CreateTime,
c.Price AS Price,
b.RemainCouponNum AS RemainCouponNum,
b.ID AS CouponConfigId,
d.[TYPE] AS CouponsType,
(CASE WHEN b.IconUrl IS NULL THEN N'''' WHEN b.IconUrl=N'''' THEN N'''' ELSE @hostName+b.IconUrl END) AS IconUrl
FROM MK_Campaign a WITH ( NOLOCK )
INNER JOIN MK_CouponConfig b WITH ( NOLOCK ) ON a.ID=b.CampaignID AND (b.[ReceiveStartTime] <= @dt) AND (b.[ReceiveEndTime] >= @dt)
INNER JOIN [dbo].[MK_Coupon] AS c WITH ( NOLOCK ) ON b.[CouponID] = c.[ID] and (2 = b.[CouponGetType]) AND (4 = a.[State])
INNER JOIN [dbo].[MK_CouponRestriction] AS d WITH ( NOLOCK ) ON c.[ID] = d.[CompainID] AND (2 = d.[Type])
LEFT OUTER JOIN MK_CouponRestrictionProduct AS e WITH ( NOLOCK ) ON d.[ID] = e.[CouponRestrictionID]
LEFT OUTER JOIN SL_Product AS f WITH ( NOLOCK ) ON (e.ProductID = f.ID)
INNER JOIN ViewOrganizationCommunityForInterface v ON v.ID=f.PublisherID
where v.CommunityID=@CommunityID
) t
ORDER BY t.Price--@Sort
offset (@PageIndex-1)*@PageSize ROWS FETCH NEXT @PageIndex*@PageSize ROWS ONLY'
end
--执行SQL
exec sp_executesql @strSql,N'@PageIndex int,@PageSize int,@Sort nvarchar(50),@hostName nvarchar(100),@CommunityID UNIQUEIDENTIFIER,@IsGetCount bit,@dt datetime2(7)',@PageIndex =@PageIndex,@PageSize =@PageSize,@Sort=@Sort,@hostName=@hostName,@CommunityID=@CommunityID,@IsGetCount=@IsGetCount,@dt=@dt
set nocount off;
这里需要注意的是，存储执行是，先关闭计数，set nocount on;，然后再打开set nocount off;，这样可以提升性能。还有就是使用WITH ( NOLOCK )允许脏读，提升查询效率。
这里遇到一个很诡异的问题，我使用exec sp_executesql @strSql,N'....'的方式来执行是没有问题的，而如果我使用拼接sql的方式，会报错，因为sql字符串被截断了，只截取到了4000个字符长度，即便我把字符串变量长度设置为nvarchar(max)也没用。
分页方式采用Sqlserver2012以上版本才支持的高效方式：offset ... FETCH NEXT ...ROWS ONLY
原来Linq的执行时间测试：
BLW.png)
我修改为存储过程之后的执行时间测试：
性能差距非常明显。
数据筛选和API优化的更多相关文章
- elasticsearch的数据写入流程及优化
Elasticsearch 写入流程及优化 一. 集群分片设置:ES一旦创建好索引后,就无法调整分片的设置,而在ES中,一个分片实际上对应一个lucene 索引,而lucene索引的读写会占用很多的系 ...
- ASP.NET MVC5+EF6+EasyUI 后台管理系统（81）-数据筛选（万能查询）
系列目录 前言 听标题的名字似乎是一个非常牛X复杂的功能,但是实际上它确实是非常复杂的,我们本节将演示如何实现对数据,进行组合查询(数据筛选) 我们都知道Excel中是如何筛选数据的.就像下面一样 他 ...
- 聚合数据全国天气预报api接口
查询天气预报在APP中常用的一个常用功能,聚合数据全国天气预报api接口可以根据根据城市名/id查询天气.根据IP查询天气.据GPS坐标查询天气.查询城市天气三小时预报,并且支持全国不同城市天气预报查 ...
- .Net程序员安卓学习之路3：Post数据给网络API
本例我们实现一次真正的网络交互,将数据POST到API,然后接收服务器的返回值进行处理,同时引入自定义类型和传说中阿里的FastJson. 实现思路如: 1. 在API端接收客户POST的数据还原成对 ...
- 【百度地图API】今日小年大进步，齐头共进贺佳节——API优化升级上线，不再增加内存消耗
原文:[百度地图API]今日小年大进步,齐头共进贺佳节--API优化升级上线,不再增加内存消耗 任务描述: 今天是2011年01月26日,小年夜.百度地图API在小年夜献给广大API爱好者一份给力的礼 ...
- DataGridView如何实现列标头带数据筛选功能，就象Excel高级筛选功能一样
'近日有本论坛网友问:DataGridView如何实现列标头带数据筛选功能,就象Excel高级筛选功能一样 '今晚正好闲着没事,加之以前也没用到过这个需求,所以就写了个模拟功能,供各位坛友酌情参考. ...
- SQL命令语句进行大数据查询如何进行优化
SQL 大数据查询如何进行优化? 1.对查询进行优化,应尽量避免全表扫描,首先应考虑在 where 及 order by 涉及的列上建立索 2.应尽量避免在 where 子句中对字段进行 null 值 ...
- layui table 根据条件改变更换表格颜色 高亮显示 数据筛选
请问想让当layui表格的某个字段符合某个条件的时候,让该行变颜色.这样可以实现么. layui数据表格怎么更换表格颜色 layui表格 通过判断某一行中的某一列的值进行设置这一行的颜色 LayUI之 ...
- C#进行数据筛选（二）
这里介绍LINQ+Lambda表达式进行数据筛选的方式 这里是第一种方式,还是使用了if条件语句去判断,根据选择的条件去筛选出我所需要的数据 public GxAnaly SelectDay(stri ...
随机推荐
- redis info 详解
# Server(服务器信息)redis_version:3.0.6 #redis服务器版本redis_git_sha1:00000000 ...
- cryptoJS AES 加解密简单使用
简单记录一下,前端利用 cryptoJS 如何加解密的.主要是关于 AES 加解密. 需求描述:需要对 url 中的参数进行 AES 解密,然后再把该参数进行 MD5 加密通过接口传递. AES AE ...
- LINUX capability概念及配置
写的不错的一片博客,可以参考熟悉相关概念,主要将了linux系统的系统调用,以及用法这里就不重新造轮子了 https://www.cnblogs.com/iamfy/archive/2012/09/2 ...
- AccessTokenValidation3 源码分析 jwttoken验证流程图
processon分享地址:https://www.processon.com/view/link/5c6a0b59e4b08a7683c40fc5
- asp.net core mvc上传大文件解决方案
默认上传文件大小不超过30M 第一个问题: IIS 10.0 详细错误 - 404.13 - Not Found 请求筛选模块被配置为拒绝超过请求内容长度的请求. 服务器上的请求筛选被配置为拒绝该请求 ...
- sql server 性能调优之 资源等待SOS_SCHEDULER_YIELD
一.概念 SOS_SCHEDULER_YIELD等待类型是一个任务自愿放弃当前的资源占用,让给其他任务使用. 这个等待类型与CPU有直接关系,与内存与也有间接关系,与CPU有关系是因为在sql s ...
- mysql 开发基础系列16 视图
一. 什么是视图视图是一种虚拟存在的表,行和列数据来自,定义视图的查询中使用的表,并且是在使用视图时动态生成的.优势有: 简单: 使用视图的用户完全不需要关心后面对应的表的结构,关联条件,筛选条件. ...
- casbin的分析
casbin的分析 问题 一般的项目中,都会有权限认证模块,用来控制不同的角色,可以访问的功能.比较出名的权限控制模型有ACL和RABC.如果每个项目中,都重新实现权限控制模块,这样操作会比较繁琐,希 ...
- 分享几个实用的Chrome扩展程序
前言 吐槽一下自己,最近变懒了,博客已经变成月更了.这次分享几个自己工作这几年下来,平常用的比较多的几个谷歌浏览器的扩展程序. AdBlock 最受欢迎的 Chrome 扩展,拥有超过 6000 万用 ...
- Pandas数据去重和对重复数据分类、求和，得到未重复和重复（求和后）的数据
人的理想志向往往和他的能力成正比. —— 约翰逊 其实整个需求呢,就是题目.2018-08-16 需求的结构图: 涉及的包有:pandas.numpy 1.导入包: import pandas as ...