[转]Compact Normal Storage for Small G-Buffers
http://aras-p.info/texts/CompactNormalStorage.html
- Intro
- Baseline: store X&Y&Z
- Method 1: X&Y
- Method 3: Spherical Coordinates
- Method 4: Spheremap Transform
- Method 7: Stereographic projection
- Method 8: Per-pixel View Space
- Performance Comparison
- Quality Comparison
- Changelog
Intro
Various deferred shading/lighting approaches or image postprocessing effects need to store normals as part of their G-buffer. Let’s figure out a compact storage method for view space normals. In my case, main target is minimalist G-buffer, where depth and normals are packed into a single 32 bit (8 bits/channel) render texture. I try to minimize error and shader cycles to encode/decode.
Now of course, 8 bits/channel storage for normals can be not enough for shading, especially if you want specular (low precision & quantization leads to specular “wobble” when camera or objects move). However, everything below should Just Work (tm) for 10 or 16 bits/channel integer formats. For 16 bits/channel half-float formats, some of the computations are not necessary (e.g. bringing normal values into 0..1 range).
If you know other ways to store/encode normals, please let me know in the comments!
Various normal encoding methods and their comparison below. Notes:
- Error images are: 1-pow(dot(n1,n2),1024) and abs(n1-n2)*30, where n1 is actual normal, andn2 is normal encoded into a texture, read back & decoded. MSE and PSNR is computed on the difference (abs(n1-n2)) image.
- Shader code is HLSL. Compiled into ps_3_0 by d3dx9_42.dll (February 2010 SDK).
- Radeon GPU performance numbers from AMD’s GPU ShaderAnalyzer 1.53, using Catalyst 9.12 driver.
- GeForce GPU performance numbers from NVIDIA’s NVShaderPerf 2.0, using 174.74 driver.
Note: there was an error!
Original version of my article had some stupidity: encoding shaders did not normalize the incoming per-vertex normal. This resulted in quality evaluation results being somewhat wrong. Also, if normal is assumed to be normalized, then three methods in original article (Sphere Map, Cry Engine 3 and Lambert Azimuthal) are in fact completely equivalent. The old version is still available for the sake of integrity of the internets.
Test Playground Application
Here is a small Windows application I used to test everything below: NormalEncodingPlayground.zip(4.8MB, source included).
It requires GPU with Shader Model 3.0 support. When it writes fancy shader reports, it expects AMD’s GPUShaderAnalyzer and NVIDIA’s NVShaderPerf to be installed. Source code should build with Visual C++ 2008.
Baseline: store X&Y&Z
Just to set the basis, store all three components of the normal. It’s not suitable for our quest, but I include it here to evaluate “base” encoding error (which happens here only because of quantization to 8 bits per component).
Encoding, Error to Power, Error * 30 images below. MSE: 0.000008; PSNR: 51.081 dB.
Encoding | Decoding |
---|---|
half4 encode (half3 n, float3 view) |
half3 decode (half4 enc, float3 view) |
ps_3_0 |
ps_3_0 |
1 ALU |
2 ALU, 1 TEX |
Method #1: store X&Y, reconstruct Z
Used by Killzone 2 among others (PDF link).
Encoding, Error to Power, Error * 30 images below. MSE: 0.013514; PSNR: 18.692 dB.
Pros:
|
Cons:
|
Encoding | Decoding |
---|---|
half4 encode (half3 n, float3 view) |
half3 decode (half2 enc, float3 view) |
ps_3_0 |
ps_3_0 |
1 ALU |
7 ALU, 1 TEX |
Method #3: Spherical Coordinates
It is possible to use spherical coordinates to encode the normal. Since we know it’s unit length, we can just store the two angles.
Suggested by Pat Wilson of Garage Games: GG blog post. Other mentions: MJP’s blog, GarageGames thread, Wolf Engel’s blog, gamedev.net forum thread.
Encoding, Error to Power, Error * 30 images below. MSE: 0.000062; PSNR: 42.042 dB.
Pros:
|
Cons:
|
Encoding | Decoding |
---|---|
#define kPI 3.1415926536f |
half3 decode (half2 enc, float3 view) |
ps_3_0 |
ps_3_0 |
26 ALU |
17 ALU, 1 TEX |
Method #4: Spheremap Transform
Spherical environment mapping (indirectly) maps reflection vector to a texture coordinate in [0..1] range. The reflection vector can point away from the camera, just like our view space normals. Bingo! See Siggraph 99 notes for sphere map math. Normal we want to encode is R, resulting values are (s,t).
If we assume that incoming normal is normalized, then there are methods derived from elsewhere that end up being exactly equivalent:
- Used in Cry Engine 3, presented by Martin Mittring in “A bit more Deferred” presentation (PPT link, slide 13). For Unity, I had to negate Z component of view space normal to produce good results, I guess Unity’s and Cry Engine’s coordinate systems are different. The code would be:
half2 encode (half3 n, float3 view)
{
half2 enc = normalize(n.xy) * (sqrt(-n.z*0.5+0.5));
enc = enc*0.5+0.5;
return enc;
}
half3 decode (half4 enc, float3 view)
{
half4 nn = enc*half4(2,2,0,0) + half4(-1,-1,1,-1);
half l = dot(nn.xyz,-nn.xyw);
nn.z = l;
nn.xy *= sqrt(l);
return nn.xyz * 2 + half3(0,0,-1);
} - Lambert Azimuthal Equal-Area projection (Wikipedia link). Suggested by Sean Barrett in comments for this article. The code would be:
half2 encode (half3 n, float3 view)
{
half f = sqrt(8*n.z+8);
return n.xy / f + 0.5;
}
half3 decode (half4 enc, float3 view)
{
half2 fenc = enc*4-2;
half f = dot(fenc,fenc);
half g = sqrt(1-f/4);
half3 n;
n.xy = fenc*g;
n.z = 1-f/2;
return n;
}
Encoding, Error to Power, Error * 30 images below. MSE: 0.000016; PSNR: 48.071 dB.
Pros:
|
Cons:
|
Encoding | Decoding |
---|---|
half4 encode (half3 n, float3 view) |
half3 decode (half2 enc, float3 view) |
ps_3_0 |
ps_3_0 |
4 ALU |
8 ALU, 1 TEX |
Method #7: Stereographic Projection
What the title says: use Stereographic Projection (Wikipedia link), plus rescaling so that “practically visible” range of normals maps into unit circle (regular stereographic projection maps sphere to circle of infinite size). In my tests, scaling factor of 1.7777 produced best results; in practice it depends on FOV used and how much do you care about normals that point away from the camera.
Suggested by Sean Barrett and Ignacio Castano in comments for this article.
Encoding, Error to Power, Error * 30 images below. MSE: 0.000038; PSNR: 44.147 dB.
Pros:
|
Cons:
|
Encoding | Decoding |
---|---|
half4 encode (half3 n, float3 view) |
half3 decode (half4 enc, float3 view) |
ps_3_0 |
ps_3_0 |
5 ALU |
7 ALU, 1 TEX |
Method #8: Per-pixel View Space
If we compute view space per-pixel, then Z component of a normal can never be negative. Then just store X&Y, and compute Z.
Suggested by Yuriy O’Donnell on Twitter.
Encoding, Error to Power, Error * 30 images below. MSE: 0.000134; PSNR: 38.730 dB.
Pros:
|
Cons:
|
Encoding | Decoding |
---|---|
float3x3 make_view_mat (float3 view) |
|
ps_3_0 |
ps_3_0 |
17 ALU |
21 ALU, 1 TEX |
Performance Comparison
GPU performance comparison in a single table:
#1: X & Y | #3: Spherical | #4: Spheremap | #7: Stereo | #8: PPView | |||
---|---|---|---|---|---|---|---|
Encoding, GPU cycles | |||||||
Radeon HD2400 | 1.00 | 17.00 | 3.00 | 4.00 | 11.00 | ||
Radeon HD5870 | 0.50 | 0.95 | 0.50 | 0.50 | 0.80 | ||
GeForce 6200 | 1.00 | 12.00 | 4.00 | 2.00 | 12.00 | ||
GeForce 8800 | 7.00 | 43.00 | 12.00 | 12.00 | 24.00 | ||
Decoding, GPU cycles | |||||||
Radeon HD2400 | 1.00 | 17.00 | 3.00 | 4.00 | 11.00 | ||
Radeon HD5870 | 0.50 | 0.95 | 0.50 | 1.00 | 0.80 | ||
GeForce 6200 | 4.00 | 7.00 | 6.00 | 4.00 | 12.00 | ||
GeForce 8800 | 15.00 | 23.00 | 15.00 | 12.00 | 29.00 | ||
Encoding, D3D ALU+TEX instruction slots | |||||||
SM3.0 | 1 | 26 | 4 | 5 | 17 | ||
Decoding, D3D ALU+TEX instruction slots | |||||||
SM3.0 | 8 | 18 | 9 | 8 | 22 |
Quality Comparison
Quality comparison in a single table. PSNR based, higher numbers are better.
Method | PSNR, dB |
---|---|
#1: X & Y | 18.629 |
#3: Spherical | 42.042 |
#4: Spheremap | 48.071 |
#7: Stereographic | 44.147 |
#8: Per pixel view | 38.730 |
Changelog
- 2010 03 25: Added Method #8: Per-pixel View Space. Suggested by Yuriy O’Donnell.
- 2010 03 24: Stop! Everything before was wrong! Old article moved here.
- 2009 08 12: Added Method #7: Stereographic projection. Suggested by Sean Barrett and Ignacio Castano.
- 2009 08 12: Optimized Method #5, suggested by Steve Hill.
- 2009 08 08: Added power difference images.
- 2009 08 07: Optimized Method #4: Sphere map. Suggested by Irenee Caroulle.
- 2009 08 07: Added Method #6: Lambert Azimuthal Equal Area. Suggested by Sean Barrett.
- 2009 08 05: Added Method #5: Cry Engine 3. Suggested by Steve Hill.
- 2009 08 05: Improved quality of Method #3a: round values in texture LUT.
- 2009 08 05: Added MSE and PSNR values for all methods.
- 2009 08 04: Added Method #3a: Spherical Coordinates w/ texture LUT.
- 2009 08 04: Method #1: 1-dot(n.xy,n.xy) is slightly better than 1-n.x*n.x-n.y*n.y (better pipelining on NV and ATI). Suggested by Arseny “zeux” Kapoulkine.
[转]Compact Normal Storage for Small G-Buffers的更多相关文章
- DirectX11 With Windows SDK--36 延迟渲染基础
前言 随着图形硬件变得越来越通用和可编程化,采用实时3D图形渲染的应用程序已经开始探索传统渲染管线的替代方案,以避免其缺点.其中一项最流行的技术就是所谓的延迟渲染.这项技术主要是为了支持大量的动态灯光 ...
- Hierarchical Storage structure
1.hierarchical storage structure This notion of inserting a smaller, faster storage device (e.g ...
- SQLiteSpy - A fast and compact GUI database manager for SQLite
http://www.yunqa.de/delphi/doku.php/products/sqlitespy/index SQLiteSpy is a fast and compact GUI dat ...
- free -g 说明
free -g 说明: free -g -/+ buffers/cache 说明: buffer 写缓存,表示脏数据写入磁盘之前缓存一段时间,可以释放.sync命令可以把buffer强制写入硬盘 ca ...
- Method and Apparatus for Providing Highly-Scalable Network Storage for Well-Gridded Objects
An apparatus comprising a plurality of storage nodes comprising a plurality of corresponding storage ...
- Flexible implementation of a system management mode (SMM) in a processor
A system management mode (SMM) of operating a processor includes only a basic set of hardwired hooks ...
- [MySQL Reference Manual]14 InnoDB存储引擎
14 InnoDB存储引擎 14 InnoDB存储引擎 14.1 InnoDB说明 14.1.1 InnoDB作为默认存储引擎 14.1.1.1 存储引擎的趋势 14.1.1.2 InnoDB变成默认 ...
- UBIFS FAQ and HOWTO
转:http://www.linux-mtd.infradead.org/faq/ubifs.html UBIFS FAQ and HOWTO Table of contents How do I e ...
- C++开源库集合
| Main | Site Index | Download | mimetic A free/GPL C++ MIME Library mimetic is a free/GPL Email lib ...
随机推荐
- 关于标准库中的ptr_fun/binary_function/bind1st/bind2nd
http://www.cnblogs.com/shootingstars/archive/2008/11/14/860042.html 以前使用bind1st以及bind2nd很少,后来发现这两个函数 ...
- 【HDOJ】1720 A+B coming
水题. #include <stdio.h> #include <string.h> #define MAXNUM 1005 int stoi(char); int main( ...
- Service Oriented Architecture
What is Service Oriented Architecture (SOA)? There have been so many interpretations of this through ...
- Android开发之Fragment的介绍、使用及生命周期
Fragment官网介绍-http://developer.android.com/guide/components/fragments.html 郭大神的使用实例文章:http://blog.csd ...
- java里的静态变量是放在了堆内存还是栈内存?
堆区: 1.存储的全部是对象,每个对象都包含一个与之对应的class的信息.(class的目的是得到操作指令) 2.jvm只有一个堆区(heap)被所有线程共享,堆中不存放基本类型和对象引用,只存放对 ...
- wildfly9 配置SSL单向认证/https
D:\>keytool -genkey -keystore cdi-init.keystore -alias cdi-init -keyalg RSA -keysize 2048 -validi ...
- 【转】Xcode常用快捷键与技巧分享
原文网址:http://www.jianshu.com/p/039954b0cbe0 工欲善其事必先利其器. 虽然Xcode编写objective-c or swift很完美, 但了解其工具的常用快捷 ...
- jQuery-单击文字或图片内容放大显示效果插件
css很强大,jQuery也很强大,两者结合在一起就是无比强大.这里要介绍的这个单击文字或图片内容放大居中显示的效果就是这两者结合的产物. 先来介绍css和jQuery各自发挥了什么作用吧: css: ...
- CSS学习笔记——定位position属性的学习
今天学习之前剩下的一个问题:CSS的position属性.首先归纳出和position相关的问题: position作为一个属性,它一共有哪几个属性值? position常用的属性值有哪几个?分别有什 ...
- C#:实体类中做数据验证
主要是在实体类中验证 using System; namespace Jone.Function.attribute{ /// <summary> /// 附加 ...