Neural Texture Compression using Hypernetworks

GenAI TDIG Inpainting
近期关于神经纹理压缩的研究表明,可以学习得到尺寸较小的、针对每种材质的纹理表示(由隐式纹理和一个小型多层感知机解码器构成),该表示可在着色过程中实时解码,以重建物理真实感着色模型所需的输入。然而,现有方法在给定多层感知机结构及隐式纹理配置的前提下,仍需针对每种材质单独执行基于梯度下降的优化过程。本工作提出训练一个统一的超网络,该网络可同时输出隐式特征以及多层感知机的全部权重与偏置参数。尽管解空间维度极高,该方法所生成结果的质量仍可与当前主流的神经纹理压缩基准方法相媲美。此外,我们进一步将该方法拓展至可同时推断多个解码器,甚至能生成具备超分辨率能力的解码器。
Recent work on neural texture compression has demonstrated that it is possible to learn small, per-material texture representations (composed of latent textures and a small Multi-Layer Perceptron decoder) that can be decoded in real-time during shading to reproduce the input to a physically based shading model. However, existing methods require performing gradient-descent optimization per material for a given MLP and latent configuration. In this work, we train a single hypernetwork that outputs both the latent features and the MLP's weights and biases. Though the solution space is high-dimensional, this approach produces results comparable in quality to the current reference neural texture compressors. We further extend this approach to infer multiple decoders at once or even produce decoders that learn super-resolution.
许愿