Topological constraints on self-organisation in locally interacting systems

ML GNN and MP GNNs PGM Other ML AI4S PINNs
所有智能都是集体智能,因为它由必须与系统级目标对齐的部分组成。理解这些对齐部分在问题空间中导航的动态机制,无论是促进还是限制,都会影响从生命科学到工程学的多个领域。为此,考虑一个位于平面图顶点上的系统,其成对相互作用由图的边规定。这类系统有时会展现出长程有序性,从而区分出不同的宏观行为阶段。在交互系统的网络中,我们可以将自发有序视为一种自组织形式,用以模拟神经和基础认知形式。在此基础上,我们讨论了图的拓扑结构对于有序相存在的必要条件,并着眼于寻找具有局部相互作用的系统维持有序目标状态的能力限制。通过研究三个模型系统(Potts模型、自回归模型和层次网络)中域壁形成时自由能的变化,我们展示了图上相互作用的组合学如何防止或允许自发有序。作为应用,我们能够分析为什么像生物学中常见的多尺度系统能够组织成复杂模式,而初级语言模型则难以处理长序列输出。
All intelligence is collective intelligence, in the sense that it is made of parts which must align with respect to system-level goals. Understanding the dynamics which facilitate or limit navigation of problem spaces by aligned parts thus impacts many fields ranging across life sciences and engineering. To that end, consider a system on the vertices of a planar graph, with pairwise interactions prescribed by the edges of the graph. Such systems can sometimes exhibit long-range order, distinguishing one phase of macroscopic behaviour from another. In networks of interacting systems we may view spontaneous ordering as a form of self-organisation, modelling neural and basal forms of cognition. Here, we discuss necessary conditions on the topology of the graph for an ordered phase to exist, with an eye towards finding constraints on the ability of a system with local interactions to maintain an ordered target state. By studying the scaling of free energy under the formation of domain walls in three model systems -- the Potts model, autoregressive models, and hierarchical networks -- we show how the combinatorics of interactions on a graph prevent or allow spontaneous ordering. As an application we are able to analyse why multiscale systems like those prevalent in biology are capable of organising into complex patterns, whereas rudimentary language models are challenged by long sequences of outputs.
许愿