0%

网上几乎所有的文章都直接忽悠上CDN的车,难道上CDN就是提升速度的最优解?在CDN这条弯路上折腾了快两年,玩了一圈免备案的CDN,踩了各种各样的坑以后,恍然大悟,茅厕顿开,便在此大放厥词写下此文。本文主要介绍CDN的正确用法,以及性价比爆炸,便宜又效果好的网站加速方案。

Recently, a SOTA sharding approach, GSPMD/GShard, was proposed and it provides an intuitive interface to partition a large array on arbitrary dimensions, while utilizing sharding propagation algorithms to automatically infer the partitioning strategy for tensors without user-specified sharding specifications. This document introduces the design and the implementation of XLA Sharding System.

It would be easier to read the source code if we are aware of the runtime information, including call stacks and variable values. This tutorial introduces how to utilize our powerful VSCode to trace XLA Compiler.

ASC20好死不死决赛场地就在妮可,痛失旅游机会。祸不单行,ASC20取消,合并为ASC20-21,公费旅游机会-=2。雪上加霜,疫情还顺手把晚宴给整没了。没有机票,酒店,和大吃大喝的比赛能叫比赛吗!

It will be convenient if the installation is fully automated when configuring multiple nodes at the same time. However, I believe Ubuntu doesn’t care about unattended installation via the CD image. Its developers seem to be unwilling to write a detailed tutorial about that, even some changes they made make trouble unintentionally. Note that installing via PXE Network Boot is a good alternative.

It is always hard to debug distributed programs. Not only the concurrency is extremely naughty, but we don’t have enough tools, or don’t know there are several tools to debug the distributed programs. But I found that tmux is capable of handling multiple windows, which means it’s possible to control numerous nodes without GUI.

Switch的NAT Type是一个很迷惑的东西,因为似乎没有人能够解释清楚NAT Type的每个类别对应什么意思,又会有什么影响,但是这玩意似乎又能决定一些游戏能否成功联机,比如喷喷。网络上什么说法都有,不过经过我一段时间的摸索,终于理解一丝丝Switch联机的秘密,并找到了不依靠商用加速器提升NAT Type的方法。

This tutorial will introduce how to utilize map-by option to deal with many complex scenarios such as running a hybrid MPI program (mixture of OpenMP and MPI).

我最喜欢SSH的一个功能就是X11 Forwarding,可以把远程服务器的图形界面转发到本地的X11 Server上,然而WSL并不原生支持这个功能(因为Windows里没有原生的X11 Server)。但是其实稍加配置,其实WSL的SSH可以比较好的支持X11 Forwarding。(Chrome OS什么都不需要配置,yyds!)

实际上这次的情况有一些复杂,首先这个集群上跑的是活化石Cent OS,也就是说环境非常的古老(硬件倒是最新的),GCC还是4.8.5,甚至编译不了最新的DGL库。更悲伤的是我并没有这个公用集群的管理员权限,只能想方设法去绕开权限去安装软件,因此我用Conda装了CMake,GCC和G++。所以解决version GLIBCXX_3.4.20 not found这个问题就更加麻烦了,因此这篇文章的解决方法并不适用所有的情况,但可以作为一个参考。