特点：在 ReLU 的基础上引入概率思想，让激活与输入大小平滑相关。
The last week has been particularly tumultuous for Microsoft's gaming division. Former Microsoft Gaming CEO Phil Spencer announced his retirement on Friday, alongside the appointment of Asha Sharma, the President of Microsoft's CoreAI division, as his replacement. Opinions differ as to whether Sharma's new position will be good or bad for Xbox, but more changes are likely on the way.
，更多细节参见夫子
不过，专用粉并非单品种小麦粉，而是将不同品质的小麦按比例搭配在一起，实现优势互补。郑学玲介绍，在确保专用粉品质的前提下提高面粉出粉率，是小麦加工的难题之一。
1L nanoGPT, d=4, 2h