Resilient, Distributed AI Training at Scale — Google DeepMind

Decoupled DiLoCo is not only more resilient to failures, but is also practical for executing production-level, fully distributed pre-training. We successfully trained a 12 billion parameter model across four separate U.S. regions using 2-5 Gbps of wide-area networking (a level relatively achievable using existing internet connectivity between datacenter facilities, rather than requiring new custom network…

Read More

    Compass Pathways CEO on Trump's Order to Expand Psychedelics Research

    Shares of companies involved in psychedelic-tied therapies surged Monday after President Donald Trump signed an executive order to expedite research and access. US-traded shares of Compass Pathways spiked as much as 53% while AtaiBeckley surged by 37%. GH Research jumped 34% and Definium Therapeutics rallied 16%. The AdvisorShares Psychedelics ETF (PSIL) also climbed as much as 20% — touching its highest intraday level…

    Read More