Diverse Expert Ensembles: embarrassingly parallel LLMs from diverse experts

SkipPipe: a communication efficient method for decentralised training

RL Swarm: a framework for collaborative RL

Verde: a verification system for machine learning over untrusted nodes