CD-GraB paper is accepted by NeurIPS'23 as a poster
CD-GraB paper is accepted by NeurIPS'23 as a poster
CD-GraB paper is accepted by NeurIPS'23! Thanks for my collaborators and my advisor Prof. Chris De Sa! We extend our previous GraB paper with dencentralized data in parameter server setting and propose CD-GraB algorithm. We could find a better distributed data permutation than distributed random reshuffling with decentralized data!
Wentao Guo
CS PhD student @ Princeton
I am a CS PhD student at Princeton University. My research interests include improving the efficiency of LLMs during fine-tuning and deployment.