https://shjwudp.github.io/news/announcement_1/ 2015-10-22T19:59:00+00:00 https://shjwudp.github.io/news/announcement_2/ 2015-11-07T20:11:00+00:00 https://shjwudp.github.io/news/announcement_3/ 2016-01-15T11:59:00+00:00 https://shjwudp.github.io/blog/2023/gpt-training-memory-estimation-nemo-training-practice/ 2023-08-22T12:00:00+00:00 https://shjwudp.github.io/blog/2023/math-for-megatron-moe/ 2023-10-19T12:00:00+00:00 https://shjwudp.github.io/blog/2023/you-need-to-know-about-megatron-lm-distributedoptimizer/ 2023-10-27T08:00:00+00:00 https://shjwudp.github.io/projects/1_project/ 2023-10-29T03:17:47+00:00 https://shjwudp.github.io/projects/2_project/ 2023-10-29T03:17:47+00:00 https://shjwudp.github.io/projects/3_project/ 2023-10-29T03:17:47+00:00 https://shjwudp.github.io/projects/4_project/ 2023-10-29T03:17:47+00:00 https://shjwudp.github.io/projects/5_project/ 2023-10-29T03:17:47+00:00 https://shjwudp.github.io/projects/6_project/ 2023-10-29T03:17:47+00:00 https://shjwudp.github.io/news/ https://shjwudp.github.io/blog/tag/nemo/ https://shjwudp.github.io/blog/tag/gpt/ https://shjwudp.github.io/blog/tag/training/ https://shjwudp.github.io/blog/tag/memory-estimation/ https://shjwudp.github.io/blog/tag/mixture-of-experts/ https://shjwudp.github.io/blog/tag/megatron-lm/ https://shjwudp.github.io/blog/category/article/ https://shjwudp.github.io/blog/category/note/ https://shjwudp.github.io/blog/2023/