Clean up WeightRow
in preparation for optimizer state offloading#4021
Open
q10 wants to merge 3 commits intopytorch:mainfrom
WeightRow
in preparation for optimizer state offloading#4021