Function_releated
Q: How Do I Generate a Model Sharding Strategy File?
A: The model sharding strategy file documents the sharding strategy for model weights in distributed scenarios and is generally used when slicing weights offline. Configure only_save_strategy: True
in the network yaml
file, and then start the distributed task normally, then the distributed strategy file can be generated in the output/strategy/
directory. For details, please refer to the Tutorial on Slicing and Merging Distributed Weights.
Q: How Can I Do When socket.gaierror: [Errno -2] Name or service not known
or socket.gaierror: [Errno -3] Temporary failure in name resolution
is Reported in ranktable
Generation File?
A: Starting from MindFormers r1.2.0
version, cluster startup is unified using msrun
method, and ranktable
startup method is deprecated.