OpenNMT-py v3.1.2
-
fixes: transforms (normalize, clean, inlinetags)
-
Llama support (rotary embeddings, RMSNorm, Silu activation)
-
8bit loading for specific layers (along with LoRa for other layers)
-
subword learner added to build_vocab
fixes: transforms (normalize, clean, inlinetags)
Llama support (rotary embeddings, RMSNorm, Silu activation)
8bit loading for specific layers (along with LoRa for other layers)
subword learner added to build_vocab