Meta released its models trained on multi-token prediction for research purposes
Meta has released pre-trained code completion models licensed for research use. The models were trained using a novel multi-token prediction approach, which improves performance and inference speed without additional training time or memory overhead.