Add log probs for all tokens #2840

Job	Run time
build-and-test-cpp-x86_64 (ubuntu-20.04, mkl)	6m 14s
build-and-test-cpp-x86_64 (ubuntu-20.04, mkl)	6m 14s
build-and-push-docker-images	29m 17s
build-and-push-docker-images	29m 17s
build-and-test-cpp-aarch64 (openblas)	4m 32s
build-and-test-cpp-aarch64 (openblas)	4m 32s
build-and-test-cpp-x86_64 (ubuntu-20.04, dnnl)	5m 59s
build-and-test-cpp-x86_64 (ubuntu-20.04, dnnl)	5m 59s
build-python-wheels (ubuntu-20.04, auto64)	35m 3s
build-python-wheels (ubuntu-20.04, auto64)	35m 3s
build-python-wheels (windows-2019, auto64)	52m 43s
build-python-wheels (windows-2019, auto64)	52m 43s
check-python-style	10s
check-python-style	10s
build-python-wheels (ubuntu-20.04, aarch64)	1h 18m 12s
build-python-wheels (ubuntu-20.04, aarch64)	1h 18m 12s
build-python-wheels (macos-12, arm64)	7m 21s
build-python-wheels (macos-12, arm64)	7m 21s
build-and-deploy-docs	32s
build-and-deploy-docs	32s
test-python-wheels (ubuntu-20.04)	4m 15s
test-python-wheels (ubuntu-20.04)	6m 0s
test-python-wheels (windows-2019)	3m 54s
test-python-wheels (windows-2019)	5m 41s
publish-python-wheels-on-pypi	0s
publish-python-wheels-on-pypi	0s
	7h 39m 56s

Provide feedback