if you have docker-expertise, you could try to get the docker-containers in the following link to do the job for you (creating the executable for windows/linux by setting up a docker-container for each target-system) and starting up the Docker-Containers for Building the Executables from within your Windows-OS. I have not tryed it out though, but the Readme of the project sounds promising.
https://github.com/cdrx/docker-pyinstaller
If the project does what it says, you would only need to execute the following two commands in your project-folder to create the executables for Windows and Linux, when you have gotten everything setted up:
docker run -v "$(pwd):/src/" cdrx/pyinstaller-windows
docker run -v "$(pwd):/src/" cdrx/pyinstaller-linux