The docs have a link to Deployments > Azure Web App on Windows but no link to Azure Web App on Linux.
[Update]
It is not possible to data enter the app service name.
[Update]
It turns out that the order of filling things in matters. Once I filled in the settings for the pipeline task then I could enter data in the Azure App Service Task.

