Add below to the Configuration function of the Startup.cs file.
Make sure you use the same name ("test" here) and the "API URL suffix" in Azure.

services.AddSwaggerGen(c =>
{
    c.SwaggerDoc("test", new OpenApiInfo { Title = "TestAPI", Version = "v1" });
});

In the web deployment profile add below line under 

v1