It seems that not all selected tests are run even if all the pre requisites are valid

[nmco]

The testing server was configured with all the necessary data:

<Contents>
    <Layer>
      <ows:Title>TransparentNodata</ows:Title>
      <ows:WGS84BoundingBox>
        <ows:LowerCorner>-180.0 -89.9011075949367</ows:LowerCorner>
        <ows:UpperCorner>-0.0988924050632818 90.0</ows:UpperCorner>
      </ows:WGS84BoundingBox>
      <ows:Identifier>TransparentNodata</ows:Identifier>
      <Style isDefault="true">
        <ows:Identifier>Default_style</ows:Identifier>
        <LegendURL format="image/png" xlink:href="http://localhost:8085/geoserver/sf/sf/ows?service=WMS&amp;request=GetLegendGraphic&amp;format=image%2Fpng&amp;width=20&amp;height=20&amp;layer=sf%3ATransparentNodata" width="20" height="20"/>
      </Style>
      <Format>image/png</Format>
      <Format>image/jpeg</Format>
      <InfoFormat>text/plain</InfoFormat>
      <InfoFormat>application/vnd.ogc.gml</InfoFormat>
      <InfoFormat>text/xml</InfoFormat>
      <InfoFormat>application/vnd.ogc.gml/3.1.1</InfoFormat>
      <InfoFormat>text/xml</InfoFormat>
      <InfoFormat>text/html</InfoFormat>
      <InfoFormat>application/json</InfoFormat>
      <TileMatrixSetLink>
        <TileMatrixSet>TransparentNodata</TileMatrixSet>
        <TileMatrixSetLimits>
          <TileMatrixLimits>
            <TileMatrix>TransparentNodata:0</TileMatrix>
            <MinTileRow>0</MinTileRow>
            <MaxTileRow>0</MaxTileRow>
            <MinTileCol>0</MinTileCol>
            <MaxTileCol>0</MaxTileCol>
          </TileMatrixLimits>
        </TileMatrixSetLimits>
      </TileMatrixSetLink>
      <ResourceURL format="image/png" resourceType="tile" template="http://localhost:8085/geoserver/sf/gwc/rest/wmts/TransparentNodata/{style}/{TileMatrixSet}/{TileMatrix}/{TileRow}/{TileCol}?format=image/png"/>
      <ResourceURL format="image/jpeg" resourceType="tile" template="http://localhost:8085/geoserver/sf/gwc/rest/wmts/TransparentNodata/{style}/{TileMatrixSet}/{TileMatrix}/{TileRow}/{TileCol}?format=image/jpeg"/>
      <ResourceURL format="text/plain" resourceType="FeatureInfo" template="http://localhost:8085/geoserver/sf/gwc/rest/wmts/TransparentNodata/{style}/{TileMatrixSet}/{TileMatrix}/{TileRow}/{TileCol}/{J}/{I}?format=text/plain"/>
      <ResourceURL format="application/vnd.ogc.gml" resourceType="FeatureInfo" template="http://localhost:8085/geoserver/sf/gwc/rest/wmts/TransparentNodata/{style}/{TileMatrixSet}/{TileMatrix}/{TileRow}/{TileCol}/{J}/{I}?format=application/vnd.ogc.gml"/>
      <ResourceURL format="text/xml" resourceType="FeatureInfo" template="http://localhost:8085/geoserver/sf/gwc/rest/wmts/TransparentNodata/{style}/{TileMatrixSet}/{TileMatrix}/{TileRow}/{TileCol}/{J}/{I}?format=text/xml"/>
      <ResourceURL format="application/vnd.ogc.gml/3.1.1" resourceType="FeatureInfo" template="http://localhost:8085/geoserver/sf/gwc/rest/wmts/TransparentNodata/{style}/{TileMatrixSet}/{TileMatrix}/{TileRow}/{TileCol}/{J}/{I}?format=application/vnd.ogc.gml/3.1.1"/>
      <ResourceURL format="text/xml" resourceType="FeatureInfo" template="http://localhost:8085/geoserver/sf/gwc/rest/wmts/TransparentNodata/{style}/{TileMatrixSet}/{TileMatrix}/{TileRow}/{TileCol}/{J}/{I}?format=text/xml"/>
      <ResourceURL format="text/html" resourceType="FeatureInfo" template="http://localhost:8085/geoserver/sf/gwc/rest/wmts/TransparentNodata/{style}/{TileMatrixSet}/{TileMatrix}/{TileRow}/{TileCol}/{J}/{I}?format=text/html"/>
      <ResourceURL format="application/json" resourceType="FeatureInfo" template="http://localhost:8085/geoserver/sf/gwc/rest/wmts/TransparentNodata/{style}/{TileMatrixSet}/{TileMatrix}/{TileRow}/{TileCol}/{J}/{I}?format=application/json"/>
    </Layer>

According to the GetFeatureInfo tests where selected for running:

    It must support both GetCapabilities and GetTile operations for KVP GET binding for any further tests to be performed. 

         KVP GET

         Checking prerequisites...

         Server supports KVP GET GetCapabilities and GetTile ... continuing prerequisite check.

         No image format found for LegendURL

         Layer TransparentNodata minScaleDenominator  not found for TileMatrix from any TileMatrix set for Layer.

         Layer TransparentNodata maxScaleDenominator  not found for TileMatrix from any TileMatrix set for Layer.

         Layer TransparentNodata image width found for LegendURL -1 does not match specified width 20

         Layer TransparentNodata image height found for LegendURL -1 does not match specified height 20

         No image format found for LegendURL

         Layer states minScaleDenominator  not found for TileMatrix from any TileMatrix set for Layer.

         Layer states maxScaleDenominator  not found for TileMatrix from any TileMatrix set for Layer.

         Layer states image width found for LegendURL -1 does not match specified width 20

         Layer states image height found for LegendURL -1 does not match specified height 20

         check.prerequisites.elapsed [189] milliseconds

         Completed prerequisite check:

         Get options to run tests

         Server.KVP.GET.HTTP.Mandatory.Selected:true

         Server.KVP.GET.InvalidQueryString.Selected:true

         Server.KVP.GET.InvalidService.Selected:true

         Server.KVP.GET.InvalidRequest.Selected:true

         Server.KVP.GET.GetCapabilities.Request.Mandatory.Selected:true

         Server.KVP.GET.GetCapabilities.Request.NoService.Selected:true

         Server.KVP.GET.GetCapabilities.Request.InvalidService.Selected:true

         Server.KVP.GET.GetCapabilities.Request.AcceptVersions.Valid.Selected:true

         Server.KVP.GET.GetCapabilities.Request.AcceptVersions.Invalid.Selected:true

         Server.KVP.GET.GetCapabilities.Request.CaseInsensitive.KVP.Names.Selected:true

         Server.KVP.GET.GetCapabilities.Request.Sections.All.Selected:true

         Server.KVP.GET.GetCapabilities.Request.Sections.ServiceIdentification.Selected:true

         Server.KVP.GET.GetCapabilities.Request.Sections.ServiceProvider.Selected:true

         Server.KVP.GET.GetCapabilities.Request.Sections.OperationsMetadata.Selected:true

         Server.KVP.GET.GetCapabilities.Request.Sections.Contents.Selected:true

         Server.KVP.GET.GetCapabilities.Request.Sections.Themes.Selected:true

         Server.KVP.GET.GetCapabilities.Request.Sections.Multiple.Selected:true

         Server.KVP.GET.GetCapabilities.Request.Sections.Invalid.Selected:true

         Server.KVP.GET.GetCapabilities.Request.Sections.Missing.Selected:true

         Server.KVP.GET.GetCapabilities.Request.UpdateSequence.Selected:true

         Server.KVP.GET.GetCapabilities.Request.AcceptFormats.Selected:true

         Server.KVP.GET.GetCapabilities.Response.XML.Well.Formed.Selected:true

         Server.KVP.GET.GetCapabilities.Response.SchemaReferenced.Selected:true

         Server.KVP.GET.GetCapabilities.Response.SchemaValid.Selected:true

         Server.KVP.GET.GetCapabilities.Response.AdvertisedFormat.Selected:true

         Server.KVP.GET.GetCapabilities.Response.OnlineResource.Selected:true

         Server.KVP.GET.GetCapabilities.Response.Encoding.Constraint.Selected:true

         Server.KVP.GET.GetCapabilities.Response.Layer.Identifiers.Unique.Selected:true

         Server.KVP.GET.GetCapabilities.Response.Layer.LegendURL.Correct.Resource.Selected:true

         Server.KVP.GET.GetCapabilities.Response.Layer.LegendURL.Correct.Format.Selected:true

         Server.KVP.GET.GetCapabilities.Response.Layer.LegendURL.Correct.Size.Selected:true

         Server.KVP.GET.GetCapabilities.Response.Layer.TileMatrixSet.Valid.Selected:true

         Server.KVP.GET.GetCapabilities.Response.TileMatrixSet.Identifiers.Unique.Selected:true

         Server.KVP.GET.GetCapabilities.Response.TileMatrix.Identifiers.Unique.Selected:true

         Server.KVP.GET.GetCapabilities.Response.TileMatrixSet.ScaleDenominators.Unique.Selected:true

         Server.KVP.GET.GetCapabilities.Response.TileMatrixSet.WellKnownScaleSet.Selected:true

         Server.KVP.GET.GetCapabilities.Response.Theme.LayerRef.Valid.Selected:true

         Server.KVP.GET.GetTile.Mandatory.Selected:true

         Server.KVP.GET.GetTile.Optional.Selected:true

         Server.KVP.GET.GetTile.Missing.Selected:true

         Server.KVP.GET.GetTile.Invalid.Layer.Selected:true

         Server.KVP.GET.GetTile.Invalid.TileMatrixSet.Selected:true

         Server.KVP.GET.GetTile.Invalid.TileMatrix.Selected:true

         Server.KVP.GET.GetTile.Invalid.Tile.Row.TileMatrixSetLimits.Selected:true

         Server.KVP.GET.GetTile.Invalid.Tile.Col.TileMatrixSetLimits.Selected:true

         Server.KVP.GET.GetTile.Invalid.Tile.Style.Selected:true

         Server.KVP.GET.GetTile.Invalid.SampleDimension.Value.Selected:true

         Server.KVP.GET.GetTile.Default.SampleDimension.Selected:true

         Server.KVP.GET.GetTile.Current.SampleDimension.Selected:true

         Server.KVP.GET.GetTile.Valid.Tile.Format.Selected:true

         Server.KVP.GET.GetTile.Invalid.Tile.Format.Selected:true

         Server.KVP.GET.GetTile.Valid.Tile.Size.Selected:true

         Server.KVP.GET.GetTile.Valid.Tile.Transparency.Selected:true

         Server.KVP.GET.GetFeatureInfo.Mandatory.Selected:true

         Server.KVP.GET.GetFeatureInfo.Optional.Selected:true

         Server.KVP.GET.GetFeatureInfo.Missing.Selected:true

         Server.KVP.GET.GetFeatureInfo.Invalid.Layer.Selected:true

         Server.KVP.GET.GetFeatureInfo.Invalid.TileMatrixSet.Selected:true

         Server.KVP.GET.GetFeatureInfo.Invalid.TileMatrix.Selected:true

         Server.KVP.GET.GetFeatureInfo.Invalid.Tile.Row.TileMatrixSetLimits.Selected:true

         Server.KVP.GET.GetFeatureInfo.Invalid.Tile.Col.TileMatrixSetLimits.Selected:true

         Server.KVP.GET.GetFeatureInfo.Invalid.Tile.Style.Selected:true

         Server.KVP.GET.GetFeatureInfo.Invalid.SampleDimension.Value.Selected:true

         Server.KVP.GET.GetFeatureInfo.Default.SampleDimension.Selected:true

         Server.KVP.GET.GetFeatureInfo.Current.SampleDimension.Selected:true

         Server.KVP.GET.GetFeatureInfo.NonQueryable.Layer.Selected:true

         Server.KVP.GET.GetFeatureInfo.Valid.InfoFormat.Selected:true

         Server.KVP.GET.GetFeatureInfo.Invalid.InfoFormat.Selected:true

         Server.KVP.GET.GetFeatureInfo.Invalid.Pixel.Row.J.Selected:true

         Server.KVP.GET.GetFeatureInfo.Invalid.Pixel.Col.I.Selected:true

         Completed test selecton - selected tests will now be run in Test Mode mode.

         InvokeTestGroupsForBinding KVP.GET

But according to the test report no GetFeatureInfo test run:

Not that all operations were selected for testing:

[keshavnangare]

@dstenger

According to the issue opengeospatial/teamengine#141 and #28 the optional tests was removed, so the test GetFeatureInfo is optional that's why it is not executed.

[dstenger]

I created following issue to reactivate optional tests: #47

So, this issue can be closed as question was answered in #41 (comment).