October 2019

Author: Juan Carlos Cruellas, UPC cruellas@ac.upc.edu


Contents

  1. Introduction

  2. Generation and Cross-validation

  3. Only Validation

  4. Conformance testing tools


Introduction

The present document provides details on how the participants need to interact with the portal for conducting the different types of interoperability tests, namely:

  1. Generation and Cross-validation.

  2. Only Validation.


Generation and Cross-validation

The figure below shows two participants interacting with the portal for downloading the material present in the portal, locally performing the required operations for signature generation and cross-validation plugtests type, and uploading to the portal the obtained results .

Each participant:

downloads the so-called initial package. This package contains the AdES signatures and ASiC containers already uploaded by the organization team, distributed in a folders tree whose structure is explained in detail in the ETSI portal documentation pages.

generates those signatures and/or ASiC containers, or/and verifies other participants' signatures and/or ASiC containers, that considers worth to generate.

uploads the results to the plugtest portal. Two types of results are possible for this type of tests: the generated signatures and/or ASiC packages, and validation reports on other participants' signatures and/or ASiC containers.

Each time a participant uploads a set of signatures/ASiC containers and/or validation reports, the portal:

  1. Generates a new zip file containing all the signatures/ASiC containers and/or validation reports that have been uploaded so far, including the ones uploaded by the aforementioned participant. It then generates a link in a certain place of the portal for allowing the participants to download this zip file.

  2. It updates the interoperability matrixes if the participant has uploaded validation reports.

Only Validation

The figure below shows one participant interacting with the portal for conducting an only validation test, and uploading to the portal the obtained results .

The participant:

Downloads from the portal a zip file containing the so-called initial package or the last zip file generated by the portal, containing all the signatures, ASiC containers, and validation reports, present at that time.

Validates the signatures and/or ASiC packages that are identified as negative test cases.

Uploads the validation reports obtained in the former step to the ETSI portal.

After the last step, the ETSI portal will update the interoperability matrixes with the information present in the uploaded validation reports.

Conformance testing tools

ETSI servers host a set of tools allowing to check whether AdES signatures and ASiC containers are conformant against the corresponding ETSI ENs defining such signatures and containers: the AdES and ASiC conformance checkers. Participants in the plugtest may use these tools for free (previous registration is required) at: https://signatures-conformance-checker.etsi.org/pub/index.shtml.

The figure below shows a high-level description on how participants should interact through the portal for using the different conformance testing tools deployed in the ETSI portal.

Participant generates a AdES signature or ASiC container.

Participant request conformity test to the Portal. This is done uploading the signature to the Portal using the suitable uploading and test page.

The conformance testing tool deployed in the Portal, tests the signature or container and generates set of HTML reports that are shown to the participant.