October 2019

Author: Juan Carlos Cruellas, UPC cruellas@ac.upc.edu


Contents

  1. Introduction

  2. Types of tests

  3. Before starting the plugtest

  4. Conducting positive tests

  5. Conducting negative tests

  6. Available conformance tools


1. Introduction

This page provides generic information on the plugtest, namely: the types of interoperability tests that the participants will be able to conduct, and a high-level description of how they may conduct tests using the ETSI plugtest portal.

2. Types of tests

This plugtest allows to conduct two types of tests:

  1. Positive tests.
    Each participant is invited to generate a valid AdES signatures and/or ASiC containers with certain characteristics that are of use in their Member State. The rest of participants are invited afterwards to verify the signatures and or ASiC containers (cross-verification). The plugtest portal automatically generates an updated set of interoperability matrixes that all the participants may access.

  2. Negative tests.
    The organization team and maybe some participants will generate a number of invalid signatures and/or ASiC containers including invalid signatures (the so-called "negative testcases") by different reasons. Each participant may, at her own discretion, try to verify these signatures and/or ASiC containers, checking in this way that the corresponding tool actually detects that the involved signature/ASiC container is not valid.

3. Before starting the plugtest

Before starting the plugtests, the participants should:

  1. Read the documentation present in the portal describing the environment, namely:

    1. This page, and the additional pages listed below, providing detailed information on how to conduct the interoperability tests, namely:

      1. Conducting plugtests: Interactions with portal page, which provides a high level view of how the participants may interact with the portal depending on the type of tests they are conducting.

      2. Conducting plugtests: Downloading materiall page, which provides information on how to proceed to download the initial package and the successively updated download package, as well as details of its inner structure, and how this relates to the tests conducted.

      3. Conducting positive tests page,which provides details on how to conduct the positive test cases.

      4. Conducting negative tests page, which provides details on how to conduct the negative test cases

4. Conducting positive tests

Participants are kindly requested to read Conducting positive tests page, which provides all the required details on how to conduct the positive test cases.

5. Conducting negative tests

Participants are kindly requested to read Conducting negative tests page, which provides details on how to conduct the negative test cases.

6. Available conformance tools

Participants may use the conformance testing tools deployed at the ETSI portal. Participants are warned that these are still under development and that the degree of maturity and completeness is different. Each tool provides detailed information of its degree of development to the user.