Re: [Opensc-devel] PKCS#11 Test suite (PIV)

[Andreas S. <and...@ca...>]

Dear Jakub,

having a central regression test set-up would be great thing.

Internally we use a PKCS#11 test suite similar to [1] that validates the
PKCS#11 interface in combination with our SmartCard-HSM. We also have a
smoke-test that runs a couple of tests on the command line.

Other than that we occasionally do regression testing of the Minidriver.

I guess the biggest issue is, that you need a specific configuration for
each card. If there was a common testing framework, I'd be happy to
provide tests for our card.

Andreas


[1] https://github.com/CardContact/sc-hsm-embedded/tree/master/p11tests

On 05/16/2016 05:04 PM, Jakub Jelen wrote:
> Hello OpenSC devels,
> 
> I didn't find any test suite or unit tests for OpenSC project. As I 
> noticed, there is a lot of hand-testing work on pull requests for 
> various cards and users. I believe everyone has some use cases to verify 
> basic functionality of their cards.
> I understand that this fields is very divergent, there is a lot of card 
> variants and it is almost impossible to build automatic test suite that 
> would run in cloud with every build. But would it make sense to have 
> something that devels (or users) can simply run and what would verify 
> basic functionality and possible regressions?
> 
> I went to the directory src/tests/ and fixed the tests that are 
> available now (see pull request [1], broken for 6 years), but they are 
> far away from complete test suite.
> 
> I also started with the idea from PKCS#11 API and put together basic 
> test suite and inspector for OpenSC, which is currently in my OpenSC 
> fork [2]. It is by no mean complete test suite of all the use cases, but 
> I tried to catch most common cases, represent results in understandable 
> form (currently tested with PIV cards) and add regression test for 
> recent pull request [3].
> 
> And there is the twist. What would you expect from PKCS#11/Smartcard 
> testsuite? Would it make sense to have something like this upstream? 
> What use cases would you expect from that to check?
> 
> 
> [1] https://github.com/OpenSC/OpenSC/pull/759
> [2] https://github.com/Jakuje/OpenSC/tree/jjelen-testsuite/src/tests
> [3] https://github.com/OpenSC/OpenSC/pull/743
> 
> Regards,
> 


-- 

    ---------    CardContact Systems GmbH
   |.##> <##.|   Schülerweg 38
   |#       #|   D-32429 Minden, Germany
   |#       #|   Phone +49 571 56149
   |'##> <##'|   http://www.cardcontact.de
    ---------    Registergericht Bad Oeynhausen HRB 14880
                 Geschäftsführer Andreas Schwier