[Crackerjack-devel] I had finished packaging crackerjack-1.0.0

[Satoshi F. <sa...@sd...>]

Hi, crackerjack developers,

I'd been working for packaging crackerjack-1.0.0,
and now I finished.
It will be released in the next few days.

I compiled and checked the uploaded test programs,
and I didn't use some test programs of them for
various reasons.
These test programs and it's reasons are described
below in '3-f. Delete the below test programs'.

Among this process, I noticed some points that
we should care.

1. There are some test programs could not build
   because of the kernel version or something.
   For example, some system calls not exist on
   early kernels.
   The test programs should not be depend
   on kernel versions and the distributions.

2. Some test programs create the temporary files or
   something, and leave it.
   Test programs should be delete these files
   when test was done.

3. Sometimes glibc not call the system call which
   exactly we want to call.
   So, we should check by 'strace' that the system
   call was really called.



Summary of the packaging work
-----------------------------

1. Environment for compiling and checking test programs

  I compiled and checked on RHEL4U1 and RHEL5U0.
  ('RHEL' means RedHat Enterprise Linux.)

2. Total test programs

  I packaged 133 test programs while 158 test programs
  were uploaded.

3. Changing points from uploaded files.

  a. Delete these unnecessary files.
     .current, .order*, order*, expected/*, results/*

  b. Rename 'testcases/old_mmap' to 'testcases/mmap'
     because it is 'mmap' test.

  c. Add these new test programs created in Japan.
     ioctl, old_mmap, socket, sysctl

  d. Move 'testcases/examples' to the top directory,
     and delete 'testcases/syscall_[ABC].

  e. Delete the 'compare' programs from many Chinese/Korea's
     test programs because these are not meet the framework
     specific.
     Please see the 'SPEC' file for the specification of the
     'compare' program.

  f. Delete the below test programs.

     --- could not compile ---
     wait4, exit, read, tee, fstatat64, symlinkat, faccessat,
     unlinkat, futimesat, fchmodat, fadvise64_64, readlinkat,
     mknodat, renameat, fchownat, linkat

     --- abnormal termination ---
     time, kill/kill03

     --- always comparison error occur because these output
         the value which depends on the environment ---
     fork/fork1, setfsgid16, setfsuid16, setfsuid, setfsgid,
     times, execve/execve1, lseek, llseek

     --- zombie process remains after the test ---
     clone

  g. Add 'all-clean' target to 'Makefile' for deleting the
     test results and html report.

  h. Update the framework

     --- Fix the following bugs ---
     (1). Html report is not sorted by kernel versions.

     (2). Framework would be freeze when a test output many
          lines as its result.

     --- Update ---
     (3). Swap the argments of the comparison program.
          So now, comparison program dispalys the difference
          between 'EXPECT(from)' and 'RESULT(to)'.

     (4). Sort the comparison result by the system call
          name for both of the terminal output and html
          report.

     (5). Change the result word from 'OK'/'NG' to
          'Not Found'/'Found'.

Best regards,
--
Satoshi Fujiwara