Help building NST 18: ***ERROR*** Failed to build the "devel" packages

NST
joesox
2013-03-26
2013-05-27
  • joesox
    joesox
    2013-03-26

    Do I need to manually install ipsc? If so how? Google doesn't provide any good answers.
    Thanks.


    --> Running transaction check
    ---> Package nst-bash.noarch 0:18-14.nst18 will be installed
    --> Processing Dependency: ipsc for package: nst-bash-18-14.nst18.noarch
    ---> Package php-common.x86_64 0:5.4.12-1.fc18 will be installed
    --> Processing Dependency: libzip.so.2()(64bit) for package: php-common-5.4.12-1.fc18.x86_64
    --> Running transaction check
    ---> Package libzip.x86_64 0:0.10.1-5.fc18 will be installed
    ---> Package nst-bash.noarch 0:18-14.nst18 will be installed
    --> Processing Dependency: ipsc for package: nst-bash-18-14.nst18.noarch
    --> Finished Dependency Resolution
    Error: Package: nst-bash-18-14.nst18.noarch (/nst-bash-18-14.nst18.noarch)
    Requires: ipsc
    You could try using --skip-broken to work around the problem
    You could try running: rpm -Va --nofiles --nodigest
    make: *** [nst-bash-install] Error 1

    ERROR Failed to build the "devel" packages - can not continue!

    Configuration FAILED!

     
  • Sorry about that, there was a "chicken and egg" issue in the configuration/build procedure which we think we've resolved in the "dev" area.

    Unfortunately, we are having some issues with subversion at sourceforge at the moment and can not currently merge the updates from the "dev" area to the "trunk".

    If you have the "dev" area checked out, can you try updating and re-configuring and let us know if the updates have fixed the issue you are running into.

    If you have the "trunk" area checked out, you are going to need to be patient until we get the subversion issue at sourceforge worked out.

     
  • joesox
    joesox
    2013-03-27

    This time I checkedout dev and performed the ./configure and received the same error it looks like:
    --> Processing Dependency: php-common(x86-64) = 5.4.12-1.fc18 for package: php-cli-5.4.12-1.fc18.x86_64
    --> Running transaction check
    ---> Package nst-bash.noarch 0:18-14.nst18 will be installed
    --> Processing Dependency: ipsc for package: nst-bash-18-14.nst18.noarch
    ---> Package php-common.x86_64 0:5.4.12-1.fc18 will be installed
    --> Processing Dependency: libzip.so.2()(64bit) for package: php-common-5.4.12-1.fc18.x86_64
    --> Running transaction check
    ---> Package libzip.x86_64 0:0.10.1-5.fc18 will be installed
    ---> Package nst-bash.noarch 0:18-14.nst18 will be installed
    --> Processing Dependency: ipsc for package: nst-bash-18-14.nst18.noarch
    --> Finished Dependency Resolution
    Error: Package: nst-bash-18-14.nst18.noarch (/nst-bash-18-14.nst18.noarch)
    Requires: ipsc
    You could try using --skip-broken to work around the problem
    You could try running: rpm -Va --nofiles --nodigest
    make: *** [nst-bash-install] Error 1

    ERROR Failed to build the "devel" packages - can not continue!

     
  • Could you do me a favor and run the "svn info" directory in your top level directory and paste the results? We have been having issues with our transition to the new SourceForge subversion area and I want to make sure that you are using the new area (see: https://sourceforge.net/p/nst/code/4418/tree/) and not the old one.

    As a work around to the issue, can you try the following commands after the configure fails:

    1. Change to the yum sub-directory
    2. Run the command: make ipsc
    3. Search for the ipsc RPM package (if it builds it will show up somewhere under the repo directory).
    4. Yum install the ipsc RPM by hand
    5. Then go back to the top level directory and try running ./configure again
     
  • joesox
    joesox
    2013-03-28

    I don't normally do a bunch of building packages in linux so bare with me. I still am not having mych luck with either repositories, here is my notes using your workaround and other repo...
    Yes, not to good using the new svn @
    svn checkout svn://svn.code.sf.net/p/nst/code/trunk nst-code

    A nst-code/test/ConsoleKit/test.bash
    A nst-code/test/oinkmaster
    A nst-code/test/oinkmaster/test.bash
    svn: E160004: Filesystem is corrupt
    svn: E200014: Checksum mismatch while reading representation:
    expected: 12cc505d0b7843c7b73032ea4af37fb7
    actual: ff0f5d17478af89eb2ce64e9cbfc867c

    I tried again using
    svn checkout http://svn.code.sf.net/p/nst/code/trunk nst-code

    A nst-code/test/ConsoleKit
    A nst-code/test/ConsoleKit/test.bash
    A nst-code/test/oinkmaster
    A nst-code/test/oinkmaster/test.bash
    svn: E175002: REPORT of '/p/nst/code/!svn/me': Could not read chunk size: connection was closed by server (http://svn.code.sf.net)

    ======
    I have been going off this documentation
    http://wiki.networksecuritytoolkit.org/nstwiki/index.php/HowTo_Build_NST_2.15.0#Initial_NST_2.15.0_Build
    and using your workaround I received this output on step 2 "Run the command: make ipsc"

    [root@d006nids yum]# ls
    configure include pkgs
    [root@d006nids yum]# cd /home/jsocolos/trunk/yum/pkgs
    [root@d006nids pkgs]# cd /home/jsocolos/trunk/yum/pkgs/ipsc
    [root@d006nids ipsc]# ls
    build.bash makefile pkginfo.xml src template.spec
    [root@d006nids ipsc]# make ipsc
    ../../include/make/build.mk:14: ../../../config/config.mk: No such file or directory
    ../../include/make/build.mk:16: ../../tmp/config.mk: No such file or directory
    make: *** No rule to make target `../../tmp/config.mk'. Stop.

     
  • I'm sorry that things have not been going well. We have been fighting with some subversion issues out at SourceForge for the past week. Do NOT use the "trunk" area, it has become corrupted. We have created a new top level "repo" area to take it's place. Try using the following to checkout the code:

    svn checkout svn://svn.code.sf.net/p/nst/code/repo nst-code

    It's unfortunate that the workaround on the old subversion area did not work. We think we have a fix in the "repo" area mentioned above so hopefully you want run into the problem if you run a "./configure" and "make".

    The directions you are following for the 2.15.0 build are close (except for the initial subversion check out) to what is required to build the current NST 18 source code. At some point I will create a new build machine and document the process for building NST 18.

     
  • joesox
    joesox
    2013-03-28

    Paul,
    Thanks for the help again and almost there. Received an error on the make command this time....
    A nst-code/yum/pkgs/nst-pcap2convxml/pkginfo.xml
    A nst-code/yum/pkgs/nst-pcap2convxml/makefile
    A nst-code/README
    U nst-code
    Checked out revision 4420.
    [root@d006nids jsocolos]# cd nst-code/
    [root@d006nids nst-code]# ls
    configure COPYING docs html include livecd README src test wui yum
    [root@d006nids nst-code]# ./configure
    Verifying settings [ OK ]
    Creating (Pass 1): "./config/config.sh" [ OK ]
    Creating (Pass 1): "./config/packages.sgml" [ OK ]
    Creating (Pass 1): "./config/packages.at" [ OK ]
    Checking for DocBook XSL [ OK ]
    Creating (Pass 2): "./config/config.sh" [ OK ]
    Creating (Pass 1): "./config/config.mk" [ OK ]
    Creating (Pass 1): "./config/config.sgml" [ OK ]
    Creating (Pass 1): "./config/nstscript.bash" [ OK ]
    Creating (Pass 1): "./config/nstscriptdocbook2html.xsl" [ OK ]
    Creating config/script-entities.sgml... [ OK ]
    Configuring "yum" dir (can take long time - see yum.log) [ OK ]
    Creating (Pass 3): "./config/config.sh" [ OK ]
    Creating (Pass 1): "./config/test.sh" [ OK ]
    Creating (Pass 2): "./config/config.sgml" [ OK ]
    Creating (Pass 2): "./config/config.mk" [ OK ]
    Creating (Pass 1): "./config/config.at" [ OK ]
    Constructing top level Makefile [ OK ]
    Running configure in "docs" directory [ OK ]
    Running configure in "html" directory [ OK ]
    Running configure in "wui" directory [ OK ]
    Running configure in "livecd" directory [ OK ]
    Creating .at files from XML under include/atmacros [ OK ]
    Creating initial build information scripts [ OK ]
    Creating: config/nst.bash [ OK ]
    Creating: config/NstIso.php [ OK ]
    Adding /usr/local/lib to ldconfig search path [ OK ]

    Use "make help" to see the list of available targets.

    [root@d006nids nst-code]# make
    Updating clamav anti-virus definitions
    make[1]: [updateclamav] Error 40
    make:
    [all] Error 2
    [root@d006nids nst-code]#
    =====================================================
    =====================================================
    So then I tried......

    [root@d006nids nst-code]# make release-iso

    ERROR You need to run: "./configure -c include/dist"
    before building this make target!

    make: *** [check-release-config] Error 1
    [root@d006nids nst-code]# ./configure -c include/dist
    Verifying settings [ OK ]
    Creating (Pass 1): "./config/config.sh" [ OK ]
    Creating (Pass 1): "./config/packages.sgml" [ OK ]
    Creating (Pass 1): "./config/packages.at" [ OK ]
    Checking for DocBook XSL [ OK ]
    Creating (Pass 2): "./config/config.sh" [ OK ]
    Creating (Pass 1): "./config/config.mk" [ OK ]
    Creating (Pass 1): "./config/config.sgml" [ OK ]
    Creating (Pass 1): "./config/nstscript.bash" [ OK ]
    Creating (Pass 1): "./config/nstscriptdocbook2html.xsl" [ OK ]
    Creating config/script-entities.sgml... [ OK ]
    Configuring "yum" dir (can take long time - see yum.log) [ OK ]
    Creating (Pass 3): "./config/config.sh" [ OK ]
    Creating (Pass 1): "./config/test.sh" [ OK ]
    Creating (Pass 2): "./config/config.sgml" [ OK ]
    Creating (Pass 2): "./config/config.mk" [ OK ]
    Creating (Pass 1): "./config/config.at" [ OK ]
    Constructing top level Makefile [ OK ]
    Running configure in "docs" directory [ OK ]
    Running configure in "html" directory [ OK ]
    Running configure in "wui" directory [ OK ]
    Running configure in "livecd" directory [ OK ]
    Creating .at files from XML under include/atmacros [ OK ]
    Creating initial build information scripts [ OK ]
    Creating: config/nst.bash [ OK ]
    Creating: config/NstIso.php [ OK ]

    Use "make help" to see the list of available targets.

    [root@d006nids nst-code]# make release-iso
    ? nst-18-4420

    ERROR Subversion updates/commits required

    make: *** [check-release-config] Error 1
    [root@d006nids nst-code]#

     
  • You are almost there.

    You are making good progress! At this point, it looks like you have successfully built the NST yum repository (it is located under the yum/repo directory).

    The error looks like your system is having a problem updating the clamav definition files. Each time we build a ISO image, we update the clamav definition files and copy the current definitions to the ISO image which is generated.

    Try running the following from the command line:

    sudo freshclam -v

    (you can leave off the sudo if you are logged in as the root user).

    If the command fails, check your /etc/freshclam.conf file. I know at one point, Fedora's default configuration had a line near the top "Example" that you had to comment out in order to get freshclam to run.

     
  • joesox
    joesox
    2013-03-28

    Paul,
    looks like the make is going now. I am guessing this will take some time. If it builds the ISO I might not be able to install it until Friday or two Mondays from now.
    I will post the results when I know. Thanks for the support on this. Keep up the great work. NST saves me so much time (normally)

     
  • joesox
    joesox
    2013-03-29

    Darn, Looks like I am still having an issue. Not sure what to make of it but no file is in the nst-code/nst-18-4420 folder (if that is where it would show up)

    <clip>...

    SUCCESS: Successfully built netwag SRPM


    Building netwag RPM

    Installing /root/rpmbuild/SRPMS/netwag-5.39.0-6.nst18.src.rpm
    Executing(%prep): /bin/sh -e /var/tmp/rpm-tmp.OTut0A
    + umask 022
    + cd /root/rpmbuild/BUILD
    + cd /root/rpmbuild/BUILD
    + rm -rf netwag-5.39.0
    + /usr/bin/gzip -dc /root/rpmbuild/SOURCES/netwag-5.39.0.tar.gz
    + /usr/bin/tar -xf -
    + STATUS=0
    + '[' 0 -ne 0 ']'
    + cd netwag-5.39.0
    + /usr/bin/chmod -Rf a+rX,u+w,g-w,o-w .
    + exit 0
    Executing(%build): /bin/sh -e /var/tmp/rpm-tmp.uYZYl0
    + umask 022
    + cd /root/rpmbuild/BUILD
    + cd netwag-5.39.0
    + cd src
    + /usr/bin/sed -i -e 's,^NETWOXDEF_INSTPREFIX=/usr/local,NETWOXDEF_INSTPREFIX=/usr,' ./config.dat
    + ./genemake
    Netwag version 5.39.0 (5 39 0)
    Loading config.dat
    Checking programs
    /usr/bin/netwox539 yes
    Checking directories
    /usr/local/bin yes
    Warning: the man directory '/usr/local/man' wasn't found
    Warning: the man1 directory '/usr/local/man/man1' wasn't found
    Checking Tcl/Tk
    bin_wish not forced, so try to find it
    wish8 not found
    wish8.6 not found
    Tcl/Tk interpreter found at /bin/wish8.5
    Searching terminal emulators
    bin_term not forced, so try to find it
    xterm not found
    nxterm not found
    eterm not found
    rxvt not found
    gnome-terminal not found
    konsole not found
    dtterm not found
    cmdtool not found
    Error: No terminal emulator found in the PATH(/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/home/jsocolos/.local/bin:/home/jsocolos/bin).
    error: Bad exit status from /var/tmp/rpm-tmp.uYZYl0 (%build)

    RPM build errors:
    Bad exit status from /var/tmp/rpm-tmp.uYZYl0 (%build)


    ERROR Failed to build netwag RPM

    make[3]: [all] Error 1
    make[2]:
    [repo/noarch/netwag-5.39.0-6.nst18.noarch.rpm] Error 2
    make[1]: [iso] Error 2
    make:
    [all] Error 2
    [root@d006nids nst-code]# make iso
    make: *** No rule to make target iso'. Stop. [root@d006nids nst-code]# make setup make: *** No rule to make targetsetup'. Stop.

     
  • For some reason it looks like the netwag build is failing to find a terminal emulator on your development system. I'm not sure why it didn't find gnome-terminal.

    I rebuilt the package on my system and it found the "xterm" emulator (here is the section of the build log on my machine that overlaps the section where you encountered an error).

    Checking Tcl/Tk
     bin_wish not forced, so try to find it
     wish8 not found
     wish8.6 not found
     Tcl/Tk interpreter found at /usr/bin/wish8.5
    Searching terminal emulators
     bin_term not forced, so try to find it
     Terminal emulator found at /usr/bin/xterm
    Creation of netwag_vars1v_unix.tcl
    Creation of netwag_vars2v_unix.tcl
    Creation of makefile
    End of genemake
    

    Can you try yum installing the xterm package:

    yum install xterm
    

    Let me know if that fixes your issue (if so, I will add the xterm package as one of the packages we check for during the configuration process).

     
  • I am a bit confused at why you are seeing issues related to /bin/perl, /bin/python and /bin/wish8.5. I don't see how these executables can be missing from your system.

    I'm going to suggest the following things to try (but at the moment I'm just guessing).

    1. Try rebuilding the four packages with errors shown above:

      cd yum
      make BackupPC-remove netwag-remove nmap-remove u2ps-remove
      make BackupPC netwag nmap u2ps

    2. See if you are able to install one of the packages (like nmap) onto your development system (you shouldn't have to install it - but just to verify that the package will install):

      sudo yum install yum/repo/i686/nmap-6.25-1.100.nst18.i686.rpm

    3. If that works, reboot your system and try configuring and building the ISO again.

    If that doesn't work, you may want to consider contacting me directly via e-mail and we can try and work out something so I can ssh into your development machine to see what is going on. Otherwise, you may need to be patient until I set up a new development machine and start the process of documenting the build of NST 18.

     
  • joesox
    joesox
    2013-03-29

    Paul,
    I will try this. It is probably because I downloaded Fedora 18 and performed a fresh install, I did not download any other packages, maybe I didn't download the correct Fedora to begin with. I have training next week but I will update this thread when I can.
    Is there a ETA on a published NST 18 yet? I started building myself because I wasn't sure when you planned on the next release and I need the latest version of SNORT and want to check out the NTOP version also. Thanks again.

     
  • joesox
    joesox
    2013-04-05

    Paul,
    I am not sure if BackupPC worked or not as some parts said successfully install but last line was 'error 2' I rebooted and tried again but see below....
    I have not tried gotomeeting before on a linux box before so not sure what tools you have in mind to connect. maybe join.me would work. Let me know what you want to do.

    Retrieving http://ftp.usf.edu/pub/fedora/linux/updates/18/x86_64/repodata/repomd.xml ...OK
    Retrieving http://ftp.usf.edu/pub/fedora/linux/updates/18/x86_64/repodata/655f2318e2842ff0853ae3c552ce5d560fbb2f639a6d7443b3865cac4de027c0-primary.sqlite.bz2 ...OK
    Error creating Live CD : Failed to build transaction : BackupPC-3.2.1-118.nst18.noarch requires /bin/perl
    netwag-5.39.0-6.nst18.noarch requires /bin/wish8.5
    2:nmap-6.25-1.100.nst18.x86_64 requires /bin/python
    u2ps-0.8.2-5.nst18.noarch requires /bin/perl
    Unmounting directory /home/jsocolos/nst-code/livecd/tmp/imgcreate-29ZonU/install_root
    Losetup remove /dev/loop0

    real 1m26.256s
    user 1m8.922s
    sys 0m2.887s
    /bin/mv: cannot stat ‘nst-18-4420.x86_64.iso’: No such file or directory
    make[1]: [iso] Error 1
    make:
    [all] Error 2
    [root@d006nids nst-code]#

     
  • Sorry for the long delay in the response.

    I have done the following:

    • Cleaned up a few items in the top level configure script to stream line the build process.
    • Created instructions for building NST 18 from the source (http://wiki.networksecuritytoolkit.org/nstwiki/index.php/HowTo_Build_NST_18)
    • Set up a Fedora 18 64 bit virtual machine running under VirtualBox and followed the instructions in the link above.

    Everything worked as expected (other than the www.thc.org web site being down when I did my build - I had to work around not being able to download source code for a couple of the packages).

    So, I'm not sure what to tell you about the dependency issues you are having in your area.

    Could you try checking out a fresh copy of the 'repo' area and building again? You can save a lot of time if you copy or move the 'yum/cache' and 'livecd/cache' directories from your old area into the new area you check out.

    As a side note, we did release NST 18 this weekend (there is a 32 bit ISO available at SourceForge).

    Good Luck,
    Paul

     
  • Make sure you are NOT running as root or stepped up to superuser. Run the "./configure ; make" as a plain user that has sudo access to root with no password. That was my solution for this exact problem.

    If you've already encountered this error, you may have to blow away your checkout directory or run "make clear ; rm -rf yum/repo" as root and then run "./configure ; make" as a regular user.