*** This project has moved to https://github.com/spinto/secp/ ***
Please check https://github.com/spinto/secp/ for support or latest releases.

secp is a generic utility written in Bash to perform URL downloads to a sink directory.

The supported url schemes are ftp, scp, http, https, gridftp, file and nfs, with the possibility to perform authentication using basic FTP/HTTP authentication or more advanced SSO authentication schemas.

The application analyses HTML pages to follow links and redirects, parses RDF and ATOM feeds, supports downloads of URL lists, automatically decompresses files and directories and many other feature.

Tool works on a generic Linux distribution or on Windows (for windows, you need to install "Git for Windows")

Features

  • Support for download from most of the ESA data archives and catalogues (SciHub, VA4, ESAR, MERCI, etc...)
  • Parallel downloads (optionally with multiple credentials)
  • Support for ftp, scp, http, https, gridftp, hadoopfs, file and nfs.
  • Support for basic (e.g. SciHub), ESA's EO-SSO, EO Data Gateway authentication
  • Built-in credentials and session manager
  • Automatic unpackaging of files
  • Support for file lists in metalink, ATOM (@rel=enclosure), RDF, HTML (meta-refresh and href-tags), UAR (url textual file lists)

Project Activity

See All Activity >

Categories

Internet

License

GNU General Public License version 3.0 (GPLv3)

Follow secp

secp Web Site

Other Useful Business Software
MongoDB Atlas runs apps anywhere Icon
MongoDB Atlas runs apps anywhere

Deploy in 115+ regions with the modern database for every enterprise.

MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
Start Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of secp!

Additional Project Details

Operating Systems

MinGW/MSYS2, Linux, BSD

Intended Audience

Information Technology, End Users/Desktop

Programming Language

Unix Shell

Related Categories

Unix Shell Internet Software

Registered

2013-06-13