Search Results for "file system"

...You can build pretty much any task you want, but Luigi also comes with a toolbox of several common task templates that you use. It includes support for running Python mapreduce jobs in Hadoop, as well as Hive, and Pig, jobs. It also comes with file system abstractions for HDFS, and local files that ensures all file system operations are atomic.

Code, run and monitor your data pipelines all from your browser! From idea to scheduled pipeline in hours, not days. Interactively build your data science pipelines in our visual pipeline editor. Versioned as a JSON file. Run scripts or Jupyter notebooks as steps in a pipeline. Python, R, Julia, JavaScript, and Bash are supported. Parameterize your pipelines and run them periodically on a cron schedule. Easily install language or system packages. Built on top of regular Docker container images. Creation of multiple instances with up to 8 vCPU & 32 GiB memory. ...

Nxpy is a Python library that combines general purpose features with a set of tools more geared towards build automation and source code management. It provides convenient ways to invoke and control interactive and non-interactive commands, context aware backup for files you need to modify, convenience stubs for file like objects, and more. It also contains wrappers for ClearCase, Maven and Subversion, as well as tools to manipulate Maven and Visual Studio configuration files.

ElRey help you to create an .app package from your python script (s) for your MacOs X 10.6+ with drag and drop method and a compate app package.

ASDRAD is a source code generator which reads a configuration file and generates *.c, *.h, makefiles etc. It's written in Python and uses templates. Output files are for AmigaOS and derivates like AROS and MorphOS.

Source Navigator NG is a source code analysis tool. With it, you can edit your source code, display relationships between classes and functions and members, and display call trees. You can navigate your source code and easily get to declarations or implementations of functions, variables and macros (commonly called "symbols") which helps you discovering and mapping unknown source code for enhancement or maintenance tasks.

This tool will scan your directory for source files and then generate a project file for Codeblocks, XCode, Visual Studio, Metrowerks CodeWarrior, FreeScale Codewarrior. It runs on Linux, MacOSX and Windows and can generate the files for any host from any platform. Great care is taken to make sure project file updates change as little as possible to make source control change lists as minimal as possible. This is the main IDE project file generator used by Olde Sküül!

Patchamama is a binary patch maker/applier that works on directory tree. It can be used in application deployment, large scale project patching (including source and binary data). It use bsdiff for the binary diff job and 7zip for compression.

Dagger evaluates file dependencies in a directed-acyclic-graph (DAG) like GNU make, but timestamps or hashes can be used on a per-file basis when evaluating which file nodes are up to date or stale. Use fast timestamp comparisons on large files when hashing is too slow, and hashing on small files. When hashing is used, it's stored in either a text file or sqlite database (in-memory at runtime is optional).

Open Source Web-based Application for System & Software Requirement Management and Traceability

This is a python library that can be used to build Linux kernel, which includes selecting kernel config file, setting kernel config parameters, compiling kernel, modules and even appending a new item for the compiled kernel to bootloader config file (cur

The Library Optimizer tool rebuilds shared libraries to contain only the object files needed to provide symbols required by executables and shared libraries in a given directory tree. It can be used to reduce file system sizes for embedded systems.

Set of tools, web based and command line python based, to manage the status of builds on a linux based system. Ala Tinderbox style, task status (test, build, etc) are send via email to a rails engine that monitors build status and displays it on a web.