HDFSFileTransfer

The HDFSFileTransfer project was created and developed to ease Hadoop users quickly copying varied files such as: flat, structured, unstructured, big and small from linux to Hadoop File System (HDFS).
It allows users to transfer files:
- within the same physical machine - from local file system (linux) into HDFS
- between two physical machines - copy files from local file system (linux) with HDFS cluster installed to another HDFS cluster. Sample - one can have two single clustered Hadoop instances installed on two different linux machines. The script can copy files from one linux machine with Hadoop installed onto the other one. For further reference, read "Documentation of HDFSFileTransferByDK.pdf" available at the download section.

Project Samples

Copy From One Machine To Another With Different HDFS Cluster

Project Activity

See All Activity >

License

MIT License

Follow HDFSFileTransfer

HDFSFileTransfer Web Site

Other Useful Business Software

MongoDB Atlas runs apps anywhere

Deploy in 115+ regions with the modern database for every enterprise.

MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.

Start Free

Rate This Project

User Reviews

Be the first to post a review of HDFSFileTransfer!

Additional Project Details

Operating Systems

Linux

Programming Language

Unix Shell

Related Categories

Unix Shell Software Development Software

Registered

2014-09-01

Similar Business Software

Google Cloud Platform

Google Cloud is a cloud-based service that allows you to create anything from simple websites to complex applications for businesses of all sizes. New customers get $300 in free credits to run, test, and deploy workloads. All customers can use 25+ products for free, up to monthly usage...

See Software
DbVisualizer

DbVisualizer is a universal database client for anyone who works with data, from solo developers and startups to professional teams managing complex environments, including developers, DBAs, analysts, and data engineers working with relational and NoSQL databases. It offers a graphical interface...

See Software
Eurekos

Eurekos is the customer training LMS built to educate the world outside your organization – partners, distributors and resellers. Most companies spend years perfecting their product, then hand customers a repurposed employee training course and hope for the best. When those customers churn,...

See Software
Foxit Document Workflow APIs

Foxit provides a powerful suite of cloud-native APIs that help organizations automate, secure, and modernize document workflows. Built on scalable REST architecture, Foxit APIs enable developers to generate, convert, extract, sign, and display documents directly within applications—eliminating...

See Software
Windocks

Windocks is a leader in cloud native database DevOps, recognized by Gartner as a Cool Vendor, and as an innovator by Bloor research in Test Data Management. Novartis, DriveTime, American Family Insurance, and other enterprises rely on Windocks for on-demand database environments for development,...

See Software
Titan

Titan is the all-in-one, Salesforce-first platform for building customer-facing workflows directly on Salesforce. Create portals, forms, surveys, document generation, eSignatures, and contract processes that write back in real time, keeping Salesforce as your system of record. Titan AI turns...

See Software