HDFSFileTransfer

The HDFSFileTransfer project was created and developed to ease Hadoop users quickly copying varied files such as: flat, structured, unstructured, big and small from linux to Hadoop File System (HDFS).
It allows users to transfer files:
- within the same physical machine - from local file system (linux) into HDFS
- between two physical machines - copy files from local file system (linux) with HDFS cluster installed to another HDFS cluster. Sample - one can have two single clustered Hadoop instances installed on two different linux machines. The script can copy files from one linux machine with Hadoop installed onto the other one. For further reference, read "Documentation of HDFSFileTransferByDK.pdf" available at the download section.

Project Samples

Copy From One Machine To Another With Different HDFS Cluster

Project Activity

See All Activity >

License

MIT License

Follow HDFSFileTransfer

HDFSFileTransfer Web Site

Other Useful Business Software

$300 Free Credits for Your Google Cloud Projects

Start building on Google Cloud with $300 in free credits. No commitment, no credit card required until you're ready to scale.

Launch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.

Start Free Trial

Rate This Project

User Reviews

Be the first to post a review of HDFSFileTransfer!

Additional Project Details

Operating Systems

Linux

Programming Language

Unix Shell

Related Categories

Unix Shell Software Development Software

Registered

2014-09-01

Similar Business Software

Google Cloud Platform

Google Cloud is a cloud-based service that allows you to create anything from simple websites to complex applications for businesses of all sizes. New customers get $300 in free credits to run, test, and deploy workloads. All customers can use 25+ products for free, up to monthly usage...

See Software
DbVisualizer

DbVisualizer is a universal database client for anyone who works with data, from solo developers and startups to professional teams managing complex environments, including developers, DBAs, analysts, and data engineers working with relational and NoSQL databases. It offers a graphical interface...

See Software
Eurekos

Eurekos is the customer training LMS built to educate the world outside your organization – partners, distributors and resellers. Most companies spend years perfecting their product, then hand customers a repurposed employee training course and hope for the best. When those customers churn,...

See Software
Foxit Document Workflow APIs

Foxit provides a powerful suite of cloud-native APIs that help organizations automate, secure, and modernize document workflows. Built on scalable REST architecture, Foxit APIs enable developers to generate, convert, extract, sign, and display documents directly within applications—eliminating...

See Software
Windocks

Windocks is a leader in cloud native database DevOps, recognized by Gartner as a Cool Vendor, and as an innovator by Bloor research in Test Data Management. Novartis, DriveTime, American Family Insurance, and other enterprises rely on Windocks for on-demand database environments for development,...

See Software
Titan

Titan is the all-in-one, Salesforce-first platform for building customer-facing workflows directly on Salesforce. Create portals, forms, surveys, document generation, eSignatures, and contract processes that write back in real time, keeping Salesforce as your system of record. Titan AI turns...

See Software