HDFSFileTransfer

The HDFSFileTransfer project was created and developed to ease Hadoop users quickly copying varied files such as: flat, structured, unstructured, big and small from linux to Hadoop File System (HDFS).
It allows users to transfer files:
- within the same physical machine - from local file system (linux) into HDFS
- between two physical machines - copy files from local file system (linux) with HDFS cluster installed to another HDFS cluster. Sample - one can have two single clustered Hadoop instances installed on two different linux machines. The script can copy files from one linux machine with Hadoop installed onto the other one. For further reference, read "Documentation of HDFSFileTransferByDK.pdf" available at the download section.

Project Samples

Copy From One Machine To Another With Different HDFS Cluster

Project Activity

See All Activity >

License

MIT License

Follow HDFSFileTransfer

HDFSFileTransfer Web Site

Other Useful Business Software

Earn up to 16% annual interest with Nexo.

Access competitive interest rates on your digital assets.

Generate interest, borrow against your crypto, and trade a range of cryptocurrencies — all in one platform. Geographic restrictions, eligibility, and terms apply.

Get started with Nexo.

Rate This Project

User Reviews

Be the first to post a review of HDFSFileTransfer!

Additional Project Details

Operating Systems

Linux

Programming Language

Unix Shell

Related Categories

Unix Shell Software Development Software

Registered

2014-09-01

Similar Business Software

Google Cloud Platform

Google Cloud is a cloud-based service that allows you to create anything from simple websites to complex applications for businesses of all sizes. New customers get $300 in free credits to run, test, and deploy workloads. All customers can use 25+ products for free, up to monthly usage...

See Software
DbVisualizer

DbVisualizer is a universal database client for anyone who works with data, from solo developers and startups to professional teams managing complex environments, including developers, DBAs, analysts, and data engineers working with relational and NoSQL databases. It offers a graphical interface...

See Software
Eurekos

Eurekos is the customer training LMS built to educate the world outside your organization – partners, distributors and resellers. Most companies spend years perfecting their product, then hand customers a repurposed employee training course and hope for the best. When those customers churn,...

See Software
Foxit Document Workflow APIs

Foxit provides a powerful suite of cloud-native APIs that help organizations automate, secure, and modernize document workflows. Built on scalable REST architecture, Foxit APIs enable developers to generate, convert, extract, sign, and display documents directly within applications—eliminating...

See Software
Process Street

Process Street is an AI-powered compliance operations platform that automates complex workflows, enforces standards, and tracks audit data in real time. Teams use it to create structured SOPs, assign tasks, collect data, and monitor execution with intelligent oversight. From onboarding and...

See Software
Aikido Security

Secure your code, cloud, and runtime in one central system. Aikido’s all-in-one security platform is loved by developers and security teams alike with full security visibility, insight in what matters most, and fast/automatic vulnerability fixes. Teams get security done with Aikido thanks...

See Software