HDFSFileTransfer

The HDFSFileTransfer project was created and developed to ease Hadoop users quickly copying varied files such as: flat, structured, unstructured, big and small from linux to Hadoop File System (HDFS).
It allows users to transfer files:
- within the same physical machine - from local file system (linux) into HDFS
- between two physical machines - copy files from local file system (linux) with HDFS cluster installed to another HDFS cluster. Sample - one can have two single clustered Hadoop instances installed on two different linux machines. The script can copy files from one linux machine with Hadoop installed onto the other one. For further reference, read "Documentation of HDFSFileTransferByDK.pdf" available at the download section.

Project Samples

Copy From One Machine To Another With Different HDFS Cluster

Project Activity

See All Activity >

License

MIT License

Follow HDFSFileTransfer

HDFSFileTransfer Web Site

Other Useful Business Software

Full-stack observability with actually useful AI | Grafana Cloud

Our generous forever free tier includes the full platform, including the AI Assistant, for 3 users with 10k metrics, 50GB logs, and 50GB traces.

Built on open standards like Prometheus and OpenTelemetry, Grafana Cloud includes Kubernetes Monitoring, Application Observability, Incident Response, plus the AI-powered Grafana Assistant. Get started with our generous free tier today.

Create free account

Rate This Project

User Reviews

Be the first to post a review of HDFSFileTransfer!

Additional Project Details

Operating Systems

Linux

Programming Language

Unix Shell

Related Categories

Unix Shell Software Development Software

Registered

2014-09-01

Similar Business Software

Google Cloud Platform

Google Cloud is a cloud-based service that allows you to create anything from simple websites to complex applications for businesses of all sizes. New customers get $300 in free credits to run, test, and deploy workloads. All customers can use 25+ products for free, up to monthly usage...

See Software
DbVisualizer

DbVisualizer is a universal database client for developers, DBAs, analysts, and data engineers working with relational and NoSQL databases. It provides a graphical interface for database development, SQL querying, data exploration, and database admin. The tool includes a powerful SQL editor...

See Software
Windocks

Windocks is a leader in cloud native database DevOps, recognized by Gartner as a Cool Vendor, and as an innovator by Bloor research in Test Data Management. Novartis, DriveTime, American Family Insurance, and other enterprises rely on Windocks for on-demand database environments for development,...

See Software
Bitrise

Bitrise is a CI/CD platform built for mobile development, helping teams speed up builds, automate testing, and deliver high-quality apps faster. It supports native languages like Swift, Objective-C, Java, and Kotlin, as well as cross-platform frameworks including React Native, Flutter, Xamarin,...

See Software
Process Street

Process Street is an AI-powered compliance operations platform that automates complex workflows, enforces standards, and tracks audit data in real time. Teams use it to create structured SOPs, assign tasks, collect data, and monitor execution with intelligent oversight. From onboarding and...

See Software
Odoo

Odoo is a fully integrated, customizable, open-source software packed with hundreds of expertly designed business applications. Odoo’s intuitive database is able to meet a majority of business needs, such as: CRM, Sales, Project, Manufacturing, Inventory, and Accounting, just to name a few. Odoo...

See Software