Sponsor:

Your company here, and a link to your site. Click to find out more.

hdfscli - Man Page

hdfscli – a command line interface for HDFS

Synopsis

hdfscli [interactive] [-a ALIAS] [-v...]

hdfscli download [-fsa ALIAS] [-v...] [-t THREADS] HDFS_PATH LOCAL_PATH

hdfscli upload [-sa ALIAS] [-v...] [-A | -f] [-t THREADS] LOCAL_PATH HDFS_PATH

hdfscli -L | -v | -h

Options

Commands

download

Download a file or folder from HDFS. If a single file is downloaded, - can be specified as LOCAL_PATH to stream it to standard out.

interactive

Upload a file or folder to HDFS. - can be specified as LOCAL_PATH to read from standard in. Start the client and expose it via the python interpreter (using ipython(1) if available).

upload

Upload a file or folder to HDFS. - can be specified as LOCAL_PATH to read from standard in.

Arguments

HDFS_PATH

Remote HDFS path.

LOCAL_PATH

Path to local file or directory.

Options

-A --append

Append data to an existing file. Only supported if uploading a single file or from standard in.

-L --log

Show path to current log file and exit.

-V --version

Show version and exit.

-a ALIAS--alias=ALIAS

Alias of namenode to connect to.

-f --force

Allow overwriting any existing files.

-s --silent

Don’t display progress status.

-t THREADS--threads=THREADS

Number of threads to use for parallelization. 0 allocates a thread per file. [default: 0]

-v --verbose

Enable log output. Can be specified up to three times (increasing verbosity each time).

Exit Status

HdfsCLI exits with return status 1 if an error occurred and 0 otherwise.

Examples

hdfscli -a prod /user/foo
hdfscli download features.avro dat/
hdfscli download logs/1987-03-23 - >>logs
hdfscli upload -f - data/weights.tsv <weights.tsv

See Also

hdfscli-avro(1)

ipython(1)

Referenced By

hdfscli-avro(1).

October 2021