Navigate
ScaleArc Customer Support
  • Login to Ignite Global Support
or
Contact Us
  • Get in touch

    Send us an email

  • Submit Feedback

    Feedback and suggestions submitted by customers like you

  • Knowledgebase Read help articles
  • Feedback Custom suggestions
  • Downloads Browse our downloads
  • Contact Us We are here to help
  • Portal
  • Knowledgebase
  • Support Procedures
  • Log Collection & Upload
  • How To: Split large file (i.e. for upload to ScaleArc)
Subscribe Download PDF

How To: Split large file (i.e. for upload to ScaleArc)

John DiNapoli
2018-02-14
0 Comments
in Log Collection & Upload

 How To: Split large file (i.e. for upload to ScaleArc Support)

Release Classification Level DB Platform Categories
Any Release How To ALL OS Admin

 

OBJECTIVE

Large files and slow bandwidth can result in aborted file uploads. While the ScaleArc Upload server is capable fo supporting multiple connections and good upload speeds, ScaleArc has no control over the other compnents of the Internet. There are ways of improving the overall upload time and decreasing the impact of a failed upload.

The following precedure is intended to familiarize you with the "split" linux command.

PROCEDURE

This procedure may/will required one of more of the following skills and access:

  1. Admin access to ScaleArc UI
  2. SSH access to ScaleArc enabled
  3. Familiarity with the linux command line

The Linux Manual (Man) page for the "split" command is located here:

http://man7.org/linux/man-pages/man1/split.1.html

The split comamnd is run from the Linux command line. For a ScaleArc server, access to the command line is achieved by enabling SSH in the ScaleArc User Interface (UI), and then using a terminal session (from Mac or other linux-based OS) or tool such as "Putty" (on a Windows PC).

 Steps:

  1. Log in to ScaleArc UI as an administrator
  2. Enable SSH
    1. IMPORTANT: If SSH is already enabled and you do not know the SSH password, DO NOT DISABLE SSH. this specific SSH KEY may already be in use by automation or user API commands.
  3. There are a variety of SSH tools available. Example include "Terminal" on a Linux-based system such as a Mac; and, "Putty" is available for Windows PC systems. Install or select your tool of choice.
  4. Access the ScaleArc server command lin over SSH by configuring the tool to "idb@<your-scalearc-server>", then entering the SSH password.
  5. At the command line prompt, change directory to the location of the large file to be "split".
  6. Check your file system partitions in the ScaleArc server for space avaialble (i.e. using the "df -kha" command).
    1. IMPORTANT: The "split" command will create additional files in the course of splitting the original file. The original file remains unmodified. This effectively doubles the space used by the file whenthe adidtional split files are created. The "split" command can put the resulting split files into another disk that has adequate space.
  7. Syntax for the "split" command can be fairly simple for a 5.8GB file, it can be split into 5 smaller [roughly] 1GB fiels and a remaining 0.8GB file using the following command:
    1. # split  -b1000000000  -a2  largefile.tgz  SA-SPLIT-large.tgz-
  8. This particular command and parameters do the following:
    1. "split" is the split command
    2. "-b" is the number of bytes for each file (no space following the parameter)
    3. "-a" is the number of characters to append to the new file name
    4. "largefile.tgz" is replaced with the actual name of your large file to be split
    5. "SA-SPLIT-largefile.tgz-" is the prefix for each of the newly split smaller files (customize to your needs)
  9. In this example of a 5.8GB largefile.tgx, the resulting files will be created
    • SA-SPLIT-largefile.tgz-aa ~1.0GB
    • SA-SPLIT-largefile.tgz-ab ~1.0GB
    • SA-SPLIT-largefile.tgz-ac ~1.0GB
    • SA-SPLIT-largefile.tgz-ad ~1.0GB
    • SA-SPLIT-largefile.tgz-ae ~1.0GB
    • SA-SPLIT-largefile.tgz-af  ~0.8GB
  10. Upload all of those files using your favorite multi-thread sFTP tool. ScaleArc Support can re-combine these files to recreate the original large file.
    1. One such tool is "FileZilla" which can be configured with or without a upload limit on speed (bits/second), and can be configured to upload multiple files simultaneously to make best use of your own bandwith.

END

 

 



If you are experiencing issues with ScaleArc or with any of it's features, please contact ScaleArc Support. We are available 24x7 by phone at 855 800 7225 or +1 408 412 7315. For general support inquiries, you can also e-mail us at support@scalearc.com.

 

Copyright ©2014 ScaleArc, Inc. All rights reserved. Contact Support |  Contact ScaleArc |  Feedback

2901 Tasman Drive Santa Clara, CA 95054 | Email:  support@scalearc.com

Permalink: https://support.scalearc.com/kb/articles/4466
  • Tags
  • command
  • split
  • upload

Rate the quality of this page

This page was helpful :) :( This page was not helpful

2 of 4 people found this page helpful

Related Pages

  • How To: Upload Logs With FileZilla
  • How to manage SSH users
  • How To: Upload Files to ScaleArc for Analysis
  • How to: Enable or Disable SSH access for ScaleArc 3.x for MySQL
  • How do I enable SSH access to my ScaleArc Server after Applying ScaleArc MySQL Version 3.0 Update 2?

Quick Jump
  • ScaleArc Customer Support
  • Knowledgebase
  • Downloads
  • Feedback
  • Contact Us
Top
Helpdesk software provided by DeskPRO