On Tue, 2016-02-23 at 11:10 +1000, Piers Rowan via luv-main wrote:
I am looking at options for backup storage. From reviewing prices storage is quite cheap but I get confused by the mix-'n-match nature of some of the cloud offerings. [...] Seem to be up and working with Google now.
If storing data "outside your premise" is not an issue for you (you have to trust another entity what they are doing and not doing with your data while in transfer and while in rest), AWS S3 is pretty simple and straight forward: - get an AWS account, login at the AWS Management Console - S3: create a bucket (choose your preferred geo location, e.g. Sydney) - IAM: create a new user account (API access only, no password) - IAM: attach an access policy (to let this user access the bucket) - on your Linux box: install "aws cli" - run "aws configure" (to store the access and secret key) That's it. Now you can read/write/sync your data to and from the S3 bucket. Some examples below. Output the general man pages: $ aws help Output the S3-specific man pages: $ aws s3 help List all buckets: $ aws s3 ls Copy file "helloworld.txt" to S3 bucket "mybucket": $ aws s3 cp helloworld.txt s3://mybucket/ List the content of bucket "mybucket": $ aws s3 ls s3://mybuchet/ Download file "helloworld.txt" from S3 bucket "mybucket" to /tmp: $ aws s3 cp s3://mybucket/helloworld.txt /tmp/ Synchronise directory /tmp/myfiles to S3 recursively: $ aws s3 sync /tmp/myfiles s3://mybucket/myfiles/ List the content of directory "myfiles" of bucket "mybucket" recursively: $ aws s3 ls s3://mybuchet/myfiles/ --recursive Further reading: Getting Started: https://aws.amazon.com/getting-started/ AWS S3 details and pricing: https://aws.amazon.com/s3/ AWS CLI: https://aws.amazon.com/cli/ AWS CLI at GitHub: https://github.com/aws/aws-cli I also played with "s3fs-fuse" and wrote a tutorial (see link below), but I prefer to use the "official" aws-cli-way nowadays to be honest :-) https://schams.net/typo3-on-aws/documentation/howto/mount-an-aws-s3-bucket/ Off topic: depending on the data, you possibly want to consider encrypting every file at your end, prior the transfer to AWS, Google or any other external service provider. Cheers Michael