PART 1: HOW TO ZIP FILES FAST, ON THE FLY & GET DOWNLOAD URLS FROM AWS S3

INTRODUCTION

AWS S3 is by far one of the cheapest cloud storage solutions out there. It works well for people that either need short-term or long-term storage.
This makes it one of the most commonly used storage solutions available in the market. Because S3 is only a storage solution, a lot of users will find that it lacks some common features that they take for granted daily. When working with a personal computer, some features like Copy/Cut/Paste, creating a zip file are simple and provide much-needed convenience. This makes for easy file compression and file sharing. To be precise, S3 storage can be considered a key-value storage. A key-value storage is where a certain key is matched to a certain value.

I have always been intrigued by the idea of doing faster and faster file compressions in Amazon S3. I will go ahead and show you how to do it.

This example uses S3zippper API to accomplish the task.

S3zipper API hopes to make this process easy by providing this complete service in the form of an API.

Some cool features include:

  • ability to run tasks in the background
  • ability to retry failed tasks
  • ability to check task status
  • ability to check task results
  • ability to send notification emails
  • ease of use
  • works with almost any programming language that supports S3 i.e. Python, PHP, Go(Golang), Ruby, jQuery, Node

Requirements

  1. AWS Key
  2. AWS Secret
  3. Bucket Name
  4. Bucket Region

Optional requirements

  1. AWS Token
  2. AWS End Point
Edwin Siror avatar
About Edwin Siror
Edwin Siror writes about interesting topics on web technology, and is a avid user of Go(Golang). He is also the creator of S3zipper - an Aws S3 file zipping service(https://docs.s3zipper.com/)
comments powered by Disqus