Articles in this section

Using OpenStack Swift as deep storage for Druid

About Swift

OpenStack Swift is a self-hosted option that offers enough compatibility with the S3 API to be used as deep storage via Druid's S3 integration.

Imply 2.7.x and earlier (Druid 0.12.x and earlier)

These versions use the JetS3t library to access S3 APIs.

  1. Configure S3 deep storage the usual way: add "druid-s3-extensions" to your extension list, configure access and secret keys, and configure a bucket and path.
  2. Create a file "conf/druid/_common/jets3t.properties" (or "conf-quickstart/druid/_common/jets3t.properties" if you are using the quickstart config) and include the following lines:
s3service.s3-endpoint=swift.example.com
s3service.s3-endpoint-http-port=8080
s3service.https-only=false
s3service.disable-dns-buckets=true
s3service.enable-storage-classes=false

 

Imply 2.8 and later

These versions use the Amazon aws-java-sdk to access S3 APIs. We do not have specifics at this time about how to integrate these versions with Swift for deep storage.

Was this article helpful?
0 out of 0 found this helpful