OpenStack Swift is a self-hosted option that offers enough compatibility with the S3 API to be used as deep storage via Druid's S3 integration.
Imply 2.7.x and earlier (Druid 0.12.x and earlier)
These versions use the JetS3t library to access S3 APIs.
- Configure S3 deep storage the usual way: add "druid-s3-extensions" to your extension list, configure access and secret keys, and configure a bucket and path.
- Create a file "conf/druid/_common/jets3t.properties" (or "conf-quickstart/druid/_common/jets3t.properties" if you are using the quickstart config) and include the following lines:
Imply 2.8 and later
These versions use the Amazon aws-java-sdk to access S3 APIs. We do not have specifics at this time about how to integrate these versions with Swift for deep storage.
Please sign in to leave a comment.