Skip to content

Apache OpenDAL: Access data freely, painlessly, and efficiently.

License

Notifications You must be signed in to change notification settings

thorseraq/incubator-opendal

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Apache OpenDAL

OpenDAL is a data access layer that allows users to easily and efficiently retrieve data from various storage services in a unified way.

OpenDAL Architectural

Major components of the project include:

Libraries

Applications

  • oli: OpenDAL Command Line Interface
  • oay: OpenDAL Gateway

Services

Standard Storage Protocols (like ftp, webdav)
  • ftp: FTP and FTPS
  • http: HTTP read-only services
  • sftp: SFTP services being worked on
  • webdav: WebDAV Service
Object Storage Services (like s3, gcs, azblob)
File Storage Services (like fs, azdls, hdfs)
Consumer Cloud Storage Service (like gdrive, onedrive)
Key-Value Storage Service (like rocksdb, sled)
Cache Storage Service (like memcached, moka)

Welcome to add any services that are not currently supported here.

Examples

The examples are available at here.

Documentation

The documentation is available at https://opendal.apache.org.

Contribute

OpenDAL is an active open-source project. We are always open to people who want to use it or contribute to it. Here are some ways to go.

Who is using OpenDAL?

  • Databend: A modern Elasticity and Performance cloud data warehouse.
  • GreptimeDB: An open-source, cloud-native, distributed time-series database.
  • deepeth/mars: The powerful analysis platform to explore and visualize data from blockchain.
  • mozilla/sccache: sccache is ccache with cloud storage
  • RisingWave: A Distributed SQL Database for Stream Processing
  • Vector: A high-performance observability data pipeline.
  • OctoBase: the open-source database behind AFFiNE, local-first, yet collaborative.
  • Pants: A fast, scalable, user-friendly build system for codebases of all sizes.

License

Licensed under the Apache License, Version 2.0

About

Apache OpenDAL: Access data freely, painlessly, and efficiently.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Rust 86.1%
  • Java 3.6%
  • MDX 1.8%
  • Haskell 1.1%
  • C 1.1%
  • JavaScript 1.0%
  • Other 5.3%