| Apache Ozone 2 Adds HSync Support |
| Written by Kay Ewbank |
| Monday, 26 May 2025 |
|
Apache Ozone 2 has been released with support for HSync and lease recovery, and symmetric keys for delegation tokens among the improvements. Apache Ozone is a highly scalable, distributed storage system for analytics, big data and cloud native applications. Ozone supports S3 compatible object APIs as well as a Hadoop Compatible File System implementation. Ozone is built on a highly available, replicated block storage layer called Hadoop Distributed Data Store (HDDS), and it can be used with frameworks such as Apache Spark, YARN and Hive.
Ozone works effectively in containerized environments such as Kubernetes and YARN, and supports a number of protocols including S3 and Hadoop File System APIs. It is designed to scale to tens of billions of files and blocks, with a strongly consistent object store based on protocols like RAFT. Ozone integrates with Kerberos infrastructure for authentication, supports native ACLs and integrates with Ranger for access control and supports TDE and on-wire encryption. This release has added support for HSync and lease recovery through the addition of an hflush API and lease recovery support in Ozone. This developers say this enables new use cases such as HBase and Solr where the Write Ahead Log and Transaction Logs are flushed to Ozone constantly. In Ozone terms HSync refers to the hflush or hsync API, which ensures that data written to a file is flushed to storage before the application continues. SCM (Storage Container Manager) decommissioning support has also been added, along with symmetric keys for delegation tokens, and atomic key overwrite and key replacement. This adds support for a lightweight form of data tiering, where an external service can monitor the age and access pattern of keys and arrange to convert them from Ratis to EC, for example. The initial implementation enables atomic overwrite only on the Java OzoneBucket API, but may be expanded more widely in the Java and S3 API later. This version also adds ARM64 support, and AWS SDK v2 client support. Apache Ozone 2 is available now.
More InformationRelated ArticlesApache Spark Now Understands English Apache Hive Adds Support For Set Operations Hadoop 3 Adds HDFS Erasure Coding To be informed about new articles on I Programmer, sign up for our weekly newsletter, subscribe to the RSS feed and follow us on Twitter, Facebook or Linkedin. 
Comments
or email your comment to: comments@i-programmer.info |
