Apache Ozone 2 Adds HSync Support
Written by Kay Ewbank   
Monday, 26 May 2025

Apache Ozone 2 has been released with support for HSync and lease recovery, and symmetric keys for delegation tokens among the improvements. 

Apache Ozone is a highly scalable, distributed storage system for analytics, big data and cloud native applications. Ozone supports S3 compatible object APIs as well as a Hadoop Compatible File System implementation. Ozone is built on a highly available, replicated block storage layer called Hadoop Distributed Data Store (HDDS), and it can be used with frameworks such as Apache Spark, YARN and Hive. 

ozone

Ozone works effectively in containerized environments such as Kubernetes and YARN, and supports a number of protocols including S3 and Hadoop File System APIs. It is designed to scale to tens of billions of files and blocks, with a strongly consistent object store based on protocols like RAFT. Ozone integrates with Kerberos infrastructure for authentication, supports native ACLs and integrates with Ranger for access control and supports TDE and on-wire encryption. 

This release has added support for HSync and lease recovery through the addition of an hflush API and lease recovery support in Ozone. This developers say this enables new use cases such as HBase and Solr where the Write Ahead Log and Transaction Logs are flushed to Ozone constantly. In Ozone terms HSync refers to the hflush or hsync API, which ensures that data written to a file is flushed to storage before the application continues.

SCM (Storage Container Manager) decommissioning support has also been added, along with symmetric keys for delegation tokens, and atomic key overwrite and key replacement. This adds support for a lightweight form of data tiering, where an external service can monitor the age and access pattern of keys and arrange to convert them from Ratis to EC, for example. The initial implementation enables atomic overwrite only on the Java OzoneBucket API, but may be expanded more widely in the Java and S3 API later. 

This version also adds ARM64 support, and AWS SDK v2 client support. 

Apache Ozone 2 is available now.  

ozone

More Information

Ozone Website

Ozone on GitHub

Related Articles

Apache Spark Now Understands English

Apache Hive Adds Support For Set Operations

Hadoop 3 Adds HDFS Erasure Coding

To be informed about new articles on I Programmer, sign up for our weekly newsletter, subscribe to the RSS feed and follow us on Twitter, Facebook or Linkedin.

Banner


Wing Python 11 Increases AI Use
09/06/2025

Wing Python IDE version 11 has been released with improvements to the AI assisted development UI and support for more providers. It also has improved Python code analysis. 



Robot Combat Between Unitree G1s
01/06/2025

The world's first Humanoid Robot Kickboxing contest took place on May 25 in Hangzhou, China. While the event aimed to highlight the integration of AI and robotics, the robots weren't ac [ ... ]


More News

espbook

 

Comments




or email your comment to: comments@i-programmer.info