• Feature Releases
  • Popular
Instaclustr Product Update: September 2024

Here is a roundup of the latest features and updates we’ve developed on the Instaclustr Platform over the last few months! Our team has been hard at work listening to your feedback and making continuous improvements. 

If you have specific feature requests or improvement ideas you’d love to see, please get in touch with us. 

Major Announcements:

Apache Kafka®

Tiered Storage for Instaclustr for Apache Kafka® in Public Preview

Instaclustr for Apache Kafka now offers a Tiered Storage feature in public preview for AWS customers. Tiered Storage enables users to offload historical data to cost-effective storage solutions without sacrificing real-time query capabilities.

With a simple setup and one-click enablement, the feature allows for indefinite data retention by moving data to limitless remote storage, reducing storage and replication costs, and seamlessly integrating with existing Kafka clusters.  

ClickHouse®

Instaclustr for ClickHouse in Private Preview 

Meet the latest addition to the Instaclustr managed offering portfolio, Instaclustr for ClickHouse. 

ClickHouse is a powerful open source, column-oriented DBMS known for its lightning-fast query processing. ClickHouse is commonly used for real time analytics, log and event analysis, and machine learning capabilities to support AI use cases.

By offering ClickHouse on the Instaclustr Managed Platform, NetApp is enabling customers to leverage these capabilities without the operational complexities typically associated with self-managed solutions. 

OpenSearch®

Instaclustr Managed OpenSearch® with NetApp StorageGRID® 

Instaclustr for OpenSearch now supports the use of StorageGRID®, expanding our on-premises capabilities for OpenSearch. With native S3 object storage support, this integration allows businesses to efficiently back up and store large volumes of data.  

OpenSearch Searchable Snapshots are fully supported with StorageGRID®, allowing customers to store more data in “cold, cheaper object storage, while still being able to search it as you would any OpenSearch index.

Other Significant Changes:

Apache Cassandra®

Apache Kafka

Cadence®

  • Customer initiated scaling has been introduced in Instaclustr’s Shared Infrastructure for Cadence® Solution. This allows our customers to scale up and down their shared infrastructure Cadence clusters at the click of a button!

Ocean for Apache Spark™ 

  • Shuffle Data Store is a new addition to Ocean for Apache Spark, enhancing the resilience and efficiency of multi-step data preparation pipelines on AWS. The external shuffle solution is backed by either Amazon FSx for NetApp ONTAP storage or Amazon S3 storage, which protects Spark shuffle data in the event of a node failure. The new feature enables data engineering on lower-cost spot instances and the announcement describes further cost savings from scaling down. 

OpenSearch

  • OpenSearch® Versions 2.14 and 1.3.17 is GA. OpenSearch 2.14 features significant date histogram query speed improvements, integration of multiple data sources in OpenSearch Dashboards, and enhanced k-NN plugin functionalities. 

PostgreSQL®

  • PostgreSQL versions 16.3, 15.7, 14.12 and PgBouncer version 1.22.1 are GA. 
  • PG Cron extension is now supported for PostgreSQL clusters, enabling the scheduling of automated tasks directly within the database. 

Redis™ 

  • Redis versions 6.2.14, 7.0.14, 7.2.4 are GA. 
  • Following the announcement to support Valkey, Redis will continue to be supported on the Instaclustr Managed Platform for existing customers until version 7.2.4 becomes End-of-Life, which is expected in 2026. 

Valkey

  • We’ve recently announced our plan to support Valkey, an open source fork of the Redis project. When Valkey launches on our platform, organizations using Redis will be able to migrate to the fully open source project, avoiding the risk of future license changes.  

Instaclustr Managed Platform 

  • Added support for Tel Aviv (il-central-1) and Calgary (ca-west-1) in AWS regions. 
  • Added API support for User Actions feature enabling programmatical retrieval of audit logs for transparency, compliance, and log management purposes. 

Upcoming Releases

Apache Cassandra  

  • After the public review release of Cassandra 5.0 on the Instaclustr Managed Platform, we are gearing up for the General Availability release. Customers can take advantage of the new features of Cassandra 5.0 backed by industry-leading SLAs and ready for use in production environments. Keep an eye out for the exciting announcement of our GA release! 

ClickHouse

  • ClickHouse is on the runway to GA, with a target release date in November 2024. Enabling seamless integrations, enterprise-grade support and industry-leading SLAs on the Instaclustr Managed Platform. 

Apache Kafka

  • Support for Private Service Connect for managed Kafka cluster running on GPC is underway. The feature provides private network connectivity, removes the need for firewall rules, path definitions, or route tables between VPCs, ensuring VPC traffic is not exposed to the public internet, thereby reducing exposure to network security threats.
  • Bundled OpenSearch sink connector for use with Instaclustr managed Kafka Connect to allow customers to easily move data from Kafka to OpenSearch is to be introduced soon. 

Cadence

  • Graviton instance types, which are more cost-effective than similar x86 instance types, will be added to support Developer, Non-Production, and Production SLAs​. 

PostgreSQL

  • PostgreSQL Azure Private Link​ is to be introduced soon, providing private network connectivity removing the need for firewall rules, path definitions, or route tables between VPCs ensuring VPC traffic is not exposed to the public internet, reducing exposure to network security threats.​  

OpenSearch 

  • Cross-cluster replication will soon be released to GA. This feature enables users to replicate indexes, mappings, and other data from one OpenSearch cluster to another. 

Did You Know?