OpenSearch Files

2025-06-17 Version 3.1.0 Release Notes

[3.1]

Added

• Add support for linux riscv64 platform (#18156)
• [Rule based auto-tagging] Add get rule API (#17336)
• [Rule based auto-tagging] Add Delete Rule API (#18184)
• Add paginated wlm/stats API (#17638)
• [Rule based auto-tagging] Add Create rule API (#17792)
• Implement parallel shard refresh behind cluster settings (#17782)
• Bump OpenSearch Core main branch to 3.0.0 (#18039)
• [Rule based Auto-tagging] Add wlm ActionFilter (#17791)
• [Rule based auto-tagging] Add update rule API (#17797)
• [Rule based auto-tagging] Bug fix for update rule api (#18488)
• Update API of Message in index to add the timestamp for lag calculation in ingestion polling (#17977)
• Add Warm Disk Threshold Allocation Decider for Warm shards (#18082)
• Add composite directory factory (#17988)
• [Rule based auto-tagging] Add refresh based synchronization service for Rules (#18128)
• Add pull-based ingestion error metrics and make internal queue size configurable (#18088)
• Adding support for derive source feature and implementing it for various type of field mappers (#17759)
• [Security Manager Replacement] Enhance Java Agent to intercept newByteChannel (#17989)
• Enabled Async Shard Batch Fetch by default (#18139)
• Allow to get the search request from the QueryCoordinatorContext (#17818)
• Reject close index requests, while remote store migration is in progress.(#18327)
• Improve sort-query performance by retaining the default totalHitsThreshold for approximated match_all queries (#18189)
• Enable testing for ExtensiblePlugins using classpath plugins (#16908)
• Introduce system generated ingest pipeline (#17817))
• Added Auto Force Merge Manager to enhance hot to warm migration experience (#18229)
• Apply cluster state metadata and routing table diff when building cluster state from remote(#18256)
• Support create mode in pull-based ingestion and add retries for transient failures (#18250))
• Decouple the init of Crypto Plugin and KeyProvider in CryptoRegistry (18270))
• Support cluster write block in pull-based ingestion (#18280))
• Use QueryCoordinatorContext for the rewrite in validate API. (#18272)
• Upgrade crypto kms plugin dependencies for AWS SDK v2.x. (#18268)
• Add support for matched_fields with the unified highlighter (#18164)
• Add BooleanQuery rewrite for must_not RangeQuery clauses (#17655)
• [repository-s3] Add support for SSE-KMS and S3 bucket owner verification (#18312)
• Optimize gRPC perf by passing by reference (#18303)
• Added File Cache Stats - Involves Block level as well as full file level stats (#17538)
• Added time_in_execution attribute to /_cluster/pending_tasks response (#17780)
• Added File Cache Pinning (#17617)
• Support consumer reset in Resume API for pull-based ingestion. This PR includes a breaking change for the experimental pull-based ingestion feature. (#18332)
• Add FIPS build tooling (#4254)
• Support Nested Aggregations as part of Star-Tree (#18048)
• [Star-Tree] Support for date-range queries with star-tree supported aggregations (#17855
• Added node-left metric to cluster manager (#18421)
• [Star tree] Remove star tree feature flag and add index setting to configure star tree search on index basis (#18070)
• Approximation Framework Enhancement: Update the BKD traversal logic to improve the performance on skewed data (#18439)
• Support system generated ingest pipelines for bulk update operations (#18277))
• Added FS Health Check Failure metric (#18435)

Changed

• Create generic DocRequest to better categorize ActionRequests (#18269))
• Change implementation for percentiles aggregation for latency improvement (#18124)
• Update FipsMode check to catch NoSuchMethodError (#18427)

Dependencies

• Update Apache Lucene from 10.1.0 to 10.2.1 (#17961)
• Bump com.google.code.gson:gson from 2.12.1 to 2.13.1 (#17923, #18266)
• Bump com.github.spotbugs:spotbugs-annotations from 4.9.0 to 4.9.3 (#17922)
• Bump com.microsoft.azure:msal4j from 1.18.0 to 1.20.0 (#17925)
• Update Apache HttpClient5 and HttpCore5 (CVE-2025-27820) (#18152)
• Bump org.apache.commons:commons-collections4 from 4.4 to 4.5.0 (#18101)
• Bump netty from 4.1.118.Final to 4.1.121.Final (#18192)
• Bump org.apache.commons:commons-configuration2 from 2.11.0 to 2.12.0 (#18103, #18262)
• Bump com.nimbusds:nimbus-jose-jwt from 10.0.2 to 10.3 (#18104, #18336)
• Bump org.apache.commons:commons-text from 1.13.0 to 1.13.1 (#18102)
• Bump reactor-netty from 1.2.4 to 1.2.5 (#18243)
• Bump reactor from 3.5.20 to 3.7.5 (#18243)
• Bump com.azure:azure-core-http-netty from 1.15.7 to 1.15.11 (#18265)
• Bump lycheeverse/lychee-action from 2.4.0 to 2.4.1 (#18264)
• Bump com.maxmind.geoip2:geoip2 from 4.2.1 to 4.3.1 (#18263, #18413)
• Bump com.azure:azure-json from 1.3.0 to 1.5.0 (#18335)
• Bump org.jline:jline from 3.29.0 to 3.30.4 (#18368, #18414)
• Bump com.nimbusds:oauth2-oidc-sdk from 11.23.1 to 11.25 (#18369)
• Bump gradle/actions from 3 to 4 (#18371)
• Bump com.azure:azure-storage-common from 12.28.0 to 12.29.0 (#18415)
• Bump com.squareup.okio:okio from 3.10.2 to 3.12.0 (#18468)
• Bump com.azure:azure-xml from 1.1.0 to 1.2.0 (#18469)
• Bump com.maxmind.db:maxmind-db from 3.1.1 to 3.2.0 (#18470)

Removed

• [repository-s3] Removed existing ineffective server_side_encryption setting (#18312)

Fixed

• Fix simultaneously creating a snapshot and updating the repository can potentially trigger an infinite loop (#17532)
• Remove package org.opensearch.transport.grpc and replace with org.opensearch.plugin.transport.grpc (#18031)
• Fix the native plugin installation error cause by the pgp public key change (#18147)
• Fix object field exists query (#17843)
• Use Bad Request status for InputCoercionException (#18161)
• Null check field names in QueryStringQueryBuilder (#18194)
• Avoid NPE if on SnapshotInfo if 'shallow' boolean not present (#18187)
• Fix 'system call filter not installed' caused when network.host: 0.0.0.0 (#18309)
• DocValues-only IP field supports terms_query with more than 1025 IP masks (#18357
• Fix MatrixStatsAggregator reuse when mode parameter changes (#18242)
• Replace the deprecated construction method of TopScoreDocCollectorManager with the new method (#18395)
• Fixed Approximate Framework regression with Lucene 10.2.1 by updating intersectRight BKD walk and IntRef visit method (#18358)