Spice v1.5.1 (July 28, 2025)
Spice v1.5.1 expands the GitHub data connector to include pull-request comments, adds a configurable rate limiting for AWS Bedrock embedding models, expands partition pruning with inequality operators, and adds client-supplied cache keys for granular caching control in the HTTP and Arrow Flight SQL APIs.
What's New in v1.5.1
GitHub Data Connector Pull Request Comments: Configure GitHub pulls datasets to include comments.
Example Spicepod.yaml:
:::yaml
datasets:
- from: github:github.com/spiceai/spiceai/pulls
name: spiceai.pulls
params:
include_comments: all # 'review', 'discussion', or 'none'. Defaults to 'none'.
max_comments_fetched: '25' # Defaults to 100
# ...
For details, see the GitHub Data Connector documentation.
AWS Bedrock Embedding Models Invocation Control: Improved rate limiting control for AWS Bedrock embedding models with max_concurrent_invocations
configuration.
:::yaml
embeddings:
- from: bedrock:cohere.embed-english-v3
name: cohere-embeddings
params:
max_concurrent_invocations: '41'
# ...
For details, see the AWS Bedrock Embeddings Model Provider documentation.
Improved Query Partitioning: Expanded partition pruning support with additional inequality operators (e.g. >, >=, <, <=).
For details, see the Query Partitioning documentation.
Client-Supplied Cache Keys: Support for a new Spice-Cache-Key
header/metadata-key in the HTTP and Arrow Flight SQL query APIs to for fine-grained client-side caching control.
Example HTTP API usage:
:::bash
$ curl -vvS -XPOST http://localhost:8090/v1/sql \
-H"spice-cache-key: 1851400_20170216_north_america" \
-d "select * from scihub_journals_accessed
where user_id = '1851400'
and date_trunc('DAY', timestamp) = '2017-02-16'
and city = 'New York';"
Example Response:
:::bash
< HTTP/1.1 200 OK
< content-type: application/json
< x-cache: Hit from spiceai
< results-cache-status: HIT
< vary: Spice-Cache-Key
< vary: origin, access-control-request-method, access-control-request-headers
< content-length: 604
< date: Wed, 23 Jul 2025 20:26:12 GMT
<
[{
"timestamp": "2017-02-16 09:55:06",
"doi": "10.1155/2012/650929",
"ip_identifier": 1000856,
"user_id": 1851400,
"country": "United States",
"city": "New York",
"longitude": 40.7830603,
"latitude": -73.9712488
},
...
]
For details, see the Cache Control documentation.
Contributors
- @Jeadie
- @Advayp
- @sgrebnov
- @kczimm
- @lukekim
- @phillipleblanc
- @mach-kernel
- @varunguleriaCodes
- @peasee
- @Sevenannn
- @ewgenius
New Contributors
- @varunguleriaCodes made their first contribution in github.com/spiceai/spiceai/pull/6383
Breaking Changes
- N/A
Cookbook Updates
No new recipes added in this release.
The Spice Cookbook includes 74 recipes to help you get started with Spice quickly and easily.
Upgrading
To upgrade to v1.5.1, use one of the following methods:
CLI:
:::console
spice upgrade
Homebrew:
:::console
brew upgrade spiceai/spiceai/spice
Docker:
Pull the spiceai/spiceai:1.5.1
image:
:::console
docker pull spiceai/spiceai:1.5.1
For available tags, see DockerHub.
Helm:
:::console
helm repo update
helm upgrade spiceai spiceai/spiceai
What's Changed
Dependencies
No major dependency updates.
Changelog
- Fix refresh via Api when dataset is already accelerated and no refresh interval is set by @sgrebnov in https://github.com/spiceai/spiceai/pull/6549
- Add support for custom GraphQL unnesting behavior by @Advayp in https://github.com/spiceai/spiceai/pull/6540
- Regex Update to disallow hyphens dataset names by @varunguleriaCodes in https://github.com/spiceai/spiceai/pull/6383
- Enforce max limit on comments fetched per PR by @Advayp in https://github.com/spiceai/spiceai/pull/6580
- Fix accelerated refresh issue by @Advayp in https://github.com/spiceai/spiceai/pull/6590
- Enable configurations of max invocations for Bedrock models by @Advayp in https://github.com/spiceai/spiceai/pull/6592
- Client-supplied cache keys (Spice-Cache-Key) by @mach-kernel in https://github.com/spiceai/spiceai/pull/6579
- Improved partition pruning by @kczimm in https://github.com/spiceai/spiceai/pull/6582
- Fix retention filter when both retention_sql and period are set by @sgrebnov in https://github.com/spiceai/spiceai/pull/6595
- Initial support for PR comments by @Advayp in https://github.com/spiceai/spiceai/pull/6569
- chore: Update croner by @peasee in https://github.com/spiceai/spiceai/pull/6547
- fix databricks streaming for Claude model by @peasee in https://github.com/spiceai/spiceai/pull/6601
- Remove
FullTextUDTFAnalyzerRule
and move FTS code intosearch
crate by @jeadie in https://github.com/spiceai/spiceai/pull/6596 - Remove download of legacy sentence transformers config by @jeadie in https://github.com/spiceai/spiceai/pull/6605
- re-add snapshot tests by @jeadie
- Embedding column config to support client-specified vector sizes by @mach-kernel in https://github.com/spiceai/spiceai/pull/6610
- Fix mismatch in columns for the GitHub PR table type by @Advayp in https://github.com/spiceai/spiceai/pull/6616
- bump version to 1.5.1 by @phillipleblanc
- fix issues with cherry-picking by @jeadie
- Add integration tests for GitHub PRs with comments by @Advayp in https://github.com/spiceai/spiceai/pull/6581
- Add view name to view creation errors by @lukekim in https://github.com/spiceai/spiceai/pull/6611
- CDC: Compute embeddings on ingest by @mach-kernel in https://github.com/spiceai/spiceai/pull/6612