Download Latest Version
sparklyr 1.9.1 source code.tar.gz (3.7 MB)
Get an email when there's a new version of sparklyr
| Name | Modified | Size | Downloads / Week |
|---|---|---|---|
| Parent folder | |||
| README.md | 2025-03-18 | 1.6 kB | |
| v1.9.0 source code.tar.gz | 2025-03-18 | 3.5 MB | |
| v1.9.0 source code.zip | 2025-03-18 | 4.0 MB | |
| Totals: 3 Items | 7.6 MB | 0 | |
Sparklyr 1.9.0
Improvements
-
Adds support for Spark 4 and Scala 2.13 (#3479):
-
Adds new Java folder for Spark 4.0.0 with updated code
-
Adds new JAR file to handle Spark 4+
-
Updates to different spots in the R code to start handling version 4, as well as releases marked as "preview" by the Spark project
-
Removes JARs using Scala 2.11
-
Updates the Spark versions to use for CI
Fixes
sdf_sql()now returns nothing, including an error, when the query outputs an empty dataset (#3439)
What's Changed
- Fixes [#3439] by @edgararuiz in https://github.com/sparklyr/sparklyr/pull/3440
- Fix warnings with dbplyr and raw columns by @gregleleu in https://github.com/sparklyr/sparklyr/pull/3454
- CI updates by @edgararuiz in https://github.com/sparklyr/sparklyr/pull/3458
- fix:
src_databases,column with name 'databaseName' cannot be resolved by @weichisyu in https://github.com/sparklyr/sparklyr/pull/3460 - Adds support for Spark 4.0 by @edgararuiz in https://github.com/sparklyr/sparklyr/pull/3479
- Spark 4.0 and Scala 2.13 support - part deux by @edgararuiz in https://github.com/sparklyr/sparklyr/pull/3481
- captures multi line errors by @jmbarbone in https://github.com/sparklyr/sparklyr/pull/3475
- Updates by @edgararuiz in https://github.com/sparklyr/sparklyr/pull/3482
New Contributors
- @weichisyu made their first contribution in https://github.com/sparklyr/sparklyr/pull/3460
- @jmbarbone made their first contribution in https://github.com/sparklyr/sparklyr/pull/3475
Full Changelog: https://github.com/sparklyr/sparklyr/compare/v1.8.6...v1.9.0