AWS Data Wrangler Files

Notable Changes ⚠️

• AWS Lambda Layers: pyarrow was upgraded to 20.0.0

Features / Enhancements 🚀

• feat: add pyarrow_additional_kwargs to athena.to_iceberg by @jaidisido in https://github.com/aws/aws-sdk-pandas/pull/3094
• feat: add dtype argument to delete_from_iceberg by @jaidisido in https://github.com/aws/aws-sdk-pandas/pull/3099
• feat: add redshift and rds data api query params by @kukushking in https://github.com/aws/aws-sdk-pandas/pull/3111
• chore: ray 2.45 by @kukushking in https://github.com/aws/aws-sdk-pandas/pull/3143
• chore: upgrade setuptools & pin cmake by @kukushking in https://github.com/aws/aws-sdk-pandas/pull/3152
• chore: update pyarrow version by @EthanBunce in https://github.com/aws/aws-sdk-pandas/pull/3156

Bugfixes 🐛

• fix: Supports pyarrow's large_list by @ashrielbrian in https://github.com/aws/aws-sdk-pandas/pull/3086
• fix: large_list and large_string unit test for read_parquet_metadata by @ashrielbrian in https://github.com/aws/aws-sdk-pandas/pull/3089
• fix: handle partitions with empty table in read_parquet with dataset=True by @cournape in https://github.com/aws/aws-sdk-pandas/pull/2983
• fix: oracle decimal error by @kukushking in https://github.com/aws/aws-sdk-pandas/pull/3103
• chore: add redshift COPY with SERIALIZETOJSON test case by @kukushking in https://github.com/aws/aws-sdk-pandas/pull/3104
• fix: Changing dtype lowercasing to start of athena2pyarrow function by @DanielMy777 in https://github.com/aws/aws-sdk-pandas/pull/3122
• fix: concat with union categories by @kukushking in https://github.com/aws/aws-sdk-pandas/pull/3127
• fix: upgrade CDK RDS serverless databases to V2 by @jaidisido in https://github.com/aws/aws-sdk-pandas/pull/3128
• fix(athena): ensure thread safety when reading local Athena cache by @david-mateo in https://github.com/aws/aws-sdk-pandas/pull/3137

Security / Dependency Updates 🛡️

• chore(deps): bump the production-dependencies group with 2 updates by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3071
• chore(deps-dev): bump the development-dependencies group with 3 updates by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3072
• chore(deps): bump the production-dependencies group with 3 updates by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3075
• chore(deps-dev): bump the development-dependencies group with 3 updates by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3076
• chore: update dependecies (geopandas 1+) by @kukushking in https://github.com/aws/aws-sdk-pandas/pull/3079
• chore(deps): bump botocore from 1.36.3 to 1.36.6 in the production-dependencies group by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3081
• chore(deps-dev): bump the development-dependencies group across 1 directory with 3 updates by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3083
• chore(deps): bump the production-dependencies group with 2 updates by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3087
• chore(deps-dev): bump the development-dependencies group with 5 updates by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3088
• chore(deps): bump the production-dependencies group with 3 updates by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3097
• chore(deps-dev): bump the development-dependencies group with 5 updates by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3098
• chore(deps): bump the production-dependencies group with 3 updates by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3101
• chore(deps-dev): bump the development-dependencies group with 4 updates by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3102
• chore(deps): bump the production-dependencies group with 4 updates by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3105
• chore(deps-dev): bump the development-dependencies group with 5 updates by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3106
• chore(deps-dev): bump the development-dependencies group with 5 updates by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3109
• chore(deps): bump jinja2 from 3.1.5 to 3.1.6 by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3110
• chore(deps): bump the production-dependencies group with 2 updates by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3108
• chore(deps): bump aiohttp from 3.11.13 to 3.11.14 in the production-dependencies group by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3112
• chore(deps-dev): bump the development-dependencies group with 3 updates by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3113
• chore(deps): bump setuptools from 76.0.0 to 77.0.3 in the production-dependencies group by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3115
• chore(deps-dev): bump the development-dependencies group with 4 updates by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3116
• chore(deps-dev): bump the development-dependencies group with 4 updates by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3120
• chore(deps): bump setuptools from 77.0.3 to 78.1.0 in the production-dependencies group by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3119
• chore(deps-dev): bump the development-dependencies group with 4 updates by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3126
• chore(deps): bump the production-dependencies group with 4 updates by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3125
• chore(deps-dev): bump the development-dependencies group across 1 directory with 4 updates by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3133
• chore(deps-dev): bump h11 from 0.14.0 to 0.16.0 by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3139
• chore(deps-dev): bump the development-dependencies group with 5 updates by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3140
• chore(deps-dev): bump the development-dependencies group with 4 updates by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3141
• chore(deps): bump the production-dependencies group across 1 directory with 4 updates by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3142
• chore(deps): bump the production-dependencies group with 2 updates by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3146
• chore(deps-dev): bump the development-dependencies group with 5 updates by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3147
• chore(deps): bump the production-dependencies group with 2 updates by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3150
• chore(deps-dev): bump the development-dependencies group with 4 updates by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3151
• chore(deps-dev): bump tornado from 6.4.2 to 6.5.1 by @dependabot in https://github.com/aws/aws-sdk-pandas/pull/3153

Documentation / Workflows 📚

• chore: Prepare 3.12.0 by @kukushking in https://github.com/aws/aws-sdk-pandas/pull/3154
• chore: update layers.rst by @EthanBunce in https://github.com/aws/aws-sdk-pandas/pull/3158

New Contributors

• @ashrielbrian made their first contribution in https://github.com/aws/aws-sdk-pandas/pull/3086
• @cournape made their first contribution in https://github.com/aws/aws-sdk-pandas/pull/2983
• @DanielMy777 made their first contribution in https://github.com/aws/aws-sdk-pandas/pull/3122
• @david-mateo made their first contribution in https://github.com/aws/aws-sdk-pandas/pull/3137
• @EthanBunce made their first contribution in https://github.com/aws/aws-sdk-pandas/pull/3156

Full Changelog: https://github.com/aws/aws-sdk-pandas/compare/3.11.0...3.12.0