Notable Changes ⚠️
- AWS Lambda Layers: pyarrow was upgraded to 20.0.0
Features / Enhancements 🚀
- feat: add pyarrow_additional_kwargs to athena.to_iceberg by @jaidisido in #3094
- feat: add dtype argument to delete_from_iceberg by @jaidisido in #3099
- feat: add redshift and rds data api query params by @kukushking in #3111
- chore: ray 2.45 by @kukushking in #3143
- chore: upgrade setuptools & pin cmake by @kukushking in #3152
- chore: update pyarrow version by @EthanBunce in #3156
Bugfixes 🐛
- fix: Supports pyarrow's
large_list
by @ashrielbrian in #3086 - fix:
large_list
andlarge_string
unit test forread_parquet_metadata
by @ashrielbrian in #3089 - fix: handle partitions with empty table in read_parquet with dataset=True by @cournape in #2983
- fix: oracle decimal error by @kukushking in #3103
- chore: add redshift
COPY
withSERIALIZETOJSON
test case by @kukushking in #3104 - fix: Changing dtype lowercasing to start of athena2pyarrow function by @DanielMy777 in #3122
- fix: concat with union categories by @kukushking in #3127
- fix: upgrade CDK RDS serverless databases to V2 by @jaidisido in #3128
- fix(athena): ensure thread safety when reading local Athena cache by @david-mateo in #3137
Security / Dependency Updates 🛡️
- chore(deps): bump the production-dependencies group with 2 updates by @dependabot in #3071
- chore(deps-dev): bump the development-dependencies group with 3 updates by @dependabot in #3072
- chore(deps): bump the production-dependencies group with 3 updates by @dependabot in #3075
- chore(deps-dev): bump the development-dependencies group with 3 updates by @dependabot in #3076
- chore: update dependecies (geopandas 1+) by @kukushking in #3079
- chore(deps): bump botocore from 1.36.3 to 1.36.6 in the production-dependencies group by @dependabot in #3081
- chore(deps-dev): bump the development-dependencies group across 1 directory with 3 updates by @dependabot in #3083
- chore(deps): bump the production-dependencies group with 2 updates by @dependabot in #3087
- chore(deps-dev): bump the development-dependencies group with 5 updates by @dependabot in #3088
- chore(deps): bump the production-dependencies group with 3 updates by @dependabot in #3097
- chore(deps-dev): bump the development-dependencies group with 5 updates by @dependabot in #3098
- chore(deps): bump the production-dependencies group with 3 updates by @dependabot in #3101
- chore(deps-dev): bump the development-dependencies group with 4 updates by @dependabot in #3102
- chore(deps): bump the production-dependencies group with 4 updates by @dependabot in #3105
- chore(deps-dev): bump the development-dependencies group with 5 updates by @dependabot in #3106
- chore(deps-dev): bump the development-dependencies group with 5 updates by @dependabot in #3109
- chore(deps): bump jinja2 from 3.1.5 to 3.1.6 by @dependabot in #3110
- chore(deps): bump the production-dependencies group with 2 updates by @dependabot in #3108
- chore(deps): bump aiohttp from 3.11.13 to 3.11.14 in the production-dependencies group by @dependabot in #3112
- chore(deps-dev): bump the development-dependencies group with 3 updates by @dependabot in #3113
- chore(deps): bump setuptools from 76.0.0 to 77.0.3 in the production-dependencies group by @dependabot in #3115
- chore(deps-dev): bump the development-dependencies group with 4 updates by @dependabot in #3116
- chore(deps-dev): bump the development-dependencies group with 4 updates by @dependabot in #3120
- chore(deps): bump setuptools from 77.0.3 to 78.1.0 in the production-dependencies group by @dependabot in #3119
- chore(deps-dev): bump the development-dependencies group with 4 updates by @dependabot in #3126
- chore(deps): bump the production-dependencies group with 4 updates by @dependabot in #3125
- chore(deps-dev): bump the development-dependencies group across 1 directory with 4 updates by @dependabot in #3133
- chore(deps-dev): bump h11 from 0.14.0 to 0.16.0 by @dependabot in #3139
- chore(deps-dev): bump the development-dependencies group with 5 updates by @dependabot in #3140
- chore(deps-dev): bump the development-dependencies group with 4 updates by @dependabot in #3141
- chore(deps): bump the production-dependencies group across 1 directory with 4 updates by @dependabot in #3142
- chore(deps): bump the production-dependencies group with 2 updates by @dependabot in #3146
- chore(deps-dev): bump the development-dependencies group with 5 updates by @dependabot in #3147
- chore(deps): bump the production-dependencies group with 2 updates by @dependabot in #3150
- chore(deps-dev): bump the development-dependencies group with 4 updates by @dependabot in #3151
- chore(deps-dev): bump tornado from 6.4.2 to 6.5.1 by @dependabot in #3153
Documentation / Workflows 📚
- chore: Prepare 3.12.0 by @kukushking in #3154
- chore: update layers.rst by @EthanBunce in #3158
New Contributors
- @ashrielbrian made their first contribution in #3086
- @cournape made their first contribution in #2983
- @DanielMy777 made their first contribution in #3122
- @david-mateo made their first contribution in #3137
- @EthanBunce made their first contribution in #3156
Full Changelog: 3.11.0...3.12.0