Repository navigation
Add Quickstart: Run PySpark on Apache Iceberg Tables with Snowpark Connect for Spark - #3734
Conversation
Helpful InformationNon-Image Files in Assets FolderNon-image files found in /assets folders will **NOT** be uploaded to snowflake.com. If you are referencing them in your guide, you should link to them directly (e.g. [using permanent GitHub links](htt…
These are informational messages and will not block your PR from being merged. |
🔗 Staging Preview ReadyQuickstart:
Generated by GitHub Actions |
🔗 Staging Preview ReadyQuickstart:
Generated by GitHub Actions |
🔗 Staging Preview ReadyQuickstart:
Generated by GitHub Actions |
Summary
Adds a Quickstart that runs an existing PySpark churn pipeline (fictional StreamCo) on Snowflake with Snowpark Connect for Spark, writing Snowflake-managed Apache Iceberg tables. It covers DataFrameWriterV2, day partitions and
overwritePartitions(), Iceberg tags, incremental reads and the changelog, time travel, Write-Audit-Publish on branches (preview) and lineage via metadata tables.Guide
pyspark-iceberg-churn-snowpark-connectsite/sfguides/src/pyspark-iceberg-churn-snowpark-connect/Test plan
DROP ROLE IF EXISTS SCOS_CHURN_ROLEcleans up in the Clean Up step.context-ticket: N/A