v1.2.0

Highlights

New features

• Integration of JuiceFS S3 gateway to achieve the architecture of compute-storage separation.
• Integration of Iceberg on Hive/Spark/Flink to build data lakehouse on KDP.
• Integration of the high-performance vector database Milvus with Airbyte to build RAG + LLM systems on KDP.

Documentation

• Iceberg quick start
• Install KDP on offline environment

What's Changed

• Fix: update mysql innodb_buffer_pool_size to reasonable range by @harlee-x in #85
• Fix: incorrect default DS url of Grafana by @jason-ltc in #86
• Fix: fix clickhouse parameters and dashboard by @qq157755587 in #91
• Chore: update superset airbyte apps image registry by @xingcan-ltc in #90
• Chore: change the folder path of tutorial images by @xingcan-ltc in #95
• Feat: add a startup probe for StreamPark in case it takes a long time… by @xingcan-ltc in #94
• Fix: Control The mysql mode cannot be changed after installation by @harlee-x in #99
• Fix: airflow db initialization (#98) by @hakeedra in #101
• Chore: format airflow cue def by @xingcan-ltc in #104
• Docs: Add tutorials of KDP installation on main stream Kubernetes management platforms by @jason-ltc in #102
• Fix: handling the issue of context lifecycle being inconsistent with … by @harlee-x in #106
• Feat(airflow): use kubernetes_executor as airflow default executor, use git sync dags and add tutorials by @xingcan-ltc in #113
• Fix(ingress): remove ingress trait parameter ingressClassName, use k8s default class by @xingcan-ltc in #111
• Chore: (deps): Bump docker/login-action from 3.1.0 to 3.2.0 by @dependabot in #114
• Chore: use the open-source Airflow Helm chart and update the web server launch arguments to decrease memory usage by @xingcan-ltc in #116
• Fix: delete nil for architecture list by @harlee-x in #119
• Fix: deal with resource ownerReferences (#121) by @harlee-x in #122
• Fix: Remove context setting when uninstalling the httpfs app (#120) by @xingcan-ltc in #123
• Chore: (deps): Bump goreleaser/goreleaser-action from 5.1.0 to 6.0.0 by @dependabot in #127
• Chore: (deps): Bump golang.org/x/crypto from 0.23.0 to 0.24.0 by @dependabot in #128
• Docs: Visualization Analysis of Taobao Maternal and Infant Shopping Data by @xingcan-ltc in #129
• Chore: (deps): Bump docker/build-push-action from 5.3.0 to 5.4.0 by @dependabot in #133
• Chore: (deps): Bump github.com/spf13/cobra from 1.8.0 to 1.8.1 by @dependabot in #132
• Docs: Add real time increment data analysis docs by @hakeedra in #131
• Chore: (deps): Bump docker/build-push-action from 5.4.0 to 6.1.0 by @dependabot in #136
• Feat: add ttlSecondsAfterFinished for hms job by @qq157755587 in #138
• Chore: (deps): Bump docker/build-push-action from 6.1.0 to 6.2.0 by @dependabot in #144
• Feat: add juicefs s3 gateway app by @xingcan-ltc in #140
• Feat(hue): Add a switch to enable/disable HDFS file browsing by @xingcan-ltc in #141
• Feat: Add Iceberg Support by @qq157755587 in #145
• Feat: Add milvus by @hakeedra in #142
• Fix: update cloudtty ingress object works with different ingress cont… by @harlee-x in #147
• Docs: fix juicefs docs by @xingcan-ltc in #148
• Fix: deal with the web terminal entry is restored to the original state (#150) by @harlee-x in #155
• Docs: fix juicefs doc typo by @xingcan-ltc in #157
• Fix: add policies enable parameter by @harlee-x in #156
• Chore: (deps): Bump golang.org/x/crypto from 0.24.0 to 0.25.0 by @dependabot in #154
• Chore: (deps): Bump docker/setup-qemu-action from 3.0.0 to 3.1.0 by @dependabot in #151
• Chore: (deps): Bump docker/setup-buildx-action from 3.3.0 to 3.4.0 by @dependabot in #152
• Chore: (deps): Bump docker/build-push-action from 6.2.0 to 6.3.0 by @dependabot in #153
• Fix: milvus readme and dependences configuration by @hakeedra in #158
• Fix: user-tutorials doc of real-time incremental data analysis by @hakeedra in #160
• Docs: Add KDP offline install docs by @stdnt-xiao in #135
• Fix: fix metadata of iceberg related images by @qq157755587 in #161
• Fix: deal with job container creating by @harlee-x in #166

New Contributors

• @stdnt-xiao made their first contribution in #135

Full Changelog: v1.1.4...v1.2.0