Skip to content

Commit

Permalink
[docs](tutorials) Update arch pictures of Lakehouse and sidebar of tu…
Browse files Browse the repository at this point in the history
…torials (#997)
  • Loading branch information
KassieZ authored Aug 14, 2024
1 parent f77d02e commit a4f4de5
Show file tree
Hide file tree
Showing 28 changed files with 98 additions and 1,894 deletions.
8 changes: 4 additions & 4 deletions common_docs_zh/gettingStarted/demo-block/page-hero-1.tsx
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
import React,{useState,useEffect} from 'react';
import React, { useState, useEffect } from 'react';
import './demo-block.css';
export default function PageHero() {
const [currentVersion, setCurrentVersion] = useState('')
Expand All @@ -22,16 +22,16 @@ export default function PageHero() {
</div>
</div> */}
<div className="home-page-hero-right">
<a className="latest-button-CN" href={`/zh-CN/docs${currentVersion === '' ? '' : `/${currentVersion}`}/practical-guide/log-storage-analysis`}>
<div className="home-page-hero-button-label"><div>实践教程</div></div>
<a className="latest-button-CN" href={`/zh-CN/docs${currentVersion === '' ? '' : `/${currentVersion}`}/gettingStarted/tutorials/log-storage-analysis`}>
<div className="home-page-hero-button-label"><div>使用教程</div></div>
<div className="latest-button-title">
{/* <div className="home-page-hero-button-icon">
<svg width="24px" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg">
<path className="icon-svg" d="M18.19 11.13l-6.02 8.68c-.13.17-.4.08-.4-.13v-5.73c0-.43-.35-.77-.77-.77H5.97c-.18 0-.28-.2-.18-.35l6.01-8.69c.12-.18.39-.09.39.12V9.98c0 .42.34.76.76.76h5.02c.17 0 .27.19.17.34Zm1.26.87c.8-1.17-.03-2.76-1.45-2.76h-5.03l.76.76V4.277c0-1.73-2.22-2.42-3.2-1.01l-6.02 8.68c-.81 1.16.02 2.75 1.44 2.75h5.02l-.77-.77v5.72c0 1.72 2.21 2.41 3.19 1l6.01-8.69Z"></path>
<path fill="none" d="M0 0h24v24H0Z"></path>
</svg>
</div> */}
<div style={{ marginBottom: 10 }}>日志存储与分析</div>
<div style={{ marginBottom: 10 }}>构建日志存储与分析平台</div>
</div>
<div style={{ fontSize: 12, marginBottom: 20 }}>如何基于 Apache Doris 构建开放、高性能低成本、统一的日志存储分析平台。</div>
</a>
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
{
"title": "使用 Doris 和 Hudi 构建 Lakehouse",
"title": "使用 Doris 和 Hudi",
"language": "zh-CN"
}

Expand Down Expand Up @@ -33,7 +33,7 @@ under the License.
- 自 1.2 版本起,Apache Doris 正式引入 Multi-Catalog 功能,实现了多种数据源的自动元数据映射和数据访问、并对外部数据读取和查询执行等方面做了诸多性能优化,完全具备了构建极速易用 Lakehouse 架构的能力。
- 在 2.1 版本中,Apache Doris 湖仓一体架构得到全面加强,不仅增强了主流数据湖格式(Hudi、Iceberg、Paimon 等)的读取和写入能力,还引入了多 SQL 方言兼容、可从原有系统无缝切换至 Apache Doris。在数据科学及大规模数据读取场景上,Doris 集成了 Arrow Flight 高速读取接口,使得数据传输效率实现 100 倍的提升。

![](/images/quick-start/lakehouse-arch.PNG)
![使用 Doris 和 Hudi 构建 Lakehouse](/images/lakehouse-architecture-for-doris-and-hudi.png)

## Apache Doris & Hudi

Expand All @@ -55,7 +55,7 @@ Apache Doris 同样对 Apache Hudi 数据表的读取能力进行了增强:

本文将在 Docker 环境下,为读者介绍如何快速搭建 Apache Doris + Apache Hudi 的测试及演示环境,并对各功能操作进行演示,帮助读者快速入门。

关于更多说明,请参阅 [Hudi Catalog](../../lakehouse/datalake-analytics/hudi.md)
关于更多说明,请参阅 [Hudi Catalog](../../lakehouse/datalake-analytics/hudi)

## 使用指南

Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
{
"title": "使用 Doris 和 Iceberg 构建 Lakehouse",
"title": "使用 Doris 和 Iceberg",
"language": "zh-CN"
}

Expand Down Expand Up @@ -33,7 +33,7 @@ under the License.
- 自 1.2 版本起,Apache Doris 正式引入 Multi-Catalog 功能,实现了多种数据源的自动元数据映射和数据访问、并对外部数据读取和查询执行等方面做了诸多性能优化,完全具备了构建极速易用 Lakehouse 架构的能力。
- 在 2.1 版本中,Apache Doris 湖仓一体架构得到全面加强,不仅增强了主流数据湖格式(Hudi、Iceberg、Paimon 等)的读取和写入能力,还引入了多 SQL 方言兼容、可从原有系统无缝切换至 Apache Doris。在数据科学及大规模数据读取场景上,Doris 集成了 Arrow Flight 高速读取接口,使得数据传输效率实现 100 倍的提升。

![](/images/quick-start/lakehouse-iceberg-arch.jpeg)
![使用 Doris 和 Iceberg 构建 Lakehouse](/images/lakehouse-architecture-for-doris-and-iceberg.png)

## Apache Doris & Iceberg

Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
{
"title": "使用 Doris 和 Paimon 构建 Lakehouse",
"title": "使用 Doris 和 Paimon",
"language": "zh-CN"
}

Expand Down Expand Up @@ -33,7 +33,7 @@ under the License.
- 自 1.2 版本起,Apache Doris 正式引入 Multi-Catalog 功能,实现了多种数据源的自动元数据映射和数据访问、并对外部数据读取和查询执行等方面做了诸多性能优化,完全具备了构建极速易用 Lakehouse 架构的能力。
- 在 2.1 版本中,Apache Doris 湖仓一体架构得到全面加强,不仅增强了主流数据湖格式(Hudi、Iceberg、Paimon 等)的读取和写入能力,还引入了多 SQL 方言兼容、可从原有系统无缝切换至 Apache Doris。在数据科学及大规模数据读取场景上,Doris 集成了 Arrow Flight 高速读取接口,使得数据传输效率实现 100 倍的提升。

![](/images/quick-start/lakehouse-paimon-arch.jpeg)
![使用 Doris 和 Paimon 构建 Lakehouse](/images/lakehouse-architecture-for-doris-and-paimon.png)

## Apache Doris & Paimon

Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
{
"title": "日志存储与分析",
"title": "构建日志存储与分析平台",
"language": "zh-CN"
}
---
Expand Down
8 changes: 4 additions & 4 deletions gettingStarted/demo-block/page-hero-1.tsx
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
import React,{useState,useEffect} from 'react';
import React, { useState, useEffect } from 'react';
import './demo-block.css';
export default function PageHero1() {
const [currentVersion, setCurrentVersion] = useState('')
Expand All @@ -22,16 +22,16 @@ export default function PageHero1() {
</div>
</div> */}
<div className="home-page-hero-right">
<a className="latest-button" href={`/docs${currentVersion === '' ? '' : `/${currentVersion}`}/practical-guide/log-storage-analysis`}>
<div className="home-page-hero-button-label"><div>Use Case</div></div>
<a className="latest-button" href={`/docs${currentVersion === '' ? '' : `/${currentVersion}`}/gettingStarted/tutorials/log-storage-analysis`}>
<div className="home-page-hero-button-label"><div>Tutorials</div></div>
<div className="latest-button-title">
{/* <div className="home-page-hero-button-icon">
<svg width="24px" viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg">
<path className="icon-svg" d="M18.19 11.13l-6.02 8.68c-.13.17-.4.08-.4-.13v-5.73c0-.43-.35-.77-.77-.77H5.97c-.18 0-.28-.2-.18-.35l6.01-8.69c.12-.18.39-.09.39.12V9.98c0 .42.34.76.76.76h5.02c.17 0 .27.19.17.34Zm1.26.87c.8-1.17-.03-2.76-1.45-2.76h-5.03l.76.76V4.277c0-1.73-2.22-2.42-3.2-1.01l-6.02 8.68c-.81 1.16.02 2.75 1.44 2.75h5.02l-.77-.77v5.72c0 1.72 2.21 2.41 3.19 1l6.01-8.69Z"></path>
<path fill="none" d="M0 0h24v24H0Z"></path>
</svg>
</div> */}
<div style={{ marginBottom: 10 }}>Log Storage and analysis</div>
<div style={{ marginBottom: 10 }}>Building log analysis platform</div>
</div>
<div style={{ fontSize: 12, marginBottom: 20 }}>To build an open, high-performance, cost-effective and unified log storage and analysis platform.</div>
</a>
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
{
"title": "Building lakehouse using Doris and Hudi",
"title": "Using Doris and Hudi",
"language": "en"
}

Expand Down Expand Up @@ -33,7 +33,7 @@ In recent versions, Apache Doris has deepened its integration with data lakes an
- Starting from version 1.2, Apache Doris officially introduced the Multi-Catalog feature, enabling automatic metadata mapping and data access for various data sources, along with numerous performance optimizations for external data reading and query execution. It now fully possesses the ability to build a high-speed and user-friendly Lakehouse architecture.
- In version 2.1, Apache Doris' Data Lakehouse architecture was significantly enhanced, improving the reading and writing capabilities of mainstream data lake formats (Hudi, Iceberg, Paimon, etc.), introducing compatibility with multiple SQL dialects, and seamless migration from existing systems to Apache Doris. For data science and large-scale data reading scenarios, Doris integrated the Arrow Flight high-speed reading interface, achieving a 100-fold increase in data transfer efficiency.

![](/images/quick-start/lakehouse-arch.PNG)
![Building lakehouse using doris and huid](/images/lakehouse-architecture-for-doris-and-hudi.png)

## Apache Doris & Hudi

Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
{
"title": "Building lakehouse using Doris and Iceberg",
"title": "Using Doris and Iceberg",
"language": "en"
}

Expand Down Expand Up @@ -31,7 +31,7 @@ In recent versions, Apache Doris has deepened its integration with data lakes an
- Starting from version 1.2, Apache Doris officially introduced the Multi-Catalog feature, enabling automatic metadata mapping and data access for various data sources, along with numerous performance optimizations for external data reading and query execution. It now fully supports building a high-speed and user-friendly Lakehouse architecture.
- In version 2.1, Apache Doris further strengthened its Data Lakehouse architecture, enhancing the reading and writing capabilities of mainstream data lake formats (Hudi, Iceberg, Paimon, etc.), introducing compatibility with multiple SQL dialects, and seamless migration from existing systems to Apache Doris. For data science and large-scale data reading scenarios, Doris integrated the Arrow Flight high-speed reading interface, achieving a 100x improvement in data transfer efficiency.

![](/images/quick-start/lakehouse-iceberg-arch.jpeg)
![Building Lakehouse using Doris and Iceberg](/images/lakehouse-architecture-for-doris-and-iceberg.png)

## Apache Doris & Iceberg

Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
{
"title": "Building lakehouse using Doris and Paimon",
"title": "Using Doris and Paimon",
"language": "en"
}

Expand Down Expand Up @@ -33,7 +33,7 @@ In recent versions, Apache Doris has deepened its integration with data lakes an
- Starting from version 1.2, Apache Doris officially introduced the Multi-Catalog feature, achieving automatic metadata mapping and data access for various data sources, along with many performance optimizations for external data reading and query execution. It now fully possesses the ability to build a high-speed and user-friendly Lakehouse architecture.
- In version 2.1, Apache Doris' Data Lakehouse architecture was significantly enhanced, strengthening the reading and writing capabilities of mainstream data lake formats (Hudi, Iceberg, Paimon, etc.), introducing compatibility with multiple SQL dialects, and seamless migration from existing systems to Apache Doris. For data science and large-scale data reading scenarios, Doris integrated the Arrow Flight high-speed reading interface, achieving a 100-fold improvement in data transfer efficiency.

![](/images/quick-start/lakehouse-paimon-arch.jpeg)
![Building lakehouse using Doris and Paimon](/images/lakehouse-architecture-for-doris-and-paimon.png)

## Apache Doris & Paimon

Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
{
"title": "Log Storage and Analysis",
"title": "Building log analysis platform",
"language": "en"
}
---
Expand Down
8 changes: 4 additions & 4 deletions i18n/zh-CN/docusaurus-plugin-content-docs/current.json
Original file line number Diff line number Diff line change
Expand Up @@ -419,16 +419,16 @@
"message": "存算分离",
"description": "Compute-Storage Decoupled"
},
"sidebar.docs.category.Use Case": {
"message": "实践教程",
"description": "The label for category Practical Guide in sidebar docs"
},
"sidebar.ecosystem.category.BI and Database IDE": {
"message": "BI 与数据库 IDE",
"description": "The label for category BI and Database IDE in sidebar docs"
},
"sidebar.get-starting.category.Tutorials": {
"message": "使用教程",
"description": "The label for category BI and Database IDE in sidebar docs"
},
"sidebar.get-starting.category.Building lakehouse": {
"message": "构建 Lakehouse",
"description": "The label for category BI and Database IDE in sidebar docs"
}
}
4 changes: 4 additions & 0 deletions i18n/zh-CN/docusaurus-plugin-content-docs/version-1.2.json
Original file line number Diff line number Diff line change
Expand Up @@ -322,5 +322,9 @@
"sidebar.get-starting.category.Tutorials": {
"message": "使用教程",
"description": "The label for category BI and Database IDE in sidebar docs"
},
"sidebar.get-starting.category.Building lakehouse": {
"message": "构建 Lakehouse",
"description": "The label for category BI and Database IDE in sidebar docs"
}
}
4 changes: 4 additions & 0 deletions i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0.json
Original file line number Diff line number Diff line change
Expand Up @@ -378,5 +378,9 @@
"sidebar.get-starting.category.Tutorials": {
"message": "使用教程",
"description": "The label for category BI and Database IDE in sidebar docs"
},
"sidebar.get-starting.category.Building lakehouse": {
"message": "构建 Lakehouse",
"description": "The label for category BI and Database IDE in sidebar docs"
}
}
Loading

0 comments on commit a4f4de5

Please sign in to comment.