From a9bade317fdbc41def644eded61dd2ff8c04df69 Mon Sep 17 00:00:00 2001 From: Andreas Motl Date: Sun, 24 Dec 2023 02:58:00 +0100 Subject: [PATCH 1/3] Integrate: Split "Analyze" section into BI vs. ML --- docs/index.md | 23 +++++++++---- docs/integrate/{analyze.md => bi.md} | 51 ++++------------------------ docs/integrate/ml.md | 47 +++++++++++++++++++++++++ 3 files changed, 69 insertions(+), 52 deletions(-) rename docs/integrate/{analyze.md => bi.md} (51%) create mode 100644 docs/integrate/ml.md diff --git a/docs/index.md b/docs/index.md index 87ef54e..e77db6f 100644 --- a/docs/index.md +++ b/docs/index.md @@ -63,7 +63,7 @@ CrateDB integrates well with a diverse set of applications and tools concerned with analytics, visualization, and data wrangling, in the areas of ETL, BI, metrics aggregation and monitoring, and more. -::::{grid} 1 2 2 4 +::::{grid} 1 2 2 3 :margin: 4 4 0 0 :gutter: 1 @@ -84,15 +84,23 @@ Use ETL applications and frameworks for transferring data in and out of CrateDB. ::: -:::{grid-item-card} {material-outlined}`analytics;2em` Analytics -:link: analyze +:::{grid-item-card} {material-outlined}`analytics;2em` Business Intelligence +:link: bi :link-type: ref Analyze information in your CrateDB cluster. ::: -:::{grid-item-card} {material-outlined}`bar_chart;2em` Visualization +:::{grid-item-card} {material-outlined}`analytics;2em` Machine Learning +:link: ml +:link-type: ref + +Apply machine learning to information in your CrateDB cluster. +::: + + +:::{grid-item-card} {material-outlined}`bar_chart;2em` Data Visualization :link: visualize :link-type: ref @@ -129,9 +137,10 @@ Database drivers ```{toctree} :hidden: -Load and export data -Analyze data -Visualize data +Load and Export +Business Intelligence +Machine Learning +Data Visualization ``` ```{toctree} diff --git a/docs/integrate/analyze.md b/docs/integrate/bi.md similarity index 51% rename from docs/integrate/analyze.md rename to docs/integrate/bi.md index 1e8144c..4b332a2 100644 --- a/docs/integrate/analyze.md +++ b/docs/integrate/bi.md @@ -1,12 +1,12 @@ +(bi)= (bi-tools)= -(analyze)= -# Analytics with CrateDB +# Business Analytics and Intelligence with CrateDB -This documentation section enumerates analytics applications and frameworks, -which can be used for analyzing data in CrateDB. +This documentation section lists business analytics applications +and frameworks, which can be used together with CrateDB. -## Business analytics with Microsoft Power BI +## Microsoft Power BI ```{div} :style: "float: right" @@ -34,7 +34,7 @@ possible to publish your dashboards, in order to share them with others. ``` -## Business intelligence with Tableau +## Tableau ```{div} :style: "float: right" @@ -54,51 +54,12 @@ guide you through the process of setting it up correctly with CrateDB. ``` -## Data analysis with pandas and scikit-learn - -```{div} -:style: "float: right" -[![](https://pandas.pydata.org/static/img/pandas.svg){w=180px}](https://pandas.pydata.org/) -
-[![](https://upload.wikimedia.org/wikipedia/commons/thumb/0/05/Scikit_learn_logo_small.svg/240px-Scikit_learn_logo_small.svg.png){w=180px}](https://scikit-learn.org/) -
-[![](https://jupyter.org/assets/logos/rectanglelogo-greytext-orangebody-greymoons.svg){w=180px}](https://jupyter.org/) -``` - - -Using [pandas] and [scikit-learn] to run a regression analysis within a [Jupyter Notebook]. - -- [Machine Learning and CrateDB: An introduction] -- [Machine Learning and CrateDB: Getting Started With Jupyter] -- [Machine Learning and CrateDB: Experiment Design & Linear Regression] - -More resources: - -- [Automating financial data collection and storage in CrateDB with Python and pandas 2.0.0] -- [From data storage to data analysis: Tutorial on CrateDB and pandas] - - -## Machine Learning and CrateDB - -- Using pandas, NumPy, Matplotlib, Merlion, and MLFlow, to analyze timeseries anomalies: - [Running Time Series Models in Production using CrateDB] - - -[Automating financial data collection and storage in CrateDB with Python and pandas 2.0.0]: https://community.crate.io/t/automating-financial-data-collection-and-storage-in-cratedb-with-python-and-pandas-2-0-0/916 [Connecting to CrateDB from Tableau with JDBC]: https://crate.io/blog/connecting-to-cratedb-from-tableau-with-jdbc [CrateDB and Tableau]: https://crate.io/integrations/cratedb-and-tableau [CrateDB and Power BI]: https://crate.io/integrations/cratedb-and-power-bi -[From data storage to data analysis: Tutorial on CrateDB and pandas]: https://community.crate.io/t/from-data-storage-to-data-analysis-tutorial-on-cratedb-and-pandas/1440/1 -[Jupyter Notebook]: https://jupyter.org/ -[Machine Learning and CrateDB: An introduction]: https://crate.io/blog/machine-learning-and-cratedb-part-one -[Machine Learning and CrateDB: Getting Started With Jupyter]: https://crate.io/blog/machine-learning-cratedb-jupyter -[Machine Learning and CrateDB: Experiment Design & Linear Regression]: https://crate.io/blog/machine-learning-and-cratedb-part-three-experiment-design-and-linear-regression -[pandas]: https://pandas.pydata.org/ [PostgreSQL ODBC driver]: https://odbc.postgresql.org/ [Power BI Desktop]: https://powerbi.microsoft.com/en-us/desktop/ [Power BI Service]: https://powerbi.microsoft.com/en-us/ [Power Query PostgreSQL connector]: https://learn.microsoft.com/en-us/power-query/connectors/postgresql -[Running Time Series Models in Production using CrateDB]: https://github.com/crate/ml-sandbox/blob/main/timeseries-blog/timeseries-blog.md -[scikit-learn]: https://scikit-learn.org/ [Tableau]: https://www.tableau.com/ [Using CrateDB with Tableau]: https://community.crate.io/t/using-cratedb-with-tableau/1192 diff --git a/docs/integrate/ml.md b/docs/integrate/ml.md new file mode 100644 index 0000000..da42ba3 --- /dev/null +++ b/docs/integrate/ml.md @@ -0,0 +1,47 @@ +(ml)= +(ml-tools)= +# Machine Learning with CrateDB + +This documentation section lists machine learning applications and frameworks, +which can be used together with CrateDB. + + +## Data analysis with pandas and scikit-learn + +```{div} +:style: "float: right" +[![](https://pandas.pydata.org/static/img/pandas.svg){w=180px}](https://pandas.pydata.org/) +
+[![](https://upload.wikimedia.org/wikipedia/commons/thumb/0/05/Scikit_learn_logo_small.svg/240px-Scikit_learn_logo_small.svg.png){w=180px}](https://scikit-learn.org/) +
+[![](https://jupyter.org/assets/logos/rectanglelogo-greytext-orangebody-greymoons.svg){w=180px}](https://jupyter.org/) +``` + + +Using [pandas] and [scikit-learn] to run a regression analysis within a [Jupyter Notebook]. + +- [Machine Learning and CrateDB: An introduction] +- [Machine Learning and CrateDB: Getting Started With Jupyter] +- [Machine Learning and CrateDB: Experiment Design & Linear Regression] + +More resources: + +- [Automating financial data collection and storage in CrateDB with Python and pandas 2.0.0] +- [From data storage to data analysis: Tutorial on CrateDB and pandas] + + +## Machine Learning and CrateDB + +- Using pandas, NumPy, Matplotlib, Merlion, and MLFlow, to analyze timeseries anomalies: + [Running Time Series Models in Production using CrateDB] + + +[Automating financial data collection and storage in CrateDB with Python and pandas 2.0.0]: https://community.crate.io/t/automating-financial-data-collection-and-storage-in-cratedb-with-python-and-pandas-2-0-0/916 +[From data storage to data analysis: Tutorial on CrateDB and pandas]: https://community.crate.io/t/from-data-storage-to-data-analysis-tutorial-on-cratedb-and-pandas/1440/1 +[Jupyter Notebook]: https://jupyter.org/ +[Machine Learning and CrateDB: An introduction]: https://crate.io/blog/machine-learning-and-cratedb-part-one +[Machine Learning and CrateDB: Getting Started With Jupyter]: https://crate.io/blog/machine-learning-cratedb-jupyter +[Machine Learning and CrateDB: Experiment Design & Linear Regression]: https://crate.io/blog/machine-learning-and-cratedb-part-three-experiment-design-and-linear-regression +[pandas]: https://pandas.pydata.org/ +[Running Time Series Models in Production using CrateDB]: https://github.com/crate/ml-sandbox/blob/main/timeseries-blog/timeseries-blog.md +[scikit-learn]: https://scikit-learn.org/ From dadc842ff8e7c281357ad8053c7c0573eac15fb9 Mon Sep 17 00:00:00 2001 From: Andreas Motl Date: Sun, 24 Dec 2023 03:04:17 +0100 Subject: [PATCH 2/3] Chore: Make link checker ignore https://{powerbi,www}.microsoft.com --- docs/conf.py | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/docs/conf.py b/docs/conf.py index a03252f..b8205d0 100644 --- a/docs/conf.py +++ b/docs/conf.py @@ -9,9 +9,11 @@ # TODO: Refactor into global configuration. linkcheck_ignore = [ - "https://portal.azure.com/", "https://azuremarketplace.microsoft.com/", "https://github.com/crate/ml-sandbox", + "https://portal.azure.com/", + "https://powerbi.microsoft.com", + "https://www.microsoft.com", ] linkcheck_timeout = 5 From e42e143505c994eb5b3c66c95da3ea7b5cc119b7 Mon Sep 17 00:00:00 2001 From: Andreas Motl Date: Sun, 24 Dec 2023 03:16:27 +0100 Subject: [PATCH 3/3] Chore: Fix links to images within "Cluvio" section --- docs/integrate/visualize.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/docs/integrate/visualize.md b/docs/integrate/visualize.md index 93ee10f..8488322 100644 --- a/docs/integrate/visualize.md +++ b/docs/integrate/visualize.md @@ -63,7 +63,7 @@ based on Apache Superset. ```{div} :style: "float: right" -[![](https://www.cluvio.com/images/logos/cluvio/cluvio-logo-full_color-on_dark.svg){w=180px}](https://www.cluvio.com/) +[![cluvio-logo-full_color-on_dark.svg](https://github.com/crate/crate-clients-tools/assets/453543/cac142ef-412a-4a67-a63f-bf9d1ce92c84){w=180px}](https://www.cluvio.com/) ``` [Cluvio] is a programmable and interactive dashboarding platform — your analytics @@ -78,8 +78,8 @@ your entire company in few minutes. - [Data Analysis with Cluvio and CrateDB] -![](https://www.cluvio.com/images/features/custom-filters.png){h=200px} -![](https://www.cluvio.com/images/features/report-creator.png){h=200px} +![custom-filters.png](https://github.com/crate/crate-clients-tools/assets/453543/49ca6a35-239e-4915-951c-db6649fd35a4){h=200px} +![report-creator.png](https://github.com/crate/crate-clients-tools/assets/453543/844a5ffd-0b92-4c77-8cdd-0b5cc5b392b1){h=200px} ## Explo Explore