Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integrate: Split "Analyze" section into BI vs. ML #53

Merged
merged 3 commits into from
Dec 24, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 3 additions & 1 deletion docs/conf.py
Original file line number Diff line number Diff line change
Expand Up @@ -9,9 +9,11 @@

# TODO: Refactor into global configuration.
linkcheck_ignore = [
"https://portal.azure.com/",
"https://azuremarketplace.microsoft.com/",
"https://github.com/crate/ml-sandbox",
"https://portal.azure.com/",
"https://powerbi.microsoft.com",
"https://www.microsoft.com",
]

linkcheck_timeout = 5
23 changes: 16 additions & 7 deletions docs/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -63,7 +63,7 @@ CrateDB integrates well with a diverse set of applications and tools concerned
with analytics, visualization, and data wrangling, in the areas of ETL, BI,
metrics aggregation and monitoring, and more.

::::{grid} 1 2 2 4
::::{grid} 1 2 2 3
:margin: 4 4 0 0
:gutter: 1

Expand All @@ -84,15 +84,23 @@ Use ETL applications and frameworks for transferring data in and out of CrateDB.
:::


:::{grid-item-card} {material-outlined}`analytics;2em` Analytics
:link: analyze
:::{grid-item-card} {material-outlined}`analytics;2em` Business Intelligence
:link: bi
:link-type: ref

Analyze information in your CrateDB cluster.
:::


:::{grid-item-card} {material-outlined}`bar_chart;2em` Visualization
:::{grid-item-card} {material-outlined}`analytics;2em` Machine Learning
:link: ml
:link-type: ref

Apply machine learning to information in your CrateDB cluster.
:::


:::{grid-item-card} {material-outlined}`bar_chart;2em` Data Visualization
:link: visualize
:link-type: ref

Expand Down Expand Up @@ -129,9 +137,10 @@ Database drivers <connect/index>
```{toctree}
:hidden:

Load and export data <integrate/etl>
Analyze data <integrate/analyze>
Visualize data <integrate/visualize>
Load and Export <integrate/etl>
Business Intelligence <integrate/bi>
Machine Learning <integrate/ml>
Data Visualization <integrate/visualize>
```

```{toctree}
Expand Down
51 changes: 6 additions & 45 deletions docs/integrate/analyze.md → docs/integrate/bi.md
Original file line number Diff line number Diff line change
@@ -1,12 +1,12 @@
(bi)=
(bi-tools)=
(analyze)=
# Analytics with CrateDB
# Business Analytics and Intelligence with CrateDB

This documentation section enumerates analytics applications and frameworks,
which can be used for analyzing data in CrateDB.
This documentation section lists business analytics applications
and frameworks, which can be used together with CrateDB.


## Business analytics with Microsoft Power BI
## Microsoft Power BI

```{div}
:style: "float: right"
Expand Down Expand Up @@ -34,7 +34,7 @@ possible to publish your dashboards, in order to share them with others.
```


## Business intelligence with Tableau
## Tableau

```{div}
:style: "float: right"
Expand All @@ -54,51 +54,12 @@ guide you through the process of setting it up correctly with CrateDB.
```


## Data analysis with pandas and scikit-learn

```{div}
:style: "float: right"
[![](https://pandas.pydata.org/static/img/pandas.svg){w=180px}](https://pandas.pydata.org/)
<br>
[![](https://upload.wikimedia.org/wikipedia/commons/thumb/0/05/Scikit_learn_logo_small.svg/240px-Scikit_learn_logo_small.svg.png){w=180px}](https://scikit-learn.org/)
<br>
[![](https://jupyter.org/assets/logos/rectanglelogo-greytext-orangebody-greymoons.svg){w=180px}](https://jupyter.org/)
```


Using [pandas] and [scikit-learn] to run a regression analysis within a [Jupyter Notebook].

- [Machine Learning and CrateDB: An introduction]
- [Machine Learning and CrateDB: Getting Started With Jupyter]
- [Machine Learning and CrateDB: Experiment Design & Linear Regression]

More resources:

- [Automating financial data collection and storage in CrateDB with Python and pandas 2.0.0]
- [From data storage to data analysis: Tutorial on CrateDB and pandas]


## Machine Learning and CrateDB

- Using pandas, NumPy, Matplotlib, Merlion, and MLFlow, to analyze timeseries anomalies:
[Running Time Series Models in Production using CrateDB]


[Automating financial data collection and storage in CrateDB with Python and pandas 2.0.0]: https://community.crate.io/t/automating-financial-data-collection-and-storage-in-cratedb-with-python-and-pandas-2-0-0/916
[Connecting to CrateDB from Tableau with JDBC]: https://crate.io/blog/connecting-to-cratedb-from-tableau-with-jdbc
[CrateDB and Tableau]: https://crate.io/integrations/cratedb-and-tableau
[CrateDB and Power BI]: https://crate.io/integrations/cratedb-and-power-bi
[From data storage to data analysis: Tutorial on CrateDB and pandas]: https://community.crate.io/t/from-data-storage-to-data-analysis-tutorial-on-cratedb-and-pandas/1440/1
[Jupyter Notebook]: https://jupyter.org/
[Machine Learning and CrateDB: An introduction]: https://crate.io/blog/machine-learning-and-cratedb-part-one
[Machine Learning and CrateDB: Getting Started With Jupyter]: https://crate.io/blog/machine-learning-cratedb-jupyter
[Machine Learning and CrateDB: Experiment Design & Linear Regression]: https://crate.io/blog/machine-learning-and-cratedb-part-three-experiment-design-and-linear-regression
[pandas]: https://pandas.pydata.org/
[PostgreSQL ODBC driver]: https://odbc.postgresql.org/
[Power BI Desktop]: https://powerbi.microsoft.com/en-us/desktop/
[Power BI Service]: https://powerbi.microsoft.com/en-us/
[Power Query PostgreSQL connector]: https://learn.microsoft.com/en-us/power-query/connectors/postgresql
[Running Time Series Models in Production using CrateDB]: https://github.com/crate/ml-sandbox/blob/main/timeseries-blog/timeseries-blog.md
[scikit-learn]: https://scikit-learn.org/
[Tableau]: https://www.tableau.com/
[Using CrateDB with Tableau]: https://community.crate.io/t/using-cratedb-with-tableau/1192
47 changes: 47 additions & 0 deletions docs/integrate/ml.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,47 @@
(ml)=
(ml-tools)=
# Machine Learning with CrateDB

This documentation section lists machine learning applications and frameworks,
which can be used together with CrateDB.


## Data analysis with pandas and scikit-learn

```{div}
:style: "float: right"
[![](https://pandas.pydata.org/static/img/pandas.svg){w=180px}](https://pandas.pydata.org/)
<br>
[![](https://upload.wikimedia.org/wikipedia/commons/thumb/0/05/Scikit_learn_logo_small.svg/240px-Scikit_learn_logo_small.svg.png){w=180px}](https://scikit-learn.org/)
<br>
[![](https://jupyter.org/assets/logos/rectanglelogo-greytext-orangebody-greymoons.svg){w=180px}](https://jupyter.org/)
```


Using [pandas] and [scikit-learn] to run a regression analysis within a [Jupyter Notebook].

- [Machine Learning and CrateDB: An introduction]
- [Machine Learning and CrateDB: Getting Started With Jupyter]
- [Machine Learning and CrateDB: Experiment Design & Linear Regression]

More resources:

- [Automating financial data collection and storage in CrateDB with Python and pandas 2.0.0]
- [From data storage to data analysis: Tutorial on CrateDB and pandas]


## Machine Learning and CrateDB

- Using pandas, NumPy, Matplotlib, Merlion, and MLFlow, to analyze timeseries anomalies:
[Running Time Series Models in Production using CrateDB]


[Automating financial data collection and storage in CrateDB with Python and pandas 2.0.0]: https://community.crate.io/t/automating-financial-data-collection-and-storage-in-cratedb-with-python-and-pandas-2-0-0/916
[From data storage to data analysis: Tutorial on CrateDB and pandas]: https://community.crate.io/t/from-data-storage-to-data-analysis-tutorial-on-cratedb-and-pandas/1440/1
[Jupyter Notebook]: https://jupyter.org/
[Machine Learning and CrateDB: An introduction]: https://crate.io/blog/machine-learning-and-cratedb-part-one
[Machine Learning and CrateDB: Getting Started With Jupyter]: https://crate.io/blog/machine-learning-cratedb-jupyter
[Machine Learning and CrateDB: Experiment Design & Linear Regression]: https://crate.io/blog/machine-learning-and-cratedb-part-three-experiment-design-and-linear-regression
[pandas]: https://pandas.pydata.org/
[Running Time Series Models in Production using CrateDB]: https://github.com/crate/ml-sandbox/blob/main/timeseries-blog/timeseries-blog.md
[scikit-learn]: https://scikit-learn.org/
6 changes: 3 additions & 3 deletions docs/integrate/visualize.md
Original file line number Diff line number Diff line change
Expand Up @@ -63,7 +63,7 @@ based on Apache Superset.

```{div}
:style: "float: right"
[![](https://www.cluvio.com/images/logos/cluvio/cluvio-logo-full_color-on_dark.svg){w=180px}](https://www.cluvio.com/)
[![cluvio-logo-full_color-on_dark.svg](https://github.com/crate/crate-clients-tools/assets/453543/cac142ef-412a-4a67-a63f-bf9d1ce92c84){w=180px}](https://www.cluvio.com/)
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am just using GitHub as image host here. It worked well for a while already, so I never looked back.

/cc @matkuliak

```

[Cluvio] is a programmable and interactive dashboarding platform — your analytics
Expand All @@ -78,8 +78,8 @@ your entire company in few minutes.

- [Data Analysis with Cluvio and CrateDB]

![](https://www.cluvio.com/images/features/custom-filters.png){h=200px}
![](https://www.cluvio.com/images/features/report-creator.png){h=200px}
![custom-filters.png](https://github.com/crate/crate-clients-tools/assets/453543/49ca6a35-239e-4915-951c-db6649fd35a4){h=200px}
![report-creator.png](https://github.com/crate/crate-clients-tools/assets/453543/844a5ffd-0b92-4c77-8cdd-0b5cc5b392b1){h=200px}
Comment on lines -81 to +82
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Dito.



## Explo Explore
Expand Down