Apache Superset: Verify connectivity to CrateDB with basic integration tests #217
Conversation
amotl
changed the title
amotl
force-pushed
the
amo/apache-superset
branch
3 times, most recently
from
8aa6650 to
dda20ba
Compare
Add a few basic integration tests having conversations with the Apache Superset UI and HTTP API.
amotl
force-pushed
the
amo/apache-superset
branch
from
dda20ba to
b2a0186
Compare
| @pytest.fixture(scope="session") | ||
| def fix_greenlet(): | ||
| """ | ||
| Install more recent greenlet, because Playwright installs version 3.0.1, which breaks Superset. | ||
| """ | ||
| os.system("pip install --upgrade greenlet") |
There was a problem hiding this comment.
Well. Irgendwas ist immer. May need a report or patch on/for Playwright.
There was a problem hiding this comment.
There is a corresponding patch now.
|
@vvulf: You recently signaled interest in building something with Apache ECharts. On this matter, I'd also recommend to take a look at Apache Superset, because, well, it's a reasonable container application/framework already for exploring data with visualizations based on ECharts. It can be integrated well through its HTTP API, which has been outlined a bit within this patch. @quodt, @SStorm: Playwright hasn't been used much at Crate.io, as far as I know. You also may want to take a look inside this patch, because I think it is the most advanced browser automation tool/interface these days. As with other topics, the devil is in the details of UI testing, but it doesn't take much efforts to quickly whip up a few test cases for UI purposes, thanks to its ergonomic interface and setup procedure, and that it works out of the box on CI/GHA. If you like that, HTML capturing with Imagecast may also resonate with you, as it is also using Playwright under the hood. |
About
This patch includes a few basic test cases having conversations with the Apache Superset UI and HTTP API, using a database connection to CrateDB. It is meant to monitor connectivity works, and doesn't break with future releases of both Apache Superset and CrateDB. By running the integration tests each night, the monitoring will be durable.
Documentation
The README document Verify Apache Superset with CrateDB included here is a mini tutorial which walks you through the steps needed to setup an instance of Apache Superset on your machine, and connect it to CrateDB. If you don't want to clone any repository to get started, effectively all you need are the requirements.txt and superset_config.py files.
Backlog
and Python 3.12to the test matrix on behalf of subsequent patches.latest, andCSRF_TOKENas well as HTTP session is no longer needed.git cloneare omitted. Most probably, a user-focused tutorial should be based on Docker Compose for running both Superset and CrateDB, but also not like the upstream documentation Installing Superset Locally Using Docker Compose is doing it, because it also uses agit cloneinside. This new tutorial should be the primary resource to advertise when educating users about this integration, and it should also outline how to connect to CrateDB Cloud./cc @karynzv, @marijaselakovic, @ckurze