feat: add YDB as a new database engine

[vgvoleg]

SUMMARY

This PR provides YDB database support based on YDB Dialect

BEFORE/AFTER SCREENSHOTS OR ANIMATED GIF

TESTING INSTRUCTIONS

Steps needed to install sqlalchemy dialect described on databases.mdx.

To test it you can start local YDB via docker-compose:

version: "3.3"
services:
  ydb:
    image: ydbplatform/local-ydb:trunk
    restart: always
    ports:
      - 2136:2136
    hostname: localhost
    environment:
      - YDB_USE_IN_MEMORY_PDISKS=true
      - YDB_ENABLE_COLUMN_TABLES=true

sqlalchemy uri will be like

ydb://localhost:2136/local

ADDITIONAL INFORMATION

• Has associated issue:
• Required feature flags:
• Changes UI
• Includes DB Migration (follow approval process in SIP-59)
  • Migration is atomic, supports rollback & is backwards-compatible
  • Confirm DB migration upgrade and downgrade tested
  • Runtime estimates and downtime expectations provided
• Introduces new feature or API
• Removes existing feature or API

[github-actions]

Congrats on making your first PR and thank you for contributing to Superset! 🎉 ❤️

We hope to see you in our Slack community too! Not signed up? Use our Slack App to self-register.

[codecov]

Codecov Report

Attention: Patch coverage is 89.58333% with 5 lines in your changes missing coverage. Please review.

Project coverage is 83.81%. Comparing base (76d897e) to head (ffb2309).
Report is 1135 commits behind head on master.

Files with missing lines	Patch %	Lines
superset/db_engine_specs/ydb.py	89.58%	5 Missing ⚠️

Additional details and impacted files

@@             Coverage Diff             @@
##           master   #31141       +/-   ##
===========================================
+ Coverage   60.48%   83.81%   +23.33%     
===========================================
  Files        1931      537     -1394     
  Lines       76236    38980    -37256     
  Branches     8568        0     -8568     
===========================================
- Hits        46114    32673    -13441     
+ Misses      28017     6307    -21710     
+ Partials     2105        0     -2105     

Flag	Coverage Δ
hive	48.79% <56.25%> (-0.37%)	⬇️
javascript	?
mysql	76.56% <56.25%> (?)
postgres	76.62% <56.25%> (?)
presto	53.29% <56.25%> (-0.52%)	⬇️
python	83.81% <89.58%> (+20.33%)	⬆️
sqlite	76.08% <56.25%> (?)
unit	60.91% <89.58%> (+3.28%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[giftig]

Also the logic in your spec should have some unit tests.

[github-actions]

@giftig No ephemeral environment action detected. Please use '/testenv up' or '/testenv down'. View workflow run.

[giftig]

/testenv up

[github-actions]

@giftig Processing your ephemeral environment request here.

[giftig]

Can you also provide some test instructions for how to verify this is working / describe what you tested, please? I'm assuming it's mostly just install the ydb driver, connect a ydb database, and try running some queries and building some dashboards, but maybe others will catch some edge case testing which may be useful with a new engine spec.

[github-actions]

@giftig Ephemeral environment spinning up at http://18.237.77.159:8080. Credentials are admin/admin. Please allow several minutes for bootstrapping and startup.

[giftig]

Minor comments / questions but looks good to me.

I haven't had chance to try running your branch with YDB though, and we'll probably need to check if there's a process for including that ydb.svg, so we should wait for some more reviews.

[giftig]

This argument seems unnecessary, could just be one line like L100