Migrating to postgres

[brecke]

Tools and resources

This is mostly a space for jotting down ideas and notes about postgres as we approach 2022

Work packages

Stuff we need to do in the long-term:

• Docker container
• Data modelling
• Migration tool for existing deployments
• New DB layer on Hilary
• New tests on Hilary
• Benchmark and fixes
• Attempt replication and other scaling techniques (sharding, etc. See more here)

JS tools

• Prisma

Links and resources

• PGLoader (inspiration-only, as it does not support Cassandra)
• Building an Oracle to PostgreSQL migrator: Lessons learned

A lot has been written about Oracle to PostgreSQL migration; today, I want to share some of the lessons learned when it comes to actually building a migration tool. Over the years, we’ve tried out many different approaches to creating the perfect tool, and we’ve definitely made some mistakes on the way – mistakes you will not want to repeat. I’ve decided to share some of the insights I personally had on this multi-year journey. I can’t give you a complete account of them in the space of a short article, so what I’ve done here is to highlight the most useful methods you can take advantage of to make migrations more efficient.

• JSON in PostgreSQL: how to use it right