-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
50 changed files
with
2,070 additions
and
90 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,8 @@ | ||
.gitignore | ||
sql/queries | ||
.vscode | ||
.github | ||
README.md | ||
docker-compose.yml | ||
app.sample.env | ||
Dockerfile |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -38,7 +38,7 @@ jobs: | |
- name: Set up Go | ||
uses: actions/setup-go@v4 | ||
with: | ||
go-version: "1.22.0" | ||
go-version: "1.22.2" | ||
|
||
- name: Install golang-migrate | ||
run: go install -tags 'postgres' github.com/golang-migrate/migrate/v4/cmd/[email protected] | ||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1 +1,2 @@ | ||
app.env | ||
app.env | ||
app.docker.env |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,30 @@ | ||
FROM golang:1.22.2-alpine3.19 AS builder | ||
|
||
WORKDIR /app | ||
|
||
RUN apk add curl | ||
RUN curl -L https://github.com/golang-migrate/migrate/releases/download/v4.17.0/migrate.linux-amd64.tar.gz | tar xvz | ||
|
||
# pre-copy/cache go.mod for pre-downloading dependencies and only redownloading them in subsequent builds if they change | ||
COPY go.mod go.sum ./ | ||
RUN go mod download && go mod verify | ||
|
||
COPY . . | ||
RUN go build -v -o . ./... | ||
|
||
FROM alpine:3.19 | ||
|
||
WORKDIR /usr/local/bin | ||
|
||
COPY --from=builder /app/server . | ||
COPY --from=builder /app/migrate . | ||
|
||
COPY app.env . | ||
COPY start.sh . | ||
COPY sql/migrations/ ./sql/migrations/ | ||
|
||
CMD ["server"] | ||
|
||
ENTRYPOINT [ "start.sh" ] | ||
|
||
EXPOSE 8080 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,28 @@ | ||
The MIT License (MIT) | ||
|
||
Original Work | ||
Copyright (c) 2016 Matthias Kadenbach | ||
https://github.com/mattes/migrate | ||
|
||
Modified Work | ||
Copyright (c) 2018 Dale Hui | ||
https://github.com/golang-migrate/migrate | ||
|
||
|
||
Permission is hereby granted, free of charge, to any person obtaining a copy | ||
of this software and associated documentation files (the "Software"), to deal | ||
in the Software without restriction, including without limitation the rights | ||
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell | ||
copies of the Software, and to permit persons to whom the Software is | ||
furnished to do so, subject to the following conditions: | ||
|
||
The above copyright notice and this permission notice shall be included in | ||
all copies or substantial portions of the Software. | ||
|
||
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR | ||
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, | ||
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE | ||
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER | ||
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, | ||
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN | ||
THE SOFTWARE. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,34 +1,196 @@ | ||
# Simple Bank | ||
[![GitHub Workflow Status (branch)](https://img.shields.io/github/actions/workflow/status/golang-migrate/migrate/ci.yaml?branch=master)](https://github.com/golang-migrate/migrate/actions/workflows/ci.yaml?query=branch%3Amaster) | ||
[![GoDoc](https://pkg.go.dev/badge/github.com/golang-migrate/migrate)](https://pkg.go.dev/github.com/golang-migrate/migrate/v4) | ||
[![Coverage Status](https://img.shields.io/coveralls/github/golang-migrate/migrate/master.svg)](https://coveralls.io/github/golang-migrate/migrate?branch=master) | ||
[![packagecloud.io](https://img.shields.io/badge/deb-packagecloud.io-844fec.svg)](https://packagecloud.io/golang-migrate/migrate?filter=debs) | ||
[![Docker Pulls](https://img.shields.io/docker/pulls/migrate/migrate.svg)](https://hub.docker.com/r/migrate/migrate/) | ||
![Supported Go Versions](https://img.shields.io/badge/Go-1.20%2C%201.21-lightgrey.svg) | ||
[![GitHub Release](https://img.shields.io/github/release/golang-migrate/migrate.svg)](https://github.com/golang-migrate/migrate/releases) | ||
[![Go Report Card](https://goreportcard.com/badge/github.com/golang-migrate/migrate/v4)](https://goreportcard.com/report/github.com/golang-migrate/migrate/v4) | ||
|
||
## Prerequisites | ||
# migrate | ||
|
||
__Database migrations written in Go. Use as [CLI](#cli-usage) or import as [library](#use-in-your-go-project).__ | ||
|
||
* Migrate reads migrations from [sources](#migration-sources) | ||
and applies them in correct order to a [database](#databases). | ||
* Drivers are "dumb", migrate glues everything together and makes sure the logic is bulletproof. | ||
(Keeps the drivers lightweight, too.) | ||
* Database drivers don't assume things or try to correct user input. When in doubt, fail. | ||
|
||
Forked from [mattes/migrate](https://github.com/mattes/migrate) | ||
|
||
## Databases | ||
|
||
Database drivers run migrations. [Add a new database?](database/driver.go) | ||
|
||
* [PostgreSQL](database/postgres) | ||
* [PGX v4](database/pgx) | ||
* [PGX v5](database/pgx/v5) | ||
* [Redshift](database/redshift) | ||
* [Ql](database/ql) | ||
* [Cassandra / ScyllaDB](database/cassandra) | ||
* [SQLite](database/sqlite) | ||
* [SQLite3](database/sqlite3) ([todo #165](https://github.com/mattes/migrate/issues/165)) | ||
* [SQLCipher](database/sqlcipher) | ||
* [MySQL / MariaDB](database/mysql) | ||
* [Neo4j](database/neo4j) | ||
* [MongoDB](database/mongodb) | ||
* [CrateDB](database/crate) ([todo #170](https://github.com/mattes/migrate/issues/170)) | ||
* [Shell](database/shell) ([todo #171](https://github.com/mattes/migrate/issues/171)) | ||
* [Google Cloud Spanner](database/spanner) | ||
* [CockroachDB](database/cockroachdb) | ||
* [YugabyteDB](database/yugabytedb) | ||
* [ClickHouse](database/clickhouse) | ||
* [Firebird](database/firebird) | ||
* [MS SQL Server](database/sqlserver) | ||
* [RQLite](database/rqlite) | ||
|
||
### Database URLs | ||
|
||
Database connection strings are specified via URLs. The URL format is driver dependent but generally has the form: `dbdriver://username:password@host:port/dbname?param1=true¶m2=false` | ||
|
||
Any [reserved URL characters](https://en.wikipedia.org/wiki/Percent-encoding#Percent-encoding_reserved_characters) need to be escaped. Note, the `%` character also [needs to be escaped](https://en.wikipedia.org/wiki/Percent-encoding#Percent-encoding_the_percent_character) | ||
|
||
Explicitly, the following characters need to be escaped: | ||
`!`, `#`, `$`, `%`, `&`, `'`, `(`, `)`, `*`, `+`, `,`, `/`, `:`, `;`, `=`, `?`, `@`, `[`, `]` | ||
|
||
It's easiest to always run the URL parts of your DB connection URL (e.g. username, password, etc) through an URL encoder. See the example Python snippets below: | ||
|
||
- Go 1.22.0 | ||
- Docker Desktop | ||
- [golang-migrate](https://github.com/golang-migrate/migrate/tree/master/cmd/migrate) | ||
- sqlc | ||
```bash | ||
go install github.com/sqlc-dev/sqlc/cmd/sqlc@latest | ||
$ python3 -c 'import urllib.parse; print(urllib.parse.quote(input("String to encode: "), ""))' | ||
String to encode: FAKEpassword!#$%&'()*+,/:;=?@[] | ||
FAKEpassword%21%23%24%25%26%27%28%29%2A%2B%2C%2F%3A%3B%3D%3F%40%5B%5D | ||
$ python2 -c 'import urllib; print urllib.quote(raw_input("String to encode: "), "")' | ||
String to encode: FAKEpassword!#$%&'()*+,/:;=?@[] | ||
FAKEpassword%21%23%24%25%26%27%28%29%2A%2B%2C%2F%3A%3B%3D%3F%40%5B%5D | ||
$ | ||
``` | ||
- mockgen | ||
|
||
## Migration Sources | ||
|
||
Source drivers read migrations from local or remote sources. [Add a new source?](source/driver.go) | ||
|
||
* [Filesystem](source/file) - read from filesystem | ||
* [io/fs](source/iofs) - read from a Go [io/fs](https://pkg.go.dev/io/fs#FS) | ||
* [Go-Bindata](source/go_bindata) - read from embedded binary data ([jteeuwen/go-bindata](https://github.com/jteeuwen/go-bindata)) | ||
* [pkger](source/pkger) - read from embedded binary data ([markbates/pkger](https://github.com/markbates/pkger)) | ||
* [GitHub](source/github) - read from remote GitHub repositories | ||
* [GitHub Enterprise](source/github_ee) - read from remote GitHub Enterprise repositories | ||
* [Bitbucket](source/bitbucket) - read from remote Bitbucket repositories | ||
* [Gitlab](source/gitlab) - read from remote Gitlab repositories | ||
* [AWS S3](source/aws_s3) - read from Amazon Web Services S3 | ||
* [Google Cloud Storage](source/google_cloud_storage) - read from Google Cloud Platform Storage | ||
|
||
## CLI usage | ||
|
||
* Simple wrapper around this library. | ||
* Handles ctrl+c (SIGINT) gracefully. | ||
* No config search paths, no config files, no magic ENV var injections. | ||
|
||
__[CLI Documentation](cmd/migrate)__ | ||
|
||
### Basic usage | ||
|
||
```bash | ||
go install go.uber.org/mock/mockgen@latest | ||
$ migrate -source file://path/to/migrations -database postgres://localhost:5432/database up 2 | ||
``` | ||
|
||
## Getting Started | ||
### Docker usage | ||
|
||
- If you don't already have `postgres:16-alpine` docker image; | ||
```bash | ||
# Pull docker image | ||
docker pull postgres:16-alpine | ||
$ docker run -v {{ migration dir }}:/migrations --network host migrate/migrate | ||
-path=/migrations/ -database postgres://localhost:5432/database up 2 | ||
``` | ||
|
||
## Use in your Go project | ||
|
||
# Run postgres docker container | ||
make postgres | ||
* API is stable and frozen for this release (v3 & v4). | ||
* Uses [Go modules](https://golang.org/cmd/go/#hdr-Modules__module_versions__and_more) to manage dependencies. | ||
* To help prevent database corruptions, it supports graceful stops via `GracefulStop chan bool`. | ||
* Bring your own logger. | ||
* Uses `io.Reader` streams internally for low memory overhead. | ||
* Thread-safe and no goroutine leaks. | ||
|
||
# Create database in postgres docker container | ||
make createdb | ||
__[Go Documentation](https://pkg.go.dev/github.com/golang-migrate/migrate/v4)__ | ||
|
||
# Run migration | ||
make migrateup | ||
```go | ||
import ( | ||
"github.com/golang-migrate/migrate/v4" | ||
_ "github.com/golang-migrate/migrate/v4/database/postgres" | ||
_ "github.com/golang-migrate/migrate/v4/source/github" | ||
) | ||
|
||
func main() { | ||
m, err := migrate.New( | ||
"github://mattes:personal-access-token@mattes/migrate_test", | ||
"postgres://localhost:5432/database?sslmode=enable") | ||
m.Steps(2) | ||
} | ||
``` | ||
|
||
For more scripts checkout [`Makefile`](/Makefile) | ||
Want to use an existing database client? | ||
|
||
```go | ||
import ( | ||
"database/sql" | ||
_ "github.com/lib/pq" | ||
"github.com/golang-migrate/migrate/v4" | ||
"github.com/golang-migrate/migrate/v4/database/postgres" | ||
_ "github.com/golang-migrate/migrate/v4/source/file" | ||
) | ||
|
||
func main() { | ||
db, err := sql.Open("postgres", "postgres://localhost:5432/database?sslmode=enable") | ||
driver, err := postgres.WithInstance(db, &postgres.Config{}) | ||
m, err := migrate.NewWithDatabaseInstance( | ||
"file:///migrations", | ||
"postgres", driver) | ||
m.Up() // or m.Step(2) if you want to explicitly set the number of migrations to run | ||
} | ||
``` | ||
|
||
## Getting started | ||
|
||
Go to [getting started](GETTING_STARTED.md) | ||
|
||
## Tutorials | ||
|
||
* [CockroachDB](database/cockroachdb/TUTORIAL.md) | ||
* [PostgreSQL](database/postgres/TUTORIAL.md) | ||
|
||
(more tutorials to come) | ||
|
||
## Migration files | ||
|
||
Each migration has an up and down migration. [Why?](FAQ.md#why-two-separate-files-up-and-down-for-a-migration) | ||
|
||
```bash | ||
1481574547_create_users_table.up.sql | ||
1481574547_create_users_table.down.sql | ||
``` | ||
|
||
[Best practices: How to write migrations.](MIGRATIONS.md) | ||
|
||
## Coming from another db migration tool? | ||
|
||
Check out [migradaptor](https://github.com/musinit/migradaptor/). | ||
*Note: migradaptor is not affliated or supported by this project* | ||
|
||
## Versions | ||
|
||
Version | Supported? | Import | Notes | ||
--------|------------|--------|------ | ||
**master** | :white_check_mark: | `import "github.com/golang-migrate/migrate/v4"` | New features and bug fixes arrive here first | | ||
**v4** | :white_check_mark: | `import "github.com/golang-migrate/migrate/v4"` | Used for stable releases | | ||
**v3** | :x: | `import "github.com/golang-migrate/migrate"` (with package manager) or `import "gopkg.in/golang-migrate/migrate.v3"` (not recommended) | **DO NOT USE** - No longer supported | | ||
|
||
## Development and Contributing | ||
|
||
Yes, please! [`Makefile`](Makefile) is your friend, | ||
read the [development guide](CONTRIBUTING.md). | ||
|
||
Also have a look at the [FAQ](FAQ.md). | ||
|
||
--- | ||
|
||
Looking for alternatives? [https://awesome-go.com/#database](https://awesome-go.com/#database). |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,8 +1,11 @@ | ||
GIN_MODE=debug | ||
|
||
DB_DRIVER=postgres | ||
DB_USER=root | ||
DB_PASSWORD=secret | ||
DB_NAME=simple_bank | ||
DB_PORT=5433 | ||
DB_URL="postgresql://root:secret@localhost:5433/simple_bank?sslmode=disable" | ||
DB_CONTAINER_NAME=postgres16 | ||
SERVER_ADDRESS=:8080 | ||
DB_URL="postgresql://root:secret@localhost:5433/simple_bank?sslmode=disable" | ||
|
||
SERVER_ADDRESS=:8080 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.