Skip to content

Database

SnapOtter uses PostgreSQL 17 with Drizzle ORM (pg-core / node-postgres) for data persistence. The schema is defined in apps/api/src/db/schema.ts.

The connection is configured via the DATABASE_URL environment variable (default postgres://snapotter:snapotter@postgres:5432/snapotter). In Docker Compose, the Postgres container stores its data in the SnapOtter-pgdata named volume.

Tables

users

Stores user accounts. Created automatically on first run from DEFAULT_USERNAME and DEFAULT_PASSWORD.

ColumnTypeNotes
iduuidPrimary key
usernamevarcharUnique, required
passwordHashvarcharscrypt hash
rolevarcharadmin, editor, or user
mustChangePasswordbooleanForced password reset flag
createdAttimestampCreation time
updatedAttimestampLast update time

sessions

Active login sessions. Each row ties a session token to a user.

ColumnTypeNotes
idvarcharPrimary key (session token)
userIduuidForeign key to users.id
expiresAttimestampExpiry time
createdAttimestampCreation time

teams

Groups for organizing users. Admins can assign users to teams.

ColumnTypeDescription
iduuidPrimary key
namevarchar (unique, max 50 chars)Team name
createdAttimestampCreation time

api_keys

API keys for programmatic access. The raw key is shown once on creation; only the hash is stored.

ColumnTypeNotes
iduuidPrimary key
userIduuidForeign key to users.id
keyHashvarcharscrypt hash of the key
namevarcharUser-provided label
createdAttimestampCreation time
lastUsedAttimestampUpdated on each authenticated request

Keys are prefixed with si_ followed by 96 hex characters (48 random bytes).

pipelines

Saved tool chains that users create in the UI.

ColumnTypeNotes
iduuidPrimary key
namevarcharPipeline name
descriptionvarcharOptional description
stepsjsonbArray of { toolId, settings } objects
createdAttimestampCreation time

user_files

Persistent file library. A saved edit is inserted as an independent root row by default ("save as new": version 1, parentId null, so the original stays listed), or as a parent-linked version when you overwrite the original (parentId set, version incremented, superseding it). The toolChain column records the tools applied.

ColumnTypeDescription
iduuidPrimary key
userIduuidFK to users (CASCADE DELETE)
originalNamevarcharOriginal upload filename
storedNamevarcharFilename on disk
mimeTypevarcharMIME type
sizeintegerFile size in bytes
widthintegerImage width in px
heightintegerImage height in px
versionintegerVersion number (1 = original)
parentIduuid or nullFK to user_files (parent version)
toolChainjsonbTool IDs applied in order to produce this version
createdAttimestampCreation time

jobs

Tracks processing jobs for progress reporting and cleanup.

ColumnTypeNotes
iduuidPrimary key
typevarcharTool or pipeline identifier
statusvarcharqueued, processing, completed, or failed
progressreal0.0-1.0 fraction
inputFilesjsonbArray of input file paths
outputPathvarcharPath to the result file
settingsjsonbTool settings used
errorvarcharError message if failed
createdAttimestampCreation time
completedAttimestampCompletion time

settings

Key-value store for server-wide settings that admins can change from the UI.

ColumnTypeNotes
keyvarcharPrimary key
valuevarcharSetting value
updatedAttimestampLast update time

roles

Custom roles with granular permissions.

ColumnTypeNotes
iduuidPrimary key
namevarcharUnique role name
descriptionvarcharOptional description
permissionsjsonbArray of permission strings
createdAttimestampCreation time

audit_log

Security-relevant action log.

ColumnTypeNotes
iduuidPrimary key
userIduuidFK to users
actionvarcharAction type
detailsjsonbAction-specific data
createdAttimestampAction time

user_preferences

Per-user UI state, keyed by preference name. Backs the dashboard's pinned tools through PUT /api/v1/preferences.

ColumnTypeNotes
userIdtextFK to users, cascades on delete. Primary key with key
keytextPreference name. Primary key with userId
valuejsonbPreference payload
updatedAttimestampLast write

Migrations

Drizzle handles schema migrations. Migration files live in apps/api/drizzle/. During development:

bash
cd apps/api
npx drizzle-kit generate   # generate a migration from schema changes
npx drizzle-kit migrate    # apply pending migrations

In production, pending migrations are applied automatically on startup.

Backup and restore

The relational database lives in the Postgres container's SnapOtter-pgdata volume, not the app's /data volume.

Logical backup with validation (recommended)

bash
# Dump into PostgreSQL's portable custom archive format
docker exec SnapOtter-postgres \
  pg_dump --format=custom --no-owner -U snapotter snapotter > snapotter.dump
test -s snapotter.dump
docker exec -i SnapOtter-postgres pg_restore --list < snapotter.dump >/dev/null

# Restore into a fresh/disposable target first and fail on the first SQL error
docker exec -i SnapOtter-postgres \
  pg_restore --exit-on-error --clean --if-exists --no-owner \
  -U snapotter -d snapotter < snapotter.dump

This database dump does not contain saved library objects in /data/files or durable BullMQ state in Redis. Back up and restore those with the coordinated procedure in Security & Hardening.

Cold volume snapshot

bash
# Stop every service first, then use your storage platform to snapshot the
# PostgreSQL, app-data, and Redis volumes as one crash-consistent set.
docker compose -f docker/docker-compose.yml stop

Do not copy a live PostgreSQL data directory with tar. Compose prefixes volume names by project, so resolve the mounted volume IDs from docker inspect or your storage platform rather than assuming the literal label SnapOtter-pgdata.

Migrating from 1.x (SQLite)

Upgrading from SnapOtter 1.x has its own guide: see Upgrading from 1.x to 2.0. In short, reuse your existing /data volume and 2.0 auto-detects and imports /data/snapotter.db on first boot (or set SQLITE_MIGRATE_PATH to point at it explicitly). Back up the whole /data volume first, not just snapotter.db: 1.x uses SQLite WAL mode, so a stopped container often leaves most of its data in snapotter.db-wal beside an almost-empty snapotter.db.