mirror of
https://github.com/J3vb/OwnCord.git
synced 2026-09-03 03:50:00 +03:00
* chore(format): one Prettier config at the repository root Every formatting rule in this repository lived under Client/ and covered exactly two globs: Client/src/**/*.ts and Client/tests/**/*.ts. Root Markdown, all of docs/, every YAML and JSON, all CSS, the root scripts and tools/mcp-introspect were formatted by nothing. There was no .editorconfig. The obvious fix -- a second Prettier config at the root for "everything else" -- gives two configs and two ignore files that can silently disagree about the same file. So the root takes ownership instead: config, ignore file and gate move up, and Client/ folds in. Client's inline "prettier" block, its .prettierignore, its format/format:check scripts and its now-unused prettier devDependency are all deleted; knip would have failed client-check on that last one. The .prettierrc.json values are lifted byte-for-byte from Client/package.json, which is what keeps the reformat commit free of client TypeScript churn: 87 tracked files need reformatting and not one of them is under Client/src or Client/tests. .prettierignore carries only what .gitignore does not. Prettier 3 reads the root .gitignore by default, so node_modules/, dist/, coverage/, Client/src/generated/ and docs/security-findings/ need no entry. It does NOT read nested .gitignore files, which is why .remember/ is listed explicitly -- 38 untracked per-machine scratch files were otherwise able to turn a shared gate red. graphify-out/ is listed because its seven files are tracked and .graphify_labels.json is signed byte-for-byte by its .sig, so formatting it would silently invalidate the signature. check:hygiene is registered in scripts/run.mjs and folded into check and release:preflight. It deliberately contains no `gofmt -l` step: gofmt -l prints offenders and still exits 0, so it cannot fail a build. Go formatting is enforced separately. shellcheck and actionlint take their file lists from `git ls-files`, never a filesystem glob -- .claude/worktrees/ holds a gitignored pre-flatten copy of the tree with three .sh files a glob would happily lint. This commit leaves the tree non-conformant on purpose. The reformat is the next commit, so the 87-file diff is reviewable separately from the rule that caused it. Not included: editorconfig-checker. .editorconfig is the editor baseline the audit asked for; Prettier, gofmt and rustfmt already fail CI on the same indentation and newline rules, so a fourth tool checking them again is a gate with no failure mode of its own. Verified: `npx prettier --check .` names 87 tracked files and zero untracked ones; the same command listed 38 .remember/ scratch files before the ignore entry and none after. `node scripts/run.mjs --list` resolves check:hygiene to 8 shell targets and 4 workflow targets. Both package.json files parse. Refs RL-19 / L-13, S-05. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com> * chore(format): reformat the tree to the repository Prettier rules Mechanical. This commit is `npx prettier --write .` and nothing else -- the rule that caused it landed in the previous commit so this diff can be reviewed as a transformation rather than as 84 files of hunks. 84 tracked files: 54 Markdown, 7 .mjs, 7 JSON, 6 YAML, 4 .js, 3 CSS, 2 TypeScript (the two Playwright configs at Client's root, which the old Client/src + Client/tests globs never covered). No file under Client/src or Client/tests moves, because .prettierrc.json carries Client's former inline values byte-for-byte. Prettier rewrote 87 files, not 84. The three in .github/ISSUE_TEMPLATE/ had CRLF on disk and differ only in line endings, which .gitattributes (`* text=auto eol=lf`) already normalises, so their committed blobs are unchanged. Worth knowing before someone reconciles the two numbers. The largest single diff is .superpowers/findings-ledger.json at 7976 lines rewritten. That is safe to format: nothing writes the ledger programmatically -- render-ledger.mjs reads it and writes only FINDINGS.md -- so no tool will fight Prettier over its style on the next hunt. FINDINGS.md itself is ignored as generated. Verified: `npx prettier --check .` reports "All matched files use Prettier code style", so the pass is both complete and idempotent. All 7 reformatted JSON files were parsed before and after and compared as values: semantically identical, zero content changes. `node .superpowers/render-ledger.mjs --check` still reports 348 valid findings and leaves FINDINGS.md untouched. `node scripts/check-doc-counts.mjs` still passes its selftest and still agrees on 27 claims across 9 watched documents -- table realignment did not break the patterns it matches on. `node scripts/run.mjs --list` still parses. Refs RL-19 / L-13, S-05. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com> * chore(lint): enforce Go formatting in the Server linter S-05: repository-wide Go formatting was not a required gate. The only gofmt enforcement anywhere was .githooks/pre-commit, which is opt-in per clone (`npm run hooks:install`), only sees staged files, and warns-and-skips when gofmt is off PATH. The obvious fix -- a `gofmt -l` step in CI -- does not work: `gofmt -l` prints its offenders and still exits 0, so the step passes no matter what it finds. scripts/run.mjs has the same problem, which is why check:hygiene has no Go step either. So gofmt goes where it can actually fail something: Server/.golangci.yml. The file was already `version: "2"` but had no `formatters:` block at all, so the 19 enabled linters ran with zero formatters. In v2 gofmt/gofumpt/goimports moved out of `linters.enable` into their own section with its own exclusions. Adding it there means the gate reports through the Lint step of "Server Build & Test", which is already pinned as required on dev -- no new job and no new pin. Every tracked .go file is under Server/ (551 of them, one go.mod), so Server-scoped is repository-wide here. One file was genuinely misformatted: a one-space struct field alignment in Server/admin/handlers_users_broadcast_test.go, fixed in the same commit because a single line does not need its own reformat commit. Trap worth recording: `gofmt -l .` on a Windows working tree lists every file that has CRLF on disk, because gofmt normalises line endings. That reported 18 offenders here, 17 of them ghosts. The blobs are all LF -- .gitattributes forces `eol=lf` -- so CI never saw them, and the honest test is to run gofmt over `git show HEAD:<file>` rather than the working copy. Doing that across all 551 tracked Go files found exactly the one real offender above. Verified both directions with golangci-lint v2 locally: `golangci-lint run ./...` reports 0 issues on the formatted tree; appending a misformatted function to Server/auth/constants.go produces 2 gofmt findings; appending the same misformatted function to Server/db/dbgen/admin.sql.go produces 0, so the exclusion holds. Both files restored and verified clean afterwards. Refs RL-19 / L-13, S-05. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com> * fix(scripts): escape the NUL separator instead of embedding one The `tracked()` helper added earlier in this branch splits `git ls-files -z` output on NUL. The separator was written as a literal NUL byte rather than the two-character JavaScript escape, so scripts/run.mjs became a binary file: `git diff` refused to show it, `grep` reported "Binary file matches" instead of the line, and `* text=auto` in .gitattributes stops normalising line endings for a blob it detects as binary. The code worked -- splitting on a raw NUL and splitting on "\0" are the same operation -- which is exactly why this is worth fixing before it is inherited. A source file that tooling classifies as binary is a file nobody can review. Verified: zero NUL bytes remain, `grep -n "split("` now prints line 50 instead of "Binary file matches", `node scripts/run.mjs --list` still resolves the same 8 shell and 4 workflow targets, and prettier still reports the file clean. * chore(lint): enforce Rust formatting Rust had no formatting gate of any kind: no rustfmt.toml, no `cargo fmt` anywhere in CI, in scripts/run.mjs, in the Makefile or in the git hooks. Clippy was the only Rust gate, and clippy does not check layout. `cargo fmt --all -- --check` now runs in the rust-tests job, ahead of clippy: a formatting failure is cheap to produce and cheap to fix, and there is no reason to spend a clippy pass to surface one. The stable toolchain in that job requested `components: clippy` only, so rustfmt is added there. Only that job. ci.yml has a second, byte-identical `Install Rust` block in tauri-build; it stays clippy-only, because a full desktop build is the wrong place to discover a misplaced brace. No rustfmt.toml. The default profile is the point of a baseline -- a config file here would be a second opinion about style with nothing to say. Client/src-tauri is a single `[package]`, not a workspace, so `--all` is a safeguard against a future member rather than a fan-out today. Verified: `node scripts/run.mjs --list` resolves check:rust to three steps with `cargo fmt --all -- --check` first, `npm run format` now also runs `cargo fmt --all`, and prettier reports ci.yml, run.mjs and the ci-check skill clean. `cargo fmt --all -- --check` currently fails on 13 files -- that is the reformat, and it is the next commit. Refs RL-19 / L-13. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com> * chore(format): reformat the Rust crate to rustfmt defaults Mechanical. This commit is `cargo fmt --all` and nothing else; the gate that demands it landed in the previous commit so this diff is reviewable on its own. 13 of the 17 tracked .rs files, +343/-164. The crate had never been formatted, so the changes are the usual first-run set: aligned trailing comments collapsed to single spaces, single-element slice literals folded onto one line, long method chains broken across lines, closure bodies expanded into blocks. Verified: `cargo fmt --all -- --check` is clean, so the pass is complete and idempotent. `cargo clippy --all-targets -- -D warnings` finishes with no warnings, and `cargo test --lib` reports 115 passed / 0 failed -- identical to before the reformat, which is what "mechanical" has to mean for a commit that touches this much of the crate. Refs RL-19 / L-13. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com> * fix(scripts): make the root facade actually run on Windows Adding the first gate that a contributor would run from the repository root exposed two bugs in the facade, both of which made it silently wrong on the platform this project is developed on. 1. Every npm and npx step failed. bin() appends `.cmd` on Windows, but Node refuses to spawn a .cmd or .bat with shell:false -- the CVE-2024-27980 mitigation -- and fails with EINVAL and a *null* exit status. run.mjs only special-cased ENOENT, so the result was `FAILED: npx prettier --check . exited null` with nothing to explain it. check:client has three npm steps and has never been able to run here. Fixed by spawning only the npm shims through a shell. They are concatenated into a single command string rather than passed as an args array, because shell:true plus a separate array is deprecated (DEP0190) and prints a warning on every invocation; no argument in this file contains a space. 2. Every optional() step was skipped, always. onPath() shelled out to `where` on Windows, but where.exe lives in C:\WINDOWS\System32, which a Git Bash PATH does not necessarily contain -- on this machine PATH carries System32\Wbem, System32\WindowsPowerShell\v1.0 and System32\OpenSSH but not System32 itself. The probe could not start, `probe.status === 0` was false, and golangci-lint and sqlc reported as "not installed" while installed. Fixed by resolving against PATH and PATHEXT directly. No subprocess, and no dependency on which directories happen to be on PATH. A spawn error other than ENOENT now reports its code instead of surfacing as a null exit status. Verified: before, `node scripts/run.mjs check:hygiene` died with "exited null" and both optional steps printed SKIP with the tools present on PATH. After, the same command runs prettier, shellcheck and actionlint and prints "check:hygiene: passed", with no deprecation warning. `golangci-lint` is detected by the new onPath where the old one missed it. Refs RL-20 / L-14. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com> * chore(format): ignore build output that nested gitignores hide Prettier honours the root .gitignore and no other. Every build and scratch directory in this repository is ignored by a *nested* one -- Client/.gitignore, .serena/.gitignore, .superpowers/sdd/.gitignore -- so none of them were excluded from the new repository-wide gate. The effect is not subtle. Running `cargo test` once drops roughly 850 formattable files into Client/src-tauri/target/, and the hygiene gate goes from clean to "Code style issues found in 939 files". CI never sees it, because a fresh checkout has no build output; every contributor sees it on their second command. Mirrors the three nested files rather than inventing a list: dist, coverage, playwright-report, test-results, .vite, src-tauri/target and src-tauri/gen from Client/.gitignore, plus .serena/ and .superpowers/sdd/. node_modules needs no entry -- Prettier ignores it by default. Verified: `npx prettier --check .` reports "All matched files use Prettier code style" with a fully populated Client/src-tauri/target/ present on disk, and still names README.md when a misformatted table is appended to it. Refs RL-19 / L-13. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com> * chore(ci): shellcheck, actionlint, and a repository hygiene job The last two gates RL-19 asks for. Neither existed: the shell scripts were never linted, the workflows were never syntax-checked, and .githooks/pre-commit carried hand-written `# shellcheck disable=` directives that nothing had ever read. New `hygiene` job, ubuntu-only and root-scoped, modelled on docs-consistency for the same reason: every gate in it is platform-independent text analysis, and .gitattributes pins eol=lf so a second OS would only re-prove line endings. It runs `npm run check:hygiene` -- the same entry point a contributor runs, not a parallel copy of the commands. shellcheck ships in the runner image. actionlint does not, so it is pinned by version and verified by sha256: an installer script piped from a branch would be the one unverified download in a workflow file that pins every action by commit SHA. Prettier's step moves here from client-check, where it no longer belongs. Both linters found real defects. shellcheck, 3 findings in 8 scripts. Two are SC1125 errors in .githooks/pre-commit: `# shellcheck disable=SC2086 - repo paths contain no spaces` is not a valid directive. Trailing prose makes shellcheck discard the rest of the line, so neither suppression was ever in effect -- and one of the two was written earlier in this same branch, which is a fair demonstration of why the gate is worth having. The prose moves to its own line above. The third is SC2015 in start-server.sh, rewritten as an explicit if. actionlint, 5 findings, all inside `run:` blocks it shellchecks once shellcheck is on PATH. Three SC2015 in load-baseline.yml, rewritten as explicit ifs. Two SC2035 in release.yml, where `sha256sum *` should not become `sha256sum ./*`: the comment four lines above records that ParseChecksumFile exact-matches the last field, so a "./" prefix would strand every deployed server exactly as a "windows/" prefix would. `sha256sum -- *` satisfies the linter and leaves the output bytes identical. Verified all three gates in both directions with shellcheck 0.10.0 and actionlint 1.7.7 on PATH. Passing: `node scripts/run.mjs check:hygiene` prints "check:hygiene: passed" with all three steps run, not skipped. Failing: appending `bait_fn() { cat $1; }` to Server/scripts/voice-test.sh fails on SC2086; changing a runs-on to `ubunt-latest` fails on runner-label; appending a misformatted table to README.md fails prettier. All three files restored and confirmed clean afterwards. actionlint validates the new job in ci.yml itself. Refs RL-19 / L-13, S-05. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com> * docs(plans): record B1 progress through B1-3 The header still read "B1-0 is complete; B1-1 is the next step" three merged phases later. A plan that misstates where it is costs a reader the same confusion whether it is stale by one phase or three. B1-0 (#1410), B1-1 (#1411), B1-2 (#1412) and B1-3 (this branch) are done; B1-4, dependency automation, is next. Verified: `node scripts/check-doc-counts.mjs` still agrees on 27 claims across 9 watched documents -- this file is one of them -- and prettier reports it clean. * chore(ci): pin Repository Hygiene as a required check on dev The second half of S-05. Its acceptance criterion is "tree is formatted AND a fast required gate fails future drift" -- a check that runs but is not pinned lets a formatting regression merge, so the gate is not a gate until this lands. The name was read off PR #1414 with `gh pr checks` after the job reported `pass` in 26s, not copied out of ci.yml. That order matters: the B0 script records that three pinned names exist in no workflow file at all, and that a required check which never reports blocks every PR forever. Extends the existing script rather than adding a second one, per the B1 plan. Also records, in the "deliberately NOT pinned" list, that Docs & Ledger Consistency reports and passes on a dev PR yet is unpinned. That reads as an oversight from the 2026-08-25 pass rather than a decision, but it belongs to G-04, so it is documented here and not changed. NOT APPLIED YET. Running this script now would pin a check that PR #1413 cannot report -- its branch predates the hygiene job, so the job does not exist in its workflow file and the check would never arrive. Run it after #1414 merges; #1413 needs a rebase onto dev regardless. Verified: shellcheck clean, the embedded JSON parses, and `check:hygiene` passes with prettier, shellcheck and actionlint all running. Refs S-05, RL-14 / G-03. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com> --------- Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
867 lines
49 KiB
Markdown
867 lines
49 KiB
Markdown
# Database Schema Reference
|
||
|
||
OwnCord uses a single SQLite database file (`data/chatserver.db`) with the pure-Go driver `modernc.org/sqlite` (no CGO). Migrations run automatically on startup.
|
||
|
||
> **Data-access layers:** most `Server/db` methods delegate to the
|
||
> sqlc-generated layer (`Server/db/dbgen`, from `Server/db/queries/`) per
|
||
> decision D2 in
|
||
> [plans/audit-2026-07-19-decisions.md](plans/audit-2026-07-19-decisions.md);
|
||
> a deliberate remainder (variable `IN` lists, FTS, multi-statement
|
||
> transactions) still runs as hand-written SQL — tracked in
|
||
> [plans/sqlc-adoption.md](plans/sqlc-adoption.md). See
|
||
> [architecture/data-model.md](architecture/data-model.md) for the full
|
||
> picture.
|
||
|
||
---
|
||
|
||
## Database Configuration
|
||
|
||
| PRAGMA | Value | Purpose |
|
||
| -------------- | ----------- | ------------------------------------------ |
|
||
| `journal_mode` | `WAL` | Write-Ahead Logging for concurrent readers |
|
||
| `foreign_keys` | `ON` | Enforces all `REFERENCES` constraints |
|
||
| `busy_timeout` | `5000` | Waits up to 5 seconds for the write lock |
|
||
| `synchronous` | `NORMAL` | Safe with WAL mode, reduces fsync calls |
|
||
| `temp_store` | `MEMORY` | Temporary tables stored in RAM |
|
||
| `mmap_size` | `268435456` | 256 MB memory-mapped I/O |
|
||
| `cache_size` | `-64000` | 64 MB page cache |
|
||
|
||
SQLite only allows one writer at a time. File-backed databases (the production
|
||
mode) therefore run a split pool: a single-connection writer pool
|
||
(`SetMaxOpenConns(1)`) plus a multi-connection read-only pool sized
|
||
`max(4, NumCPU)` and clamped to 1–64, configurable via `database.max_readers`
|
||
(`Server/db/db.go`). Only in-memory databases (tests) keep the historical
|
||
single shared connection.
|
||
|
||
---
|
||
|
||
## Migration System
|
||
|
||
Migrations are embedded `.sql` files applied in lexicographic order. Each migration runs in a transaction and is tracked in `schema_versions`.
|
||
|
||
```sql
|
||
CREATE TABLE IF NOT EXISTS schema_versions (
|
||
version TEXT PRIMARY KEY,
|
||
applied_at TEXT NOT NULL DEFAULT (datetime('now'))
|
||
);
|
||
```
|
||
|
||
### Migration History
|
||
|
||
| File | Description |
|
||
| ---------------------------------------------- | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
|
||
| `001_initial_schema.sql` | All core tables, default roles and settings |
|
||
| `002_voice_states.sql` | Adds `voice_states` table |
|
||
| `003_audit_log.sql` | Recreates `audit_log` with canonical column names (via a transient `audit_log_v6` rename) |
|
||
| `004_voice_optimization.sql` | Adds `camera`, `screenshare` to voice_states; voice settings to channels |
|
||
| `005_fix_member_permissions.sql` | Fixes Member role permissions |
|
||
| `006_channel_overrides_index.sql` | Adds composite index on channel_overrides |
|
||
| `007_member_video_permissions.sql` | Adds USE_VIDEO and SHARE_SCREEN to Member role |
|
||
| `008_attachment_dimensions.sql` | Adds `width` and `height` to attachments |
|
||
| `009_dm_tables.sql` | Adds `dm_participants` and `dm_open_state` tables |
|
||
| `010_attachment_uploader.sql` | Adds `attachments.uploader_id` + index for upload-ownership checks |
|
||
| `011_rate_lockouts.sql` | Adds `rate_lockouts` so rate-limit lockouts survive restarts |
|
||
| `012_user_blocks.sql` | Adds `user_blocks` (blocks DM creation/messaging between users) |
|
||
| `013_channel_type_constraint.sql` | INSERT/UPDATE triggers restricting `channels.type` to `text`/`voice`/`dm` |
|
||
| `014_events_table.sql` | Adds `events` — persistent broadcast log for reconnect cold-tier replay |
|
||
| `015_plugins.sql` | Adds `plugins` and `plugin_kv` for the WASM plugin runtime |
|
||
| `016_announcement_channel_type.sql` | Recreates the channel-type triggers to allow `announcement` |
|
||
| `017_user_identity_key.sql` | Adds `users.identity_public_key` (long-term E2EE identity key for voice TOFU) |
|
||
| `018_api_tokens.sql` | Adds `api_tokens` — long-lived, revocable bearer tokens for headless clients (bot/service auth) |
|
||
| `019_perf_indexes.sql` | Adds hot-path indexes |
|
||
| `020_drop_redundant_indexes.sql` | Drops indexes duplicating UNIQUE auto-indexes |
|
||
| `021_voice_server_moderation.sql` | Adds `server_muted`, `server_deafened` to voice_states (moderator-imposed) |
|
||
| `022_message_mentions.sql` | Adds `message_mentions` + `messages.mentions_everyone`, and grants `MENTION_EVERYONE` (bit 21) to the seeded Owner/Admin/Moderator roles |
|
||
| `023_role_management.sql` | Adds `idx_roles_name_nocase` — role names become unique case-insensitively, matching how they are looked up |
|
||
| `024_channel_user_overrides.sql` | Adds `channel_user_overrides` — per-member channel permission overrides, the last layer of the resolution order |
|
||
| `025_channel_nsfw.sql` | Adds `channels.nsfw` — the age-gate flag the server stores and broadcasts but imposes no behaviour of its own on |
|
||
| `026_emoji_mime.sql` | Adds `emoji.mime_type` — the sniffed image type, so the emoji image route can send a Content-Type without re-reading the file |
|
||
| `027_user_profile_fields.sql` | Adds `users.display_name`, `users.about`, `users.custom_status`, and a partial index on `users(avatar)` for the file route's avatar-authorization probe |
|
||
| `028_group_dms.sql` | Adds `channels.is_group` + a partial index — marks a DM channel as a group so group-ness survives people leaving |
|
||
| `029_drop_sounds_table.sql` | Drops `sounds` — dead since 001; the soundboard it was created for was never built (A-2026-07-13) |
|
||
| `030_attachments_unlink_on_message_delete.sql` | Rebuilds `attachments` with `message_id ON DELETE SET NULL` (was CASCADE) — cascaded message deletes now unlink rows instead of removing them, so the periodic orphan sweep can still find and reclaim the stored files |
|
||
| `031_sessions_expiry_index.sql` | Normalizes legacy `sessions.expires_at` values to RFC3339 UTC and adds `idx_sessions_expires_at` so the 15-minute expiry sweep is sargable |
|
||
|
||
---
|
||
|
||
## Tables
|
||
|
||
### roles
|
||
|
||
Defines permission tiers.
|
||
|
||
```sql
|
||
CREATE TABLE roles (
|
||
id INTEGER PRIMARY KEY AUTOINCREMENT,
|
||
name TEXT NOT NULL UNIQUE,
|
||
color TEXT,
|
||
permissions INTEGER NOT NULL DEFAULT 0,
|
||
position INTEGER NOT NULL DEFAULT 0,
|
||
is_default INTEGER NOT NULL DEFAULT 0
|
||
);
|
||
```
|
||
|
||
**Default roles** — current values after the full migration set (001 seeds
|
||
different masks: 005/007 raise Member's, 022 grants `MENTION_EVERYONE` to
|
||
Owner/Admin/Moderator). Not fixed at runtime — see _Role semantics_ below:
|
||
|
||
| id | name | color | permissions | position | Notes |
|
||
| --- | --------- | --------- | ------------ | -------- | ----------------------------------------------------- |
|
||
| 1 | Owner | `#E74C3C` | `0x7FFFFFFF` | 100 | All 31 permission bits set |
|
||
| 2 | Admin | `#F39C12` | `0x3FFFFFFF` | 80 | Everything except ADMINISTRATOR |
|
||
| 3 | Moderator | `#3498DB` | `0x002FFFFF` | 60 | All message + voice + moderation + mention-everyone |
|
||
| 4 | Member | NULL | `0x1E63` | 40 | Send, read, attach, react, voice, video, screen share |
|
||
|
||
**Role semantics:**
|
||
|
||
- **`name`** is unique case-insensitively. The column's own `UNIQUE` constraint
|
||
uses SQLite's default BINARY collation, so migration `023` adds
|
||
`idx_roles_name_nocase` (`UNIQUE … ON roles(name COLLATE NOCASE)`) —
|
||
otherwise "Moderator" and "moderator" would be two roles the client, which
|
||
resolves names case-insensitively, could not tell apart. Max 32 characters.
|
||
- **`color`** is `#rgb` or `#rrggbb` (stored uppercase) or `NULL`. It is
|
||
rendered directly into a style attribute by the desktop client and the admin
|
||
panel, so no other form is accepted.
|
||
- **`position`** is the hierarchy rank — higher outranks lower. Every
|
||
moderation and role-management check is "actor's position strictly greater
|
||
than the target's". Positions are not required to be contiguous, but
|
||
`PATCH /admin/api/roles/reorder` normalizes the roles below the actor to
|
||
`N…1`, which keeps them unique. Position `100`
|
||
(`permissions.OwnerRolePosition`) is the top: nothing outranks it, which is
|
||
what makes the seeded Owner role uneditable and undeletable.
|
||
- **`is_default`** marks the single fallback role. New users are created on it
|
||
and members of a deleted role are moved onto it, so it cannot itself be
|
||
deleted. It is set by migration and is not writable through the API — which
|
||
role is the fallback is a schema decision, not an operator one.
|
||
- Roles are created, edited, deleted and reordered through
|
||
`/admin/api/roles` (`MANAGE_ROLES` + hierarchy; see `docs/api.md`). Deleting
|
||
a role reassigns its members and drops its `channel_overrides` rows in one
|
||
transaction. `users.role_id` is a single role per user — there is no
|
||
many-to-many membership table.
|
||
|
||
---
|
||
|
||
### users
|
||
|
||
```sql
|
||
CREATE TABLE users (
|
||
id INTEGER PRIMARY KEY AUTOINCREMENT,
|
||
username TEXT NOT NULL UNIQUE COLLATE NOCASE,
|
||
password TEXT NOT NULL,
|
||
avatar TEXT,
|
||
role_id INTEGER NOT NULL DEFAULT 4 REFERENCES roles(id),
|
||
totp_secret TEXT,
|
||
status TEXT NOT NULL DEFAULT 'offline',
|
||
created_at TEXT NOT NULL DEFAULT (datetime('now')),
|
||
last_seen TEXT,
|
||
banned INTEGER NOT NULL DEFAULT 0,
|
||
ban_reason TEXT,
|
||
ban_expires TEXT,
|
||
identity_public_key TEXT,
|
||
display_name TEXT,
|
||
about TEXT,
|
||
custom_status TEXT
|
||
);
|
||
|
||
CREATE INDEX idx_users_avatar ON users(avatar) WHERE avatar IS NOT NULL;
|
||
```
|
||
|
||
Valid status values: `online`, `idle`, `dnd`, `invisible`, `offline`.
|
||
|
||
`status` holds the status the user **chose**, `invisible` included — it is
|
||
deliberately not collapsed to `offline` at the write, because the server has to
|
||
be able to tell "chose to appear offline" from "is not connected" on the next
|
||
connect. The collapse happens at read time instead (`db.BroadcastStatus` /
|
||
`StatusForViewer`): every payload another user can see maps `invisible` to
|
||
`offline`, while the owner's own payloads keep the true value.
|
||
|
||
A chosen `idle`/`dnd`/`invisible` therefore survives a disconnect (only
|
||
`online` is cleared, by `MarkUserDisconnected`) and survives a server restart
|
||
(`ResetAllUserStatuses` clears only `online`). It cannot render as "present" in
|
||
the meantime because the ready payload treats a member with no live connection
|
||
as `offline` regardless of the column.
|
||
|
||
`identity_public_key` (added in migration 017) is the user's long-term E2EE
|
||
identity public key (base64 ECDSA P-256) used for TOFU pinning of voice E2EE
|
||
announces; `NULL` = not published (legacy client).
|
||
|
||
`display_name`, `about` and `custom_status` (migration 027) are the profile
|
||
fields, all `NULL` when unset. Bounds — 32, 300 and 128 characters
|
||
respectively — are enforced in the service layer, where the HTML sanitizer runs
|
||
and a violation can answer `400` instead of a constraint error. `display_name`
|
||
is display only: `@mentions` resolve against `username`, which is the unique,
|
||
case-insensitive key.
|
||
|
||
`idx_users_avatar` covers the file route's authorization probe. An avatar
|
||
uploaded through `POST /api/v1/users/me/avatar` is an attachment with no
|
||
channel — private to its uploader by default — and `GET /api/v1/files/{id}`
|
||
additionally admits one that some user's `avatar` currently equals, so an
|
||
avatar is readable by every authenticated user for exactly as long as it is in
|
||
use.
|
||
|
||
---
|
||
|
||
### sessions
|
||
|
||
```sql
|
||
CREATE TABLE sessions (
|
||
id INTEGER PRIMARY KEY AUTOINCREMENT,
|
||
user_id INTEGER NOT NULL REFERENCES users(id) ON DELETE CASCADE,
|
||
token TEXT NOT NULL UNIQUE,
|
||
device TEXT,
|
||
ip_address TEXT,
|
||
created_at TEXT NOT NULL DEFAULT (datetime('now')),
|
||
last_used TEXT NOT NULL DEFAULT (datetime('now')),
|
||
expires_at TEXT NOT NULL
|
||
);
|
||
```
|
||
|
||
Session TTL: 30 days. Token is stored as SHA-256 hash.
|
||
|
||
---
|
||
|
||
### api_tokens
|
||
|
||
```sql
|
||
CREATE TABLE api_tokens (
|
||
id INTEGER PRIMARY KEY AUTOINCREMENT,
|
||
user_id INTEGER NOT NULL REFERENCES users(id) ON DELETE CASCADE,
|
||
token_hash TEXT NOT NULL UNIQUE,
|
||
label TEXT NOT NULL DEFAULT '',
|
||
created_at TEXT NOT NULL DEFAULT (datetime('now')),
|
||
last_used_at TEXT,
|
||
expires_at TEXT,
|
||
revoked_at TEXT
|
||
);
|
||
```
|
||
|
||
Long-lived, revocable bearer tokens for headless clients (bots, CI, the introspection
|
||
MCP tool). A token authenticates as `user_id`, inheriting that user's role/permissions,
|
||
and is resolved by the same middleware as sessions (see `auth.ResolveTokenHash`). Only the
|
||
SHA-256 hash is stored; the raw token is shown once at creation. `expires_at` NULL = never
|
||
expires; `revoked_at` NULL = active. Mint/list/revoke via `server token …`. Separate from
|
||
`sessions` so bulk logout and the per-user session cap never affect these.
|
||
|
||
---
|
||
|
||
### channels
|
||
|
||
```sql
|
||
CREATE TABLE channels (
|
||
id INTEGER PRIMARY KEY AUTOINCREMENT,
|
||
name TEXT NOT NULL,
|
||
type TEXT NOT NULL DEFAULT 'text',
|
||
category TEXT,
|
||
topic TEXT,
|
||
position INTEGER NOT NULL DEFAULT 0,
|
||
slow_mode INTEGER NOT NULL DEFAULT 0,
|
||
archived INTEGER NOT NULL DEFAULT 0,
|
||
created_at TEXT NOT NULL DEFAULT (datetime('now')),
|
||
voice_max_users INTEGER NOT NULL DEFAULT 0,
|
||
voice_quality TEXT,
|
||
mixing_threshold INTEGER,
|
||
voice_max_video INTEGER NOT NULL DEFAULT 25,
|
||
nsfw INTEGER NOT NULL DEFAULT 0,
|
||
is_group INTEGER NOT NULL DEFAULT 0
|
||
);
|
||
```
|
||
|
||
Channel types: `text`, `voice`, `announcement`, `dm`. Migration 013 installs
|
||
INSERT/UPDATE triggers restricting the value to this set (migration 016 added
|
||
`announcement`). Announcement channels are readable like text channels but
|
||
posting is restricted to users with `MANAGE_MESSAGES` (enforced in the service
|
||
layer, `Server/service/message.go`).
|
||
|
||
`nsfw` (migration 025) is the age-restriction flag, stored 0/1 like `archived`
|
||
because SQLite has no boolean type. **It drives nothing server-side.** The
|
||
server stores it, ships it in `ready` and in the `channel_create` /
|
||
`channel_update` broadcasts, and audits an operator flipping it — it does not
|
||
filter content, check anyone's age, or restrict who may read or post in a
|
||
flagged channel. Clients decide what the flag means to them; the desktop client
|
||
shows a one-time-per-session warning before rendering the channel and marks it
|
||
in the sidebar.
|
||
|
||
`voice_max_users` and `voice_max_video` (0 = unlimited) are the only channel
|
||
columns that _are_ enforced by the server, on voice join and on video publish
|
||
respectively (`CHANNEL_FULL` / `VIDEO_LIMIT`). They exist on every row but are
|
||
meaningless on a non-voice channel.
|
||
|
||
`is_group` (migration 028) marks a `dm` channel as a group DM. It is decided
|
||
once at creation and **never recomputed from the live participant count**,
|
||
because that count changes underneath you:
|
||
|
||
- A group of three that two people leave has two participants, and the 1:1
|
||
lookup — "the dm channel both of these users are in" — would then match it.
|
||
"Message Bob" would silently deliver into the remnants of a group, in front of
|
||
whoever else is still there.
|
||
- Leaving is destructive for a group (removal from `dm_participants`) and
|
||
non-destructive for a 1:1 (hide only). Deriving which one to run from the live
|
||
count means the third-from-last leaver runs a different operation than the
|
||
second-from-last, for no reason the user can see.
|
||
|
||
`name` carries the optional group name; it is `''` for every 1:1 DM (a
|
||
two-person DM is named by who is in it) and for an unnamed group.
|
||
|
||
`PATCH /admin/api/channels/{id}` (`MANAGE_CHANNELS`) is the write path for
|
||
`slow_mode` (0…21600), `nsfw` and both voice limits (0…99 each); values outside
|
||
those ranges are refused rather than clamped.
|
||
|
||
---
|
||
|
||
### channel_overrides
|
||
|
||
Per-channel permission overrides for specific roles.
|
||
|
||
```sql
|
||
CREATE TABLE channel_overrides (
|
||
id INTEGER PRIMARY KEY AUTOINCREMENT,
|
||
channel_id INTEGER NOT NULL REFERENCES channels(id) ON DELETE CASCADE,
|
||
role_id INTEGER NOT NULL REFERENCES roles(id) ON DELETE CASCADE,
|
||
allow INTEGER NOT NULL DEFAULT 0,
|
||
deny INTEGER NOT NULL DEFAULT 0,
|
||
UNIQUE(channel_id, role_id)
|
||
);
|
||
```
|
||
|
||
Effective permission calculation for this layer:
|
||
`effective = (base_permissions & ~deny) | allow`
|
||
|
||
This is the ROLE layer. The per-member layer (`channel_user_overrides`) is
|
||
applied on top of the result — see "Permission Checking Logic" below.
|
||
|
||
---
|
||
|
||
### channel_user_overrides
|
||
|
||
Per-channel permission overrides for a single **member**, independent of their
|
||
role. This is Discord's narrowest override layer: it grants or refuses one
|
||
person a bit in one channel without minting a role for them.
|
||
|
||
```sql
|
||
CREATE TABLE channel_user_overrides (
|
||
channel_id INTEGER NOT NULL REFERENCES channels(id) ON DELETE CASCADE,
|
||
user_id INTEGER NOT NULL REFERENCES users(id) ON DELETE CASCADE,
|
||
allow INTEGER NOT NULL DEFAULT 0,
|
||
deny INTEGER NOT NULL DEFAULT 0,
|
||
PRIMARY KEY (channel_id, user_id)
|
||
);
|
||
```
|
||
|
||
The shape mirrors `channel_overrides` (allow/deny masks, cascade on both
|
||
parents) so both layers are fetched and merged by the same code
|
||
(`db.GetChannelOverridesFor`). The composite PRIMARY KEY replaces the surrogate
|
||
`id` + `UNIQUE` pair `channel_overrides` carries — nothing references an
|
||
override row by id.
|
||
|
||
Only members who actually carry an override have a row: an all-inherit override
|
||
is deleted rather than stored as `(0, 0)`.
|
||
|
||
---
|
||
|
||
### messages
|
||
|
||
```sql
|
||
CREATE TABLE messages (
|
||
id INTEGER PRIMARY KEY AUTOINCREMENT,
|
||
channel_id INTEGER NOT NULL REFERENCES channels(id) ON DELETE CASCADE,
|
||
user_id INTEGER NOT NULL REFERENCES users(id),
|
||
content TEXT NOT NULL,
|
||
reply_to INTEGER REFERENCES messages(id) ON DELETE SET NULL,
|
||
edited_at TEXT,
|
||
deleted INTEGER NOT NULL DEFAULT 0,
|
||
pinned INTEGER NOT NULL DEFAULT 0,
|
||
timestamp TEXT NOT NULL DEFAULT (datetime('now')),
|
||
mentions_everyone INTEGER NOT NULL DEFAULT 0
|
||
);
|
||
```
|
||
|
||
Messages are soft-deleted (`deleted = 1`), never physically removed by user action.
|
||
|
||
`mentions_everyone` (migration 022) is set when the message carried `@everyone`
|
||
or `@here` **and** the author held `MENTION_EVERYONE` on that channel. It is a
|
||
column rather than a sentinel row in `message_mentions` so that table never
|
||
holds a `mentioned_user_id` that is not a real user. The message row and its
|
||
mention rows are written in one writer transaction, and an edit rewrites both.
|
||
|
||
---
|
||
|
||
### message_mentions
|
||
|
||
```sql
|
||
CREATE TABLE message_mentions (
|
||
message_id INTEGER NOT NULL REFERENCES messages(id) ON DELETE CASCADE,
|
||
mentioned_user_id INTEGER NOT NULL REFERENCES users(id) ON DELETE CASCADE,
|
||
PRIMARY KEY (message_id, mentioned_user_id)
|
||
);
|
||
|
||
CREATE INDEX idx_message_mentions_user ON message_mentions(mentioned_user_id);
|
||
```
|
||
|
||
The user IDs a message resolved from its `@username` tokens, capped at 20 rows
|
||
per message. Resolution is case-insensitive whole-word matching against
|
||
`users.username` (which is `UNIQUE COLLATE NOCASE`); a token that matches no
|
||
username is not stored and stays plain text. The primary key serves the
|
||
per-message lookup that message history and search batch on; the index serves
|
||
the per-user direction.
|
||
|
||
---
|
||
|
||
### messages_fts (FTS5 Virtual Table)
|
||
|
||
Full-text search index synchronized via triggers.
|
||
|
||
```sql
|
||
CREATE VIRTUAL TABLE messages_fts USING fts5(
|
||
content,
|
||
content='messages',
|
||
content_rowid='id'
|
||
);
|
||
```
|
||
|
||
Supports FTS5 query syntax: simple terms, phrase queries, prefix queries, boolean operators (`AND`, `OR`, `NOT`).
|
||
|
||
---
|
||
|
||
### attachments
|
||
|
||
```sql
|
||
CREATE TABLE attachments (
|
||
id TEXT PRIMARY KEY,
|
||
message_id INTEGER REFERENCES messages(id) ON DELETE SET NULL,
|
||
filename TEXT NOT NULL,
|
||
stored_as TEXT NOT NULL,
|
||
mime_type TEXT NOT NULL,
|
||
size INTEGER NOT NULL,
|
||
uploaded_at TEXT NOT NULL DEFAULT (datetime('now')),
|
||
width INTEGER,
|
||
height INTEGER,
|
||
uploader_id INTEGER REFERENCES users(id)
|
||
);
|
||
```
|
||
|
||
Uses UUID primary keys. `message_id` is NULL during upload, linked when the
|
||
message is sent. `uploader_id` (added by migration 010) records who uploaded
|
||
the file and backs the ownership check when attaching an upload to a message.
|
||
`ON DELETE SET NULL` (migration 030, was CASCADE) means a cascaded message
|
||
delete unlinks the row instead of removing it, leaving the periodic orphan
|
||
sweep (`DeleteOrphanedAttachments`) a handle on the stored file so the bytes
|
||
are reclaimed rather than stranded.
|
||
|
||
---
|
||
|
||
### reactions
|
||
|
||
```sql
|
||
CREATE TABLE reactions (
|
||
id INTEGER PRIMARY KEY AUTOINCREMENT,
|
||
message_id INTEGER NOT NULL REFERENCES messages(id) ON DELETE CASCADE,
|
||
user_id INTEGER NOT NULL REFERENCES users(id) ON DELETE CASCADE,
|
||
emoji TEXT NOT NULL,
|
||
UNIQUE(message_id, user_id, emoji)
|
||
);
|
||
```
|
||
|
||
---
|
||
|
||
### invites
|
||
|
||
```sql
|
||
CREATE TABLE invites (
|
||
id INTEGER PRIMARY KEY AUTOINCREMENT,
|
||
code TEXT NOT NULL UNIQUE,
|
||
created_by INTEGER NOT NULL REFERENCES users(id),
|
||
redeemed_by INTEGER REFERENCES users(id),
|
||
max_uses INTEGER,
|
||
use_count INTEGER NOT NULL DEFAULT 0,
|
||
expires_at TEXT,
|
||
created_at TEXT NOT NULL DEFAULT (datetime('now')),
|
||
revoked INTEGER NOT NULL DEFAULT 0
|
||
);
|
||
```
|
||
|
||
Invite codes are 8 random bytes encoded as hex. Uses are validated and incremented atomically.
|
||
|
||
---
|
||
|
||
### read_states
|
||
|
||
```sql
|
||
CREATE TABLE read_states (
|
||
user_id INTEGER NOT NULL REFERENCES users(id) ON DELETE CASCADE,
|
||
channel_id INTEGER NOT NULL REFERENCES channels(id) ON DELETE CASCADE,
|
||
last_message_id INTEGER NOT NULL DEFAULT 0,
|
||
mention_count INTEGER NOT NULL DEFAULT 0,
|
||
PRIMARY KEY (user_id, channel_id)
|
||
);
|
||
```
|
||
|
||
`mention_count` is incremented on message insert for every mentioned user who
|
||
can read the channel, except the author and except users who have blocked the
|
||
author. `@everyone` counts every reader; `@here` counts only readers whose
|
||
_broadcast_ status is not `offline` — the column stores the status the user
|
||
chose, so a reader who picked `invisible` is collapsed to `offline` here and is
|
||
skipped, exactly as they appear to everyone else. Edits never increment it — a badge is only
|
||
raised by the original send, so an edit cannot double-count a mention. The
|
||
`channel_focus` read-state upsert resets it to 0, and the `ready` payload ships
|
||
it per channel.
|
||
|
||
---
|
||
|
||
### audit_log
|
||
|
||
```sql
|
||
CREATE TABLE audit_log (
|
||
id INTEGER PRIMARY KEY AUTOINCREMENT,
|
||
actor_id INTEGER NOT NULL DEFAULT 0,
|
||
action TEXT NOT NULL,
|
||
target_type TEXT NOT NULL DEFAULT '',
|
||
target_id INTEGER NOT NULL DEFAULT 0,
|
||
detail TEXT NOT NULL DEFAULT '',
|
||
created_at TEXT NOT NULL DEFAULT (datetime('now'))
|
||
);
|
||
```
|
||
|
||
---
|
||
|
||
### voice_states
|
||
|
||
Ephemeral -- all rows deleted on server startup.
|
||
|
||
```sql
|
||
CREATE TABLE voice_states (
|
||
user_id INTEGER PRIMARY KEY REFERENCES users(id) ON DELETE CASCADE,
|
||
channel_id INTEGER NOT NULL REFERENCES channels(id) ON DELETE CASCADE,
|
||
muted INTEGER NOT NULL DEFAULT 0,
|
||
deafened INTEGER NOT NULL DEFAULT 0,
|
||
speaking INTEGER NOT NULL DEFAULT 0,
|
||
camera INTEGER NOT NULL DEFAULT 0,
|
||
screenshare INTEGER NOT NULL DEFAULT 0,
|
||
server_muted INTEGER NOT NULL DEFAULT 0,
|
||
server_deafened INTEGER NOT NULL DEFAULT 0,
|
||
joined_at TEXT NOT NULL DEFAULT (datetime('now'))
|
||
);
|
||
```
|
||
|
||
`server_muted` / `server_deafened` are moderator-imposed (`MUTE_MEMBERS`) and,
|
||
unlike `muted` / `deafened`, the user cannot clear them. They survive a channel
|
||
switch (the join upsert does not reset them) but not a leave, which deletes the
|
||
row.
|
||
|
||
---
|
||
|
||
### dm_participants
|
||
|
||
```sql
|
||
CREATE TABLE dm_participants (
|
||
channel_id INTEGER NOT NULL REFERENCES channels(id) ON DELETE CASCADE,
|
||
user_id INTEGER NOT NULL REFERENCES users(id) ON DELETE CASCADE,
|
||
PRIMARY KEY (channel_id, user_id)
|
||
);
|
||
```
|
||
|
||
N rows per channel: two for a 1:1 DM, three to ten for a group
|
||
(`db.MaxGroupDMParticipants`). Every DM authorization check is a lookup on
|
||
`(user_id, channel_id)`, which is why group DMs needed no new authorization
|
||
path — only `channels.is_group` to tell the two kinds apart.
|
||
|
||
A group leave deletes the row. When the last one goes, the `channels` row is
|
||
deleted with it: a DM nobody is in is reachable by nobody, and its messages and
|
||
attachments cascade off the channel.
|
||
|
||
---
|
||
|
||
### dm_open_state
|
||
|
||
```sql
|
||
CREATE TABLE dm_open_state (
|
||
user_id INTEGER NOT NULL REFERENCES users(id) ON DELETE CASCADE,
|
||
channel_id INTEGER NOT NULL REFERENCES channels(id) ON DELETE CASCADE,
|
||
opened_at TEXT NOT NULL DEFAULT (datetime('now')),
|
||
PRIMARY KEY (user_id, channel_id)
|
||
);
|
||
```
|
||
|
||
---
|
||
|
||
### login_attempts
|
||
|
||
Login attempt log used for IP-based rate limiting and lockouts.
|
||
|
||
```sql
|
||
CREATE TABLE login_attempts (
|
||
id INTEGER PRIMARY KEY AUTOINCREMENT,
|
||
ip_address TEXT NOT NULL,
|
||
username TEXT,
|
||
success INTEGER NOT NULL DEFAULT 0,
|
||
timestamp TEXT NOT NULL DEFAULT (datetime('now'))
|
||
);
|
||
```
|
||
|
||
---
|
||
|
||
### settings
|
||
|
||
Generic key/value store for server settings (`server_name`, `motd`,
|
||
`registration_open`, …). Written by the admin API; read by the REST layer and
|
||
the WebSocket hub (cached with a short TTL).
|
||
|
||
```sql
|
||
CREATE TABLE settings (
|
||
key TEXT PRIMARY KEY,
|
||
value TEXT NOT NULL
|
||
);
|
||
```
|
||
|
||
---
|
||
|
||
### emoji
|
||
|
||
Server-wide custom emoji: one row per `:shortcode:`.
|
||
|
||
```sql
|
||
CREATE TABLE emoji (
|
||
id INTEGER PRIMARY KEY AUTOINCREMENT,
|
||
shortcode TEXT NOT NULL UNIQUE,
|
||
filename TEXT NOT NULL,
|
||
uploaded_by INTEGER NOT NULL REFERENCES users(id),
|
||
created_at TEXT NOT NULL DEFAULT (datetime('now')),
|
||
mime_type TEXT NOT NULL DEFAULT 'image/png' -- migration 026
|
||
);
|
||
```
|
||
|
||
`filename` holds the **storage UUID** the image bytes were written under (the
|
||
same convention as `attachments.stored_as`); the column name is inherited from
|
||
the initial schema. It is never derived from anything the uploader sent and is
|
||
never shown to a user.
|
||
|
||
`shortcode` is always lowercase — `[a-z0-9_]{2,32}` is the only spelling the
|
||
validator admits — which is what makes the plain `UNIQUE` index a
|
||
case-insensitive one without a `COLLATE NOCASE` change.
|
||
|
||
`mime_type` (migration 026) is the type **sniffed from the file's own bytes** at
|
||
upload, restricted to `image/png`, `image/jpeg`, `image/gif` and `image/webp`.
|
||
It exists so `GET /api/v1/emoji/{id}/image` can set a Content-Type without
|
||
opening and re-sniffing the file on every request. The `DEFAULT` is only there
|
||
to make the `ALTER` legal; nothing had ever written to this table before
|
||
migration 026, because the table shipped in 001 with no server code at all.
|
||
|
||
Writes are gated on `MANAGE_SERVER` (see api.md for why no new permission bit
|
||
was added), and every mutation broadcasts the whole set as `emoji_update`.
|
||
|
||
---
|
||
|
||
### rate_lockouts
|
||
|
||
Persists rate-limiter lockouts (e.g. repeated failed logins) so they survive
|
||
server restarts. Sliding-window counters themselves stay in memory.
|
||
|
||
```sql
|
||
CREATE TABLE rate_lockouts (
|
||
key TEXT PRIMARY KEY,
|
||
expires_at TEXT NOT NULL
|
||
);
|
||
```
|
||
|
||
---
|
||
|
||
### user_blocks
|
||
|
||
User blocking (added by migration 012): a block prevents DM creation and
|
||
messaging between the two users.
|
||
|
||
```sql
|
||
CREATE TABLE user_blocks (
|
||
blocker_id INTEGER NOT NULL REFERENCES users(id) ON DELETE CASCADE,
|
||
blocked_id INTEGER NOT NULL REFERENCES users(id) ON DELETE CASCADE,
|
||
created_at TEXT NOT NULL DEFAULT (datetime('now')),
|
||
PRIMARY KEY (blocker_id, blocked_id),
|
||
CHECK (blocker_id != blocked_id)
|
||
);
|
||
```
|
||
|
||
---
|
||
|
||
### events
|
||
|
||
Persistent broadcast log (migration 014) — the cold tier of the reconnect
|
||
replay pipeline (see [protocol.md](protocol.md)). Written asynchronously by
|
||
the event persister, pruned by retention (configurable, default 24h). The
|
||
hub's in-memory sequence counter is seeded from `MAX(events.seq)` at startup
|
||
so sequence numbers stay monotonic across restarts.
|
||
|
||
```sql
|
||
CREATE TABLE events (
|
||
seq INTEGER PRIMARY KEY AUTOINCREMENT,
|
||
event_type TEXT NOT NULL,
|
||
payload BLOB NOT NULL,
|
||
channel_id INTEGER NOT NULL DEFAULT 0,
|
||
created_at TIMESTAMP NOT NULL DEFAULT CURRENT_TIMESTAMP
|
||
);
|
||
```
|
||
|
||
---
|
||
|
||
### plugins / plugin_kv
|
||
|
||
Plugin registry and per-plugin key/value storage (migration 015). `plugin_kv`
|
||
is namespaced per plugin via the composite primary key.
|
||
|
||
```sql
|
||
CREATE TABLE plugins (
|
||
id INTEGER PRIMARY KEY AUTOINCREMENT,
|
||
name TEXT NOT NULL UNIQUE,
|
||
version TEXT NOT NULL,
|
||
enabled INTEGER NOT NULL DEFAULT 0,
|
||
manifest_json TEXT NOT NULL,
|
||
installed_at TIMESTAMP NOT NULL DEFAULT CURRENT_TIMESTAMP
|
||
);
|
||
|
||
CREATE TABLE plugin_kv (
|
||
plugin_id INTEGER NOT NULL REFERENCES plugins(id) ON DELETE CASCADE,
|
||
key TEXT NOT NULL,
|
||
value BLOB NOT NULL,
|
||
PRIMARY KEY (plugin_id, key)
|
||
);
|
||
```
|
||
|
||
---
|
||
|
||
## Indexes
|
||
|
||
| Index Name | Table | Columns | Purpose |
|
||
| --------------------------------- | ---------------------- | ------------------------------------------------------------------- | ---------------------------------------------------------------------------------------------------------------------------------- |
|
||
| `idx_sessions_user` | sessions | `(user_id)` | Fast deletion of all sessions for a user |
|
||
| `idx_sessions_expires_at` | sessions | `(expires_at)` | Sargable 15-minute session-expiry sweep (031) |
|
||
| `idx_messages_channel` | messages | `(channel_id, id DESC)` | Latest messages in channel query |
|
||
| `idx_messages_user` | messages | `(user_id)` | Filter by author |
|
||
| `idx_messages_pinned` | messages | `(channel_id, id DESC)` partial: `WHERE pinned = 1 AND deleted = 0` | Pinned-message listing without scanning channel history (019) |
|
||
| `idx_audit_timestamp` | audit_log | `(created_at DESC)` | Pagination of audit log |
|
||
| `idx_audit_log_actor` | audit_log | `(actor_id)` | Filter by actor |
|
||
| `idx_login_ip` | login_attempts | `(ip_address, timestamp)` | Rate limiting queries |
|
||
| `idx_voice_states_channel` | voice_states | `(channel_id)` | All users in a voice channel |
|
||
| `idx_channel_overrides_role` | channel_overrides | `(role_id, channel_id, allow, deny)` | Covering per-role override fetch (019; replaced `idx_channel_overrides_channel_role`, which duplicated the UNIQUE auto-index) |
|
||
| `idx_dm_participants_user` | dm_participants | `(user_id)` | DM channel lookup |
|
||
| `idx_attachments_uploader` | attachments | `(uploader_id)` | Upload-ownership checks |
|
||
| `idx_attachments_message` | attachments | `(message_id)` | Message → attachments fetch (019, recreated by 030's rebuild) |
|
||
| `idx_user_blocks_blocked` | user_blocks | `(blocked_id, blocker_id)` | Reverse block lookup |
|
||
| `idx_events_channel_seq` | events | `(channel_id, seq)` | Cold-tier replay per channel |
|
||
| `idx_events_created_at` | events | `(created_at)` | Retention pruning |
|
||
| `idx_api_tokens_user` | api_tokens | `(user_id)` | Per-user token listing/revocation (018) |
|
||
| `idx_message_mentions_user` | message_mentions | `(mentioned_user_id)` | Per-user mention lookup |
|
||
| `idx_channel_user_overrides_user` | channel_user_overrides | `(user_id)` | "every override this member carries" — the direction the permission cache populates from (the PK covers the per-channel direction) |
|
||
| `idx_roles_name_nocase` | roles | `(name COLLATE NOCASE)` UNIQUE | Case-insensitive role-name uniqueness |
|
||
| `idx_users_avatar` | users | `(avatar)` partial: `WHERE avatar IS NOT NULL` | File route's avatar-authorization probe (027) |
|
||
| `idx_channels_dm_group` | channels | `(is_group)` partial: `WHERE type = 'dm'` | Group-DM filtering (028) |
|
||
|
||
Sessions are looked up by token and invites by code through their `UNIQUE`
|
||
auto-indexes; the duplicating `idx_sessions_token` / `idx_invites_code` were
|
||
dropped by migration 020.
|
||
|
||
---
|
||
|
||
## Permission Bitfield System
|
||
|
||
Permissions are stored as an integer bitfield (31 bits used) in
|
||
`roles.permissions`, `channel_overrides.allow`/`deny`, and
|
||
`channel_user_overrides.allow`/`deny`.
|
||
|
||
### Bit Map
|
||
|
||
| Bit | Hex | Name | Description |
|
||
| --- | ------------ | ------------------ | --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
|
||
| 0 | `0x1` | `SEND_MESSAGES` | Post messages in text channels |
|
||
| 1 | `0x2` | `READ_MESSAGES` | View messages in text channels |
|
||
| 5 | `0x20` | `ATTACH_FILES` | Upload file attachments |
|
||
| 6 | `0x40` | `ADD_REACTIONS` | Add emoji reactions |
|
||
| 9 | `0x200` | `CONNECT_VOICE` | Join voice channels |
|
||
| 10 | `0x400` | `SPEAK_VOICE` | Transmit audio in voice channels |
|
||
| 11 | `0x800` | `USE_VIDEO` | Enable camera in voice channels |
|
||
| 12 | `0x1000` | `SHARE_SCREEN` | Share screen in voice channels |
|
||
| 16 | `0x10000` | `MANAGE_MESSAGES` | Delete others' messages, pin/unpin |
|
||
| 17 | `0x20000` | `MANAGE_CHANNELS` | Create, edit, delete channels, edit channel permission overrides (`/admin/api/channels*`) |
|
||
| 18 | `0x40000` | `KICK_MEMBERS` | Force-logout a lower-ranked user (`DELETE /admin/api/users/{id}/sessions`) |
|
||
| 19 | `0x80000` | `BAN_MEMBERS` | Ban/unban a lower-ranked user (`PATCH /admin/api/users/{id}`) |
|
||
| 20 | `0x100000` | `MUTE_MEMBERS` | Server-side mute/deafen in voice — admits to the admin perimeter; no route enforces it yet |
|
||
| 21 | `0x200000` | `MENTION_EVERYONE` | Give `@everyone`/`@here` real mention semantics (highlight + mention badge). Without it the token stays plain text |
|
||
| 24 | `0x1000000` | `MANAGE_ROLES` | Assign a role below the actor's own rank to a lower-ranked user (`PATCH /admin/api/users/{id}`), and create/edit/delete/reorder roles below the actor's own (`/admin/api/roles…`) |
|
||
| 25 | `0x2000000` | `MANAGE_SERVER` | Read and modify server settings (`/admin/api/settings`) |
|
||
| 26 | `0x4000000` | `MANAGE_INVITES` | Create and revoke invite codes |
|
||
| 27 | `0x8000000` | `VIEW_AUDIT_LOG` | Read the audit log (`GET /admin/api/audit-log`) |
|
||
| 30 | `0x40000000` | `ADMINISTRATOR` | Bypasses ALL permission checks |
|
||
|
||
Bits 2-4, 7, 13-15, 22-23, 28-29, 31 are reserved.
|
||
|
||
### Permission groups
|
||
|
||
The bit map above is the authority on what each bit _does_; this grouping is
|
||
how the bits are _presented_ — it is the layout of the admin panel's role
|
||
permission grid (`PERM_GROUPS` in `Server/admin/static/index.html`). It carries
|
||
no semantics, but the two must stay in step: every defined bit belongs to
|
||
exactly one group, and a bit missing from the grouping is a bit no operator can
|
||
grant through the panel.
|
||
|
||
| Group | Bits |
|
||
| ---------- | -------------------------------------------------------------------------------------------------------- |
|
||
| General | `MANAGE_CHANNELS`, `MANAGE_ROLES`, `MANAGE_INVITES`, `MANAGE_SERVER`, `VIEW_AUDIT_LOG`, `ADMINISTRATOR` |
|
||
| Text | `READ_MESSAGES`, `SEND_MESSAGES`, `ATTACH_FILES`, `ADD_REACTIONS`, `MENTION_EVERYONE`, `MANAGE_MESSAGES` |
|
||
| Voice | `CONNECT_VOICE`, `SPEAK_VOICE`, `USE_VIDEO`, `SHARE_SCREEN` |
|
||
| Moderation | `KICK_MEMBERS`, `BAN_MEMBERS`, `MUTE_MEMBERS` |
|
||
|
||
### Admin perimeter
|
||
|
||
`permissions.AdminPerimeter` is the ANY-of mask that admits a principal to
|
||
`/admin/api/*`: `ADMINISTRATOR | MANAGE_CHANNELS | MANAGE_ROLES |
|
||
MANAGE_SERVER | VIEW_AUDIT_LOG | KICK_MEMBERS | BAN_MEMBERS | MUTE_MEMBERS`.
|
||
Holding one bit only gets a principal through the door — each route group
|
||
re-checks the specific bit it needs, so the seeded Moderator role can manage
|
||
channels and ban members without reading settings or the audit log. Owner-only
|
||
routes (backups, updates, API tokens) still gate on role _position_, not on a
|
||
bit. See `docs/api.md` for the per-route mapping.
|
||
|
||
### Permission Checking Logic
|
||
|
||
```
|
||
1. Get the user's role -> role.Permissions (base)
|
||
2. If (base & ADMINISTRATOR) != 0 -> ALLOW everything
|
||
3. Get channel_overrides for (channel_id, role_id) -> allow, deny
|
||
4. Get channel_user_overrides for (channel_id, user_id) -> uAllow, uDeny
|
||
5. roleLayer = (base & ~deny) | allow
|
||
6. effective = (roleLayer & ~uDeny) | uAllow
|
||
7. Check: (effective & required_permission) == required_permission
|
||
```
|
||
|
||
The order is Discord's: **base role permissions -> role override -> user
|
||
override**. Within a layer deny is applied first (strips bits) then allow (adds
|
||
bits), so allow wins when both target the same bit. Across layers the later,
|
||
narrower layer wins:
|
||
|
||
| Situation | Outcome |
|
||
| -------------------------------------------- | ---------------------------------- |
|
||
| role override allows, user override denies | denied |
|
||
| role override denies, user override allows | allowed |
|
||
| user override allows and denies the same bit | allowed |
|
||
| holder has `ADMINISTRATOR` | allowed regardless of either layer |
|
||
|
||
`permissions.EffectiveChannelPerms` is the single implementation of steps 5-6,
|
||
and `permissions.EffectivePerms` the one-layer primitive it is built from. The
|
||
`ADMINISTRATOR` bypass lives at the call sites (`Checker.HasChannelPerm`,
|
||
`Checker.HasChannelPermBatch`, and through it `VisibleChannelIDs`), not inside
|
||
the formula — it is a bypass, not a bit that survives an override.
|
||
|
||
Both layers are fetched together and per member, never per channel:
|
||
`db.GetChannelOverridesFor(roleID, userID)` runs two batch queries and merges
|
||
them, which is what keeps `buildReady`, REST `ListVisibleChannels`, reconnect
|
||
replay filtering and the cached `service.PermissionService` free of N+1 lookups
|
||
and unable to drift from each other.
|
||
|
||
DM channels bypass role permissions entirely and use participant-based authorization instead.
|
||
|
||
### Default Role Permission Values
|
||
|
||
| Role | Hex | Permissions |
|
||
| --------- | ------------ | ------------------------------------------------------------------------------------ |
|
||
| Owner | `0x7FFFFFFF` | Everything including ADMINISTRATOR |
|
||
| Admin | `0x3FFFFFFF` | Everything except ADMINISTRATOR |
|
||
| Moderator | `0x002FFFFF` | All message + voice + moderation, plus `MENTION_EVERYONE` (granted by migration 022) |
|
||
| Member | `0x1E63` | Send, read, attach, react, voice, video, screen share |
|