mirror of
https://github.com/J3vb/OwnCord.git
synced 2026-09-03 03:50:00 +03:00
* refactor: move the protocol schema to protocol/schema.json (RL-09)
The WebSocket message-type schema is the one artifact in this repository that
neither component owns: `Server/ws/message_types.go` and
`Client/src/lib/protocolTypes.ts` are both generated from it, and neither may
be hand-edited. It nonetheless lived at `docs/protocol-schema.json` — filed
under the directory for prose, whose own README calls it "Reference" material
— and its generator lived at `Server/scripts/genprotocol/`, i.e. inside one of
the two consumers. Ownership was legible from neither location.
The obvious fix — move the generator to the repository root alongside the
schema, so the whole tool is at the cross-component boundary — is wrong here.
The generator is a Go `package main`, and Go modules are directory-rooted:
`Server/go.mod` roots at `Server/`, so a root-level Go program needs a second
module or a `go.work`. That second module would sit outside every path filter
this repository already has — `golangci-lint` runs with `working-directory:
Server/` (ci.yml), `go vet ./...` runs from `Server/` (scripts/run.mjs,
.githooks/pre-commit), `.githooks/pre-commit` selects Go files with
`^Server/.*\.go$`, `.githooks/pre-push` sets `server_changed` on `^Server/`,
setup-go caches on `Server/go.sum`, and dependabot has one gomod block for
`/Server`. Six gates would silently stop covering the generator, each failing
open. The schema is data and moves freely; the generator is Go and stays where
the Go toolchain already runs.
Done instead:
- `docs/protocol-schema.json` -> `protocol/schema.json`. A new top-level
`protocol/` is the cross-component boundary, with a `README.md` naming the
two generated consumers, the one command, and the four gates.
- `Server/scripts/genprotocol/` -> `Server/cmd/genprotocol/`, the module's
conventional home for an executable. This also empties `Server/scripts/` of
Go entry points except `seed.go`, which RL-10 moves next.
- `Server/cmd/` added to `Server/.dockerignore` and `Server/.air.toml`, which
both already excluded `Server/scripts/`. Without this the move would have
silently widened the Docker build context and the air watch set.
27 files, 115 insertions, 76 deletions. Two runtime path resolvers re-pointed
(`cmd/genprotocol/main.go:41` `-schema` default, `ws/protocol_contract_test.go:67`
`filepath.Join`); two git-hook grep patterns (`pre-commit:53`, `pre-push:57`);
eight generator call sites across five files (Makefile x2, scripts/run.mjs x2,
pre-commit x2, ci-check skill, bughunt-fix.js); two broken relative markdown
links (docs/README.md:47, docs/protocol.md:1497); two generated files
regenerated, header lines only, zero constants changed; two ledger prose hits
plus a `render-ledger.mjs` re-render. No new verify was written: the
regenerate-and-diff check is already enforced three times (CI `make
protocol-verify`, `.githooks/pre-commit`, `npm run check:server`) and
`ws/protocol_contract_test.go` independently checks the schema against the
constants a fourth time.
Verified: both directions, for both resolvers. With `protocol/schema.json`
removed, `go test ./ws/ -run TestProtocol` fails with `reading protocol schema
at /home/user/OwnCord/protocol/schema.json: no such file or directory` (two
tests) and `go run ./cmd/genprotocol` exits 1 with `read schema: open
../protocol/schema.json: no such file or directory`; with the file restored
both pass. So the new path is genuinely resolved, not merely spelled in a
comment. The hook patterns were exercised directly: the pre-commit pattern
matches `protocol/schema.json` and `Server/cmd/genprotocol/main.go` and no
longer matches `docs/protocol-schema.json`; the pre-push pattern matches
`protocol/schema.json`. `go run ./cmd/genprotocol` twice in a row leaves
`git diff --exit-code ws/message_types.go ../Client/src/lib/protocolTypes.ts`
clean, so the committed outputs are exactly what the generator emits.
`go build ./...` and `go vet ./...` pass; `npx prettier --check .`,
`npm run typecheck` and `npm run lint` pass; `node .superpowers/render-ledger.mjs
--check` reports 348 findings valid.
Not included: the four dated `docs/audit-*.md` files, the older
`docs/plans/*`, and `CHANGELOG.md` keep the old path — they are point-in-time
records, and `.prettierignore` and `scripts/check-doc-counts.mjs` already
treat them as deliberately unmaintained. The B1 plan itself keeps its own
wording, since it states intent rather than current state. `Server/scripts/`
is not deleted: it still holds `seed.go` (RL-10), `k6/`, `toxiproxy/` and two
shell scripts. `Server/telemetry/metrics.go:19` declares a scope for a
`Server/voice` package that does not exist — spotted here, unrelated to this
move, left for RL-13's sweep to carry forward verbatim rather than fixed
inside a relocation. No `seed:` Make target was added.
Refs RL-09, L-09
* refactor: move the seed tool under Server/cmd/seed (RL-10)
`Server/scripts/seed.go` was a `package main` sitting directly in
`Server/scripts/`, which made `Server/scripts` itself one of the module's
three main packages — a developer tool in the module's build graph under a
directory name that says "loose scripts". It also did filesystem work in
`func init()`: `os.MkdirAll("data", 0o750)` ran before `flag.Parse()`, so the
directory appeared even when the tool immediately refused to run.
The audit row (RL-10) claims that `init()` fires "during test discovery". It
does not, and the obvious fix aimed at that claim would be aimed at nothing:
`Server/scripts/` contains zero `_test.go` files, so Go never builds a test
binary there and `go test ./...` never runs the `init()`. The residual defect
is narrower and real — an untagged `package main` in the build graph, plus a
side effect on a path (`go run ./cmd/seed -h`) that has nothing to do with
tests.
Done:
- `Server/scripts/seed.go` -> `Server/cmd/seed/main.go`, joining
`cmd/genprotocol/` from RL-09. `Server/scripts/` now holds shell and JS
tooling only (docker-smoke.sh, k6/, toxiproxy/, voice-test.sh) and no Go
entry point at all.
- The `os.MkdirAll` moved out of `init()` to immediately before `db.Open` in
`main()` — the one call that needs the directory, since `db.Open` ->
`OpenWithMaxReaders` -> `openFile` creates no intermediate directories.
- The package doc comment's usage lines were wrong in two ways, not one: they
named `go run scripts/seed.go`, which no longer exists, and they omitted
the mandatory `-confirm-dev`, so neither documented command could ever have
run. Both corrected, and `seed.go is a standalone tool` became the
conventional `Command seed populates ...`.
- `Server/CLAUDE.md`'s Layout list now names `cmd/` and states that no Go
entry point lives in `scripts/`.
Two files, 20 insertions, 17 deletions. `go list` main packages go from
`{server, server/cmd/genprotocol, server/scripts}` to `{server,
server/cmd/genprotocol, server/cmd/seed}` — the count is unchanged at three,
which is the honest framing: this relocates a main package to a conventional
path, it does not remove one from the build graph.
Verified: both directions, by building the pre-change file and the
post-change file and running each in a fresh empty directory. Before, `seed`
with no flags exits 1 *and leaves a `data/` directory behind*; `seed -h`
exits 0 and also leaves `data/` behind. After, both exit the same way and
create nothing — `data/ exists=NO` in each case. The happy path is unchanged:
`seed -confirm-dev` in an empty directory creates `data/` at mode 0750,
writes `data/chatserver.db`, and reports 4 users / 5 channels / 31 messages;
a second run reports 0 new rows, so idempotence survives. The old documented
invocation now fails loudly (`go run scripts/seed.go` -> `stat
scripts/seed.go: no such file or directory`) and the new one is what the
comment says. All four build-tag variants compile, `go vet ./...` passes,
`gofmt -l` is clean outside `db/dbgen`, and `npx prettier --check .` passes.
Behaviour delta, called out rather than left silent: the two cases above
(`-h`, and a missing `-confirm-dev`) no longer create `./data`. That is a
change, not a pure relocation. It is the change RL-10 asks for — the remedy
text is "remove import/test-time filesystem side effects" — and the
alternative that preserves the old behaviour exactly, making the `MkdirAll`
the first statement of `main()` before `flag.Parse()`, would keep precisely
the side effect the item exists to remove.
Not included: `Server/scripts/genprotocol` was moved to `Server/cmd/` by the
RL-09 commit rather than here, so the "executable tooling under conventional
command ownership" class is closed across the two commits, not this one
alone. `filepath.Dir(*dbPath)` was evaluated for the `MkdirAll` and rejected:
it would fix a real gap (`-db /elsewhere/x.db` still creates a useless
`./data` and does not create `/elsewhere`) but it means creating an arbitrary
directory from CLI input, and that is a behaviour change past "shift it out
of `init()`" — worth its own item. No `make seed` target was added, and the
dated `docs/audit-*.md` rows naming `Server/scripts/seed.go` keep the old
path. The findings ledger has zero references to this file, so no re-render
was needed.
Refs RL-10, L-10
* test: give the cross-stack contracts a named tier (RL-11)
`Client/tests/unit/admin-static-channel-perms.test.ts` reads and executes
`Server/admin/static/index.html`. Filed under `tests/unit`, nothing about its
location or name said it locks a server-owned artifact, so a Go developer
editing the admin SPA got a red check called "Client Unit Tests" with no clue
why.
The register describes this as one file. It is not, and the measured set does
not match the description in either direction:
- Client -> Server: exactly ONE test crosses by filesystem read, not two.
`main-page.test.ts` was named in the plan but only carries a prose comment
citing `Server/admin/update_handlers.go:181` at line 1046 — no read, no
import, nothing to move.
- Server -> Client: the four tests the plan named do not cross.
`waf_test.go`/`waf_crs_test.go` set a `User-Agent: OwnCordClient/1.0`
literal that appears nowhere under `Client/`; `ws_integration_test.go:289`
and `sanitize_content_fuzz_test.go:46` are comments. The real crossing is
one the register never named: `Server/updater/updater_test.go:630` does
`os.ReadFile` on `Client/src-tauri/tauri.conf.json`.
The obvious fixes are both wrong. Moving the invariant "to the owning server
test" cannot work: `Server/go.mod` carries no JavaScript engine (no goja,
otto, v8go, quickjs, rogchap, duktape), so a Go port could only assert at the
text level like `admin/perm_grid_test.go` does — and that is not a
substitute. Flipping the guard at `admin/static/index.html:1182` to
`targetIsTouchedRole=false` reintroduces OC-0154 in full while leaving every
greppable identifier intact, so a text-level test passes on a broken file.
Relocating it to the e2e admin journey is worse: that job is
`continue-on-error: true` and deliberately unpinned ("requiring it is
theatre" — `docs/plans/b0-dev-branch-protection.sh`), so it would convert a
blocking, pinned gate into one that is green regardless. And the journey does
not cover the invariant today: `grep -Eic "perm|access|role|override|matrix"`
over its 142 lines returns 0, so the "if e2e already covers it, delete"
branch never fires.
Done — one tier, applied to the whole set, defined by artifact coupling and
placed by runtime capability:
- New `Client/tests/contract/`, holding
`server-admin-static-channel-perms.test.ts`. Same directory depth, so
`../../../Server/...` still resolves; the body is byte-identical apart from
a header naming the owner and the runner.
- `Server/updater/tauri_key_contract_test.go` splits the one cross-component
Go test out of `updater_test.go` verbatim, same `package updater`. It stays
in Go — placement follows capability, and Go parses JSON fine — so only the
file name has to declare the crossing. Without this the item would have
been "moved one file and declared the class closed".
- `npm run test:contract`, and the tier, the membership rule and a
blocking/non-blocking table in `docs/contributing.md#testing`, which
previously described no tiers at all.
- `Client/CLAUDE.md`'s tier list was missing `tests/e2e/admin` and
`tests/e2e/native` before this; it now lists all seven and states the rule.
`Server/CLAUDE.md` records why the SPA's execution-level invariant is
locked from the client tree, so nobody "fixes" it into a regex.
- Ledger `OC-0154.fix.test` re-pointed and `FINDINGS.md` re-rendered;
`.claude/workflows/bughunt.js` — the workflow that produced OC-0154 — no
longer describes the TS test surface as `tests/unit/*.test.ts` only.
- Three stale cross-stack pointers of exactly the class this item is about:
`tests/e2e/helpers.ts:348,351` and `tests/unit/types.test.ts:13` named
`docs/brain/06-Specs/PROTOCOL.md`, which does not exist (`docs/brain/` is a
gitignored path); all now name `docs/protocol.md`.
15 files, 125 insertions, 33 deletions. No CI job, workflow, vitest,
tsconfig, eslint, knip or stryker change, and no new pinned check —
`ci.yml`'s `npx vitest run --coverage` has no path filter and
`vitest.config.ts` includes `tests/**/*.test.ts`, so enforcement after the
move is bit-identical to enforcement before it. That is deliberate: `dev`
pins 11 contexts and a 12th is a branch-protection API write, not something a
PR can do, so any new job would be advisory until someone separately changed
repository settings — strictly less protection than today.
Verified: both directions, and the assertion was not weakened. Flipping
`admin/static/index.html:1182` to `const targetIsTouchedRole=false;` makes
the moved test fail (`AssertionError: expected 'DELETE' not to be 'DELETE'`);
`git checkout` of that file makes it pass again — so the invariant survived
the move intact rather than becoming a test that passes anywhere. The split
Go test's cross-boundary read is live too: with
`Client/src-tauri/tauri.conf.json` moved away, `go test ./updater/` fails
with `ReadFile(../../Client/src-tauri/tauri.conf.json): no such file or
directory` from `tauri_key_contract_test.go:20`, and passes once restored.
The full client suite is 192 files / 5257 tests passing, identical to the
count before the move; `npm run typecheck` passes, which proves
`tests/contract/` is inside the tsconfig graph and that `tests/types/jsdom.d.ts`
still resolves the moved test's `import { JSDOM }`. `npm run lint`,
`npx prettier --check .`, `go vet ./...` and `go test ./updater/` all pass.
`git grep "tests/unit/admin-static-channel-perms"` finds no survivor outside
the B1 plan itself.
Not included: nothing was deleted, because no e2e sibling covers OC-0154.
`Client/tests/types/jsdom.d.ts` was neither moved nor deleted — it is still
the only type source for the moved test's `jsdom` import. `capabilities-scope.test.ts`
and `tauri-conf-webview2-args.test.ts` read `src-tauri/` and stay in
`tests/unit`: `src-tauri` is inside the `Client` component, so they are not
contract tests, and the rule earns that rather than hand-waving it — moving
them would have forced repoints of ledger entry OC-0089 and
`docs/security.md:64` for no gain. Each gained a one-line header saying why.
`Server/admin/perm_grid_test.go` and `emoji_section_test.go` read their own
package's embedded asset and are unchanged; they are the text-level
complement to the execution-level test, not duplicates. No JS engine was
added to `go.mod`, no npm root was created under `Server/`, and no root-level
`tests/` tier was created — there is no runner for one and no way to make it
blocking from a PR. Separately noticed and NOT fixed here:
`docs/contributing.md:221` still says "All ten required checks" while
`docs/plans/b0-dev-branch-protection.sh` pins eleven since B1-3 added
`Repository Hygiene`, and `docs/plans/hp-0-scorecard-2026-08-25.md:109` is
stale the same way — that is the branch-protection item's to fix, not this
one's, and one register item per commit.
Refs RL-11, L-11
* refactor: rename the Go module to github.com/J3vb/OwnCord/Server (RL-13)
`Server/go.mod` declared `github.com/owncord/server` while the public
repository is `github.com/J3vb/OwnCord`. Nothing resolves that path — there is
no `owncord` GitHub org and no vanity-import host serving go-import metadata
for it — so every import line in the tree named a location that does not
exist. It compiles because a main module's own path is never fetched, which is
exactly why it went unnoticed.
The obvious fix — an AST-aware import rewriter (`gomvpkg`, `go mod edit`) —
is wrong here, and provably so. Six of the 722 occurrences are not imports at
all: `api/main_test.go:20` (a goleak `IgnoreTopFunction` pattern),
`telemetry/metrics.go:17-19` (three OTel instrumentation-scope names),
`invariants/syncutil_locks.go:73` (a diagnostic message), and
`invariants/syncutil_locks_test.go:56` (an import line inside a raw-string Go
fixture). An import rewriter touches none of them, and the compiler cannot
see any of them either.
Done as one scripted substitution over `git ls-files`, anchored on the full
`github.com/owncord/server` string. The anchor matters: `owncord-server` is a
different identifier — the OTel `service.name` (`config/config.go`,
`telemetry/telemetry_otel.go`) and the GHCR image name
(`.github/workflows/release.yml`, `docker-compose.yml`) — and a looser pattern
would have moved it. It is untouched: 10 occurrences across 9 files, before
and after.
350 files, 728 insertions, 728 deletions. 722 occurrences in 344 Go files,
plus `go.mod:1`, the `sed` at `Makefile:67`, `Server/CLAUDE.md:3`,
`docs/architecture/server.md:5`, and the ledger pair
(`findings-ledger.json:3758` plus a `render-ledger.mjs` re-render of
`FINDINGS.md`). Zero in any workflow, zero in the Dockerfile, zero in
`Server/.golangci.yml` (no `local-prefixes`, `gci`, `importas` or `depguard`
rule keys on the module path, so import grouping is not configured anywhere).
The plan's blast-radius estimate missed one thing, and it is the one that
would have gone red: **gofmt**. `J` (0x4A) sorts before every lowercase
letter, so in the 36 files where a module-local import shares a contiguous
group with a third-party one, the module's imports must move above
`github.com/go-chi/...`. `gofmt -l` was clean before the substitution and
listed exactly 36 files after it; `gofmt -w` on those 36 restores it to
clean. `gofmt` is an enforced gate — the `formatters` block in
`Server/.golangci.yml`, which is S-05 — so a substitution-only commit fails
Lint.
Verified: both directions, and the line accounting is exact. Every added line
in this diff contains the new module path (728) and every removed line
contains the old one (728); the count of changed lines containing neither is
**zero**, so the gofmt re-sort moved module-path lines only and touched no
third-party import. The residual check
(`git ls-files -z | xargs -0 grep -n 'github\.com/owncord/server'`) returns
exactly two hits, both deliberately out of scope: the RL-13 row in
`docs/audit-2026-08-23-repository-layout.md` and the measurement row in this
phase's own plan. The compiler-invisible half was proven by reverting *only*
`api/main_test.go:20` to the old path on the otherwise-renamed tree:
`go build ./...` and `go vet ./api/` both still pass — they see nothing wrong
— while `go test ./api/` FAILS, because the runtime function name now carries
the new path and goleak stops ignoring `ws.(*Hub).Run.func1`. Restoring the
line makes it pass. `go.sum` is byte-identical (no `go mod tidy` was run and
none was needed). All four build-tag variants compile; `go vet ./...`,
`go vet -tags otel,wazero ./...` and `go vet -tags deadlock ./...` pass;
`go test -race ./...` is 16/16 packages green; `go test -tags deadlock ./...`
passes; the tag-gated `./plugin/...` (wazero) and `./telemetry/...` (otel)
runs pass. `golangci-lint` v2.11.3 — the pinned CI version, rebuilt locally
against Go 1.26 because the packaged binary cannot load a 1.26 config —
reports **0 issues**. `go run ./cmd/genprotocol` leaves
`git diff --exit-code ws/message_types.go ../Client/src/lib/protocolTypes.ts`
clean, so the rename does not reach the generated protocol constants.
`npx prettier --check .` and `node .superpowers/render-ledger.mjs --check`
pass.
Not included: `docs/audit-2026-08-23-repository-layout.md` and
`docs/plans/b1-repository-foundation-2026-08-25.md` keep the old path — they
are the audit row and the measurement that motivated this change, and
rewriting them would erase the record of what was measured. They are why the
residual check needs a two-path allowance rather than being empty; that
allowance is stated above rather than hidden in a pathspec.
`telemetry/metrics.go:19` declares `scopeVoice` for a `Server/voice` package
that does not exist; the substitution carried the dead path forward verbatim
as `github.com/J3vb/OwnCord/Server/voice` rather than fixing it, because
correcting a real observability bug inside a mechanical rename would hide it
in a 350-file diff. It needs its own item. No `go.work`, no second module,
and no vanity-import host was set up — the new path resolves against the real
repository, but nothing imports this module as a library, so `go get`
reachability was not exercised either way.
Refs RL-13, L-12
---------
Co-authored-by: Claude <noreply@anthropic.com>
475 lines
17 KiB
Go
475 lines
17 KiB
Go
package api
|
||
|
||
import (
|
||
"database/sql"
|
||
"errors"
|
||
"image"
|
||
_ "image/gif"
|
||
_ "image/jpeg"
|
||
_ "image/png"
|
||
"io"
|
||
"log/slog"
|
||
"mime"
|
||
"net/http"
|
||
"path/filepath"
|
||
"strings"
|
||
"time"
|
||
"unicode"
|
||
"unicode/utf8"
|
||
|
||
"github.com/J3vb/OwnCord/Server/auth"
|
||
"github.com/J3vb/OwnCord/Server/db"
|
||
"github.com/J3vb/OwnCord/Server/permissions"
|
||
"github.com/J3vb/OwnCord/Server/service"
|
||
"github.com/J3vb/OwnCord/Server/storage"
|
||
"github.com/go-chi/chi/v5"
|
||
"github.com/google/uuid"
|
||
)
|
||
|
||
// uploadResponse is the JSON shape returned by POST /api/v1/uploads.
|
||
type uploadResponse struct {
|
||
ID string `json:"id"`
|
||
Filename string `json:"filename"`
|
||
Size int64 `json:"size"`
|
||
Mime string `json:"mime"`
|
||
URL string `json:"url"`
|
||
Width *int `json:"width,omitempty"`
|
||
Height *int `json:"height,omitempty"`
|
||
}
|
||
|
||
// sanitizeUploadFilename cleans an upload filename: strips control and
|
||
// invisible formatting characters, removes path separators, and truncates to a
|
||
// safe length.
|
||
func sanitizeUploadFilename(name string) string {
|
||
// Strip path components — use only the base name.
|
||
name = filepath.Base(name)
|
||
// filepath.Base only understands the *server* OS's separator, so a
|
||
// backslash survives on a Linux server and is then a path separator on the
|
||
// victim's Windows client, where the name is pre-filled into a save dialog.
|
||
if i := strings.LastIndexByte(name, '\\'); i >= 0 {
|
||
name = name[i+1:]
|
||
}
|
||
// Remove control characters, invisible formatting characters, and any
|
||
// residual forward slash.
|
||
var sb strings.Builder
|
||
for _, r := range name {
|
||
// unicode.Cf covers the bidi overrides (U+202A–U+202E, U+2066–U+2069):
|
||
// invisible characters that reorder how the name renders, so an
|
||
// attachment can display a harmless-looking extension to every other
|
||
// member of the channel while really being an executable script — and
|
||
// the same string is what the native save dialog pre-fills. This is the
|
||
// rule auth.ValidateUsername already applies to usernames.
|
||
//
|
||
// A forward slash is dropped too: filepath.Base("/") returns "/" (root
|
||
// is its own basename), so an upload literally named "/" would otherwise
|
||
// slip through the reserved-name check below with a path separator
|
||
// intact. Any residual '/' is unsafe as a basename, so strip it here.
|
||
if unicode.IsControl(r) || unicode.In(r, unicode.Cf) || r == '/' {
|
||
continue
|
||
}
|
||
sb.WriteRune(r)
|
||
}
|
||
name = strings.TrimSpace(sb.String())
|
||
// Truncate to the filesystem limit. Slicing by byte offset can land in the
|
||
// middle of a multibyte rune, so trim back to the last full rune to keep the
|
||
// result valid UTF-8 (an invalid name misbehaves in JSON encoding, on disk,
|
||
// and in the client's download-name handling).
|
||
if len(name) > maxUploadFilenameLength {
|
||
name = name[:maxUploadFilenameLength]
|
||
for len(name) > 0 && !utf8.ValidString(name) {
|
||
name = name[:len(name)-1]
|
||
}
|
||
}
|
||
if name == "" || name == "." || name == ".." {
|
||
name = "unnamed"
|
||
}
|
||
return name
|
||
}
|
||
|
||
// isUnsafeInlineMIME returns true for MIME types that could execute active
|
||
// content (scripts, markup) if served inline under the OwnCord origin.
|
||
func isUnsafeInlineMIME(mimeType string) bool {
|
||
// Normalize: take the base type before any parameters (e.g. "text/html; charset=utf-8").
|
||
base := strings.SplitN(mimeType, ";", 2)[0]
|
||
base = strings.TrimSpace(strings.ToLower(base))
|
||
switch base {
|
||
case "text/html", "application/xhtml+xml",
|
||
"image/svg+xml", "text/xml", "application/xml",
|
||
"application/pdf",
|
||
"text/xsl", "text/xslt":
|
||
return true
|
||
}
|
||
return false
|
||
}
|
||
|
||
// safeStorageErrorMessage maps a storage.Save error to a client-safe
|
||
// "upload rejected" body. Full detail always goes to slog.Warn at the call
|
||
// site — this only decides what crosses the HTTP boundary. storage.Save's
|
||
// failure messages are built with fmt.Errorf("... %s", dst) / %w around
|
||
// path-bearing OS errors (creating the file, syncing it, or the destination
|
||
// resolving outside the storage dir), so echoing them verbatim hands any
|
||
// authenticated user the server's absolute storage layout the moment a save
|
||
// fails (disk full, permission change, read-only mount). The two validation
|
||
// failures below are the only ones that never embed a path, so they're the
|
||
// only ones whose detail is forwarded.
|
||
func safeStorageErrorMessage(err error) string {
|
||
msg := err.Error()
|
||
switch {
|
||
case strings.HasPrefix(msg, "blocked file type:"),
|
||
strings.HasPrefix(msg, "file exceeds maximum size"):
|
||
return "upload rejected: " + msg
|
||
default:
|
||
return "upload rejected"
|
||
}
|
||
}
|
||
|
||
// writeStorageSaveError maps a storage.Save failure onto the right HTTP
|
||
// class: server-side filesystem failures (storage.ErrIO — disk full,
|
||
// permissions, read-only mount) become 507 so they are distinguishable from
|
||
// bad uploads in any status dashboard; everything else stays the client's
|
||
// 400. Detail never crosses the HTTP boundary either way (path leakage —
|
||
// see safeStorageErrorMessage).
|
||
func writeStorageSaveError(w http.ResponseWriter, saveErr error, what string) {
|
||
if errors.Is(saveErr, storage.ErrIO) {
|
||
slog.Error(what+" failed: server storage error", "error", saveErr)
|
||
writeJSON(w, http.StatusInsufficientStorage, errorResponse{
|
||
Error: "STORAGE_ERROR",
|
||
Message: "upload failed: server storage error",
|
||
})
|
||
return
|
||
}
|
||
slog.Warn(what+" rejected", "error", saveErr)
|
||
writeJSON(w, http.StatusBadRequest, errorResponse{
|
||
Error: "BAD_REQUEST",
|
||
Message: safeStorageErrorMessage(saveErr),
|
||
})
|
||
}
|
||
|
||
// MountUploadRoutes registers upload and file-serving endpoints.
|
||
// allowedOrigins controls the Access-Control-Allow-Origin header on served files.
|
||
//
|
||
// permSvc MUST be non-nil — handleServeFile dereferences it to enforce
|
||
// per-channel ACLs on every file download. A nil permSvc would panic for
|
||
// any authenticated file request, so we fail fast at mount time rather
|
||
// than let the first user hit a 500.
|
||
func MountUploadRoutes(r chi.Router, database *db.DB, store FileStore, limiter *auth.RateLimiter, allowedOrigins []string, permSvc *service.PermissionService) {
|
||
if permSvc == nil {
|
||
panic("api: MountUploadRoutes requires a non-nil PermissionService")
|
||
}
|
||
// Upload requires authentication and a higher body size limit (100 MB).
|
||
r.With(
|
||
AuthMiddleware(database),
|
||
MaxBodySize(uploadMaxBodySize),
|
||
).Post("/api/v1/uploads", handleUpload(database, store, limiter))
|
||
// File serving requires authentication for channel-level access control.
|
||
r.With(AuthMiddleware(database)).Get("/api/v1/files/{id}", handleServeFile(database, store, allowedOrigins, permSvc))
|
||
}
|
||
|
||
func handleUpload(database *db.DB, store FileStore, limiter *auth.RateLimiter) http.HandlerFunc {
|
||
return func(w http.ResponseWriter, r *http.Request) {
|
||
// BUG-131: Per-user upload rate limit to prevent disk exhaustion.
|
||
user, ok := r.Context().Value(UserKey).(*db.User)
|
||
if ok && user != nil {
|
||
uploadKey := auth.Key("upload", user.ID)
|
||
if !limiter.Allow(uploadKey, uploadRateLimitPerMinute, time.Minute) {
|
||
writeJSON(w, http.StatusTooManyRequests, errorResponse{
|
||
Error: "RATE_LIMITED",
|
||
Message: "upload rate limit exceeded, try again later",
|
||
})
|
||
return
|
||
}
|
||
}
|
||
|
||
// Limit request body size to prevent abuse.
|
||
r.Body = http.MaxBytesReader(w, r.Body, uploadMaxBodySize)
|
||
|
||
// Parse multipart form — 10 MB in memory, rest on disk.
|
||
if err := r.ParseMultipartForm(multipartMemoryLimit); err != nil {
|
||
writeJSON(w, http.StatusBadRequest, errorResponse{
|
||
Error: "BAD_REQUEST",
|
||
Message: "invalid multipart form",
|
||
})
|
||
return
|
||
}
|
||
|
||
file, header, err := r.FormFile("file")
|
||
if err != nil {
|
||
writeJSON(w, http.StatusBadRequest, errorResponse{
|
||
Error: "BAD_REQUEST",
|
||
Message: "missing file field",
|
||
})
|
||
return
|
||
}
|
||
defer file.Close() //nolint:errcheck
|
||
|
||
// Generate UUID for storage.
|
||
fileID := uuid.New().String()
|
||
|
||
// Detect MIME type from actual file bytes (never trust client header).
|
||
var sniffBuf [512]byte
|
||
n, readErr := file.Read(sniffBuf[:])
|
||
if readErr != nil && !errors.Is(readErr, io.EOF) && !errors.Is(readErr, io.ErrUnexpectedEOF) {
|
||
writeJSON(w, http.StatusBadRequest, errorResponse{
|
||
Error: "BAD_REQUEST",
|
||
Message: "failed to read uploaded file",
|
||
})
|
||
return
|
||
}
|
||
detectedMime := http.DetectContentType(sniffBuf[:n])
|
||
// Seek back so the full content is available for storage.
|
||
if _, seekErr := file.Seek(0, 0); seekErr != nil {
|
||
writeJSON(w, http.StatusInternalServerError, errorResponse{
|
||
Error: "INTERNAL_ERROR",
|
||
Message: "failed to process uploaded file",
|
||
})
|
||
return
|
||
}
|
||
mime := detectedMime
|
||
|
||
// Store file on disk (validates file type via magic bytes).
|
||
writtenBytes, saveErr := store.Save(fileID, file)
|
||
if saveErr != nil {
|
||
writeStorageSaveError(w, saveErr, "file upload")
|
||
return
|
||
}
|
||
|
||
// Extract image dimensions if the file is an image.
|
||
var width, height *int
|
||
if strings.HasPrefix(mime, "image/") {
|
||
f, openErr := store.Open(fileID)
|
||
if openErr == nil {
|
||
cfg, _, decErr := image.DecodeConfig(f)
|
||
f.Close() //nolint:errcheck
|
||
if decErr == nil {
|
||
w2, h2 := cfg.Width, cfg.Height
|
||
width = &w2
|
||
height = &h2
|
||
} else {
|
||
slog.Warn("failed to decode image dimensions", "id", fileID, "error", decErr)
|
||
}
|
||
}
|
||
}
|
||
|
||
// Insert attachment record in DB (unlinked — message_id is NULL).
|
||
user, _ = r.Context().Value(UserKey).(*db.User)
|
||
safeFilename := sanitizeUploadFilename(header.Filename)
|
||
if err := database.CreateAttachment(r.Context(), fileID, user.ID, safeFilename, fileID, mime, writtenBytes, width, height); err != nil {
|
||
// Clean up stored file on DB failure.
|
||
_ = store.Delete(fileID)
|
||
slog.Error("failed to create attachment record", "error", err)
|
||
writeJSON(w, http.StatusInternalServerError, errorResponse{
|
||
Error: "INTERNAL_ERROR",
|
||
Message: "failed to save attachment",
|
||
})
|
||
return
|
||
}
|
||
|
||
slog.Info("file uploaded", "id", fileID, "filename", safeFilename, "size", writtenBytes, "mime", mime)
|
||
|
||
writeJSON(w, http.StatusCreated, uploadResponse{
|
||
ID: fileID,
|
||
Filename: safeFilename,
|
||
Size: writtenBytes,
|
||
Mime: mime,
|
||
URL: "/api/v1/files/" + fileID,
|
||
Width: width,
|
||
Height: height,
|
||
})
|
||
}
|
||
}
|
||
|
||
func handleServeFile(database *db.DB, store FileStore, allowedOrigins []string, permSvc *service.PermissionService) http.HandlerFunc {
|
||
return func(w http.ResponseWriter, r *http.Request) {
|
||
fileID := chi.URLParam(r, "id")
|
||
if fileID == "" {
|
||
http.NotFound(w, r)
|
||
return
|
||
}
|
||
|
||
aa := serveFileResolve(w, r, database, fileID)
|
||
if aa == nil {
|
||
return
|
||
}
|
||
|
||
if !serveFileAuthorize(w, r, database, permSvc, aa, fileID) {
|
||
return
|
||
}
|
||
|
||
// Open file from storage.
|
||
f, err := store.Open(aa.StoredAs)
|
||
if err != nil {
|
||
http.NotFound(w, r)
|
||
return
|
||
}
|
||
defer f.Close() //nolint:errcheck
|
||
|
||
// Set headers before ServeContent to ensure correct MIME type.
|
||
w.Header().Set("Content-Type", aa.MimeType)
|
||
// BUG-118: Force download for MIME types that could execute content
|
||
// under the OwnCord origin (HTML, SVG, XML, PDF).
|
||
disposition := "inline"
|
||
if isUnsafeInlineMIME(aa.MimeType) {
|
||
disposition = "attachment"
|
||
}
|
||
w.Header().Set("Content-Disposition", mime.FormatMediaType(disposition, map[string]string{"filename": aa.Filename}))
|
||
// These downloads are access-controlled, so they must never be stored by
|
||
// shared/proxy caches (info-leak). Mark private and force revalidation.
|
||
// W3-4: no-cache forces revalidation on every use, so a max-age is dead
|
||
// weight alongside it — private + no-cache expresses the intent exactly.
|
||
w.Header().Set("Cache-Control", "private, no-cache")
|
||
// The Access-Control-Allow-Origin header below reflects the request
|
||
// Origin, so responses vary by Origin and must not be cross-served.
|
||
w.Header().Set("Vary", "Origin")
|
||
// CORS: allow webview to read the response body using configured origins.
|
||
if origin := r.Header.Get("Origin"); origin != "" {
|
||
for _, allowed := range allowedOrigins {
|
||
if allowed == "*" || strings.EqualFold(allowed, origin) {
|
||
w.Header().Set("Access-Control-Allow-Origin", origin)
|
||
w.Header().Set("Access-Control-Expose-Headers", "Content-Type, Content-Length")
|
||
break
|
||
}
|
||
}
|
||
}
|
||
|
||
w.Header().Set("X-Content-Type-Options", "nosniff")
|
||
|
||
// Use the actual file modification time so If-Modified-Since works correctly.
|
||
var modTime time.Time
|
||
if info, statErr := f.Stat(); statErr == nil {
|
||
modTime = info.ModTime()
|
||
}
|
||
http.ServeContent(w, r, aa.Filename, modTime, f)
|
||
}
|
||
}
|
||
|
||
// serveFileResolve looks up the attachment behind {id} and applies the checks
|
||
// that make a file unservable regardless of who is asking. It returns nil once
|
||
// it has written the response, so the caller only has to return.
|
||
func serveFileResolve(w http.ResponseWriter, r *http.Request, database *db.DB, fileID string) *db.AttachmentAccess {
|
||
// Look up attachment metadata with channel context.
|
||
aa, err := database.GetAttachmentWithChannel(r.Context(), fileID)
|
||
if err != nil {
|
||
slog.Error("failed to look up attachment", "id", fileID, "error", err)
|
||
writeJSON(w, http.StatusInternalServerError, errorResponse{
|
||
Error: "INTERNAL_ERROR",
|
||
Message: "internal server error",
|
||
})
|
||
return nil
|
||
}
|
||
if aa == nil {
|
||
http.NotFound(w, r)
|
||
return nil
|
||
}
|
||
|
||
// A soft-deleted message's attachments must stop being servable the
|
||
// moment the message is deleted — the client shows a tombstone, but
|
||
// without this check the file stays reachable by URL forever (no
|
||
// sweep can ever reclaim a linked row either, since the only reaper
|
||
// requires message_id IS NULL). Checked before the ACL branch so it
|
||
// also covers admins, matching the tombstone applying to everyone.
|
||
//
|
||
// Queried directly rather than through database.GetMessage: that
|
||
// wrapper's SELECT list carries every message column, and the
|
||
// `deleted` flag is the only one this check needs.
|
||
if aa.MessageID != nil {
|
||
var deleted bool
|
||
deletedErr := database.QueryRowContext(r.Context(),
|
||
`SELECT deleted FROM messages WHERE id = ?`, *aa.MessageID).Scan(&deleted)
|
||
switch {
|
||
case errors.Is(deletedErr, sql.ErrNoRows):
|
||
// No message row — leave ACL to decide (unlinked-shaped by now).
|
||
case deletedErr != nil:
|
||
slog.Error("failed to look up message for attachment", "id", fileID, "error", deletedErr)
|
||
writeJSON(w, http.StatusInternalServerError, errorResponse{
|
||
Error: "INTERNAL_ERROR",
|
||
Message: "internal server error",
|
||
})
|
||
return nil
|
||
case deleted:
|
||
http.NotFound(w, r)
|
||
return nil
|
||
}
|
||
}
|
||
|
||
return aa
|
||
}
|
||
|
||
// serveFileAuthorize decides whether the caller may read aa. It returns false
|
||
// once it has written the response, so the caller only has to return.
|
||
func serveFileAuthorize(w http.ResponseWriter, r *http.Request, database *db.DB, permSvc *service.PermissionService, aa *db.AttachmentAccess, fileID string) bool {
|
||
user, _ := r.Context().Value(UserKey).(*db.User)
|
||
role, _ := r.Context().Value(RoleKey).(*db.Role)
|
||
|
||
// ── Access control ──────────────────────────────────────────────
|
||
isAdmin := role != nil && permissions.HasAdmin(role.Permissions)
|
||
|
||
// DM participation is required of everyone, including admins — this
|
||
// matches every other DM read gate in the codebase (requireChannelRead,
|
||
// PermissionService.RequireChannelAccess, checkSendPermission), none of
|
||
// which have an admin bypass. Checked ahead of the `!isAdmin` block so
|
||
// the admin bypass below cannot skip it.
|
||
if aa.ChannelID != nil && aa.ChannelType == "dm" {
|
||
if user == nil {
|
||
writeJSON(w, http.StatusForbidden, errorResponse{
|
||
Error: "FORBIDDEN",
|
||
Message: "you do not have access to this file",
|
||
})
|
||
return false
|
||
}
|
||
ok, dmErr := database.IsDMParticipant(r.Context(), user.ID, *aa.ChannelID)
|
||
if dmErr != nil || !ok {
|
||
writeJSON(w, http.StatusForbidden, errorResponse{
|
||
Error: "FORBIDDEN",
|
||
Message: "you do not have access to this file",
|
||
})
|
||
return false
|
||
}
|
||
}
|
||
|
||
if !isAdmin {
|
||
if aa.ChannelID == nil {
|
||
// An unlinked attachment that some user's avatar points at is
|
||
// readable by every authenticated user: an avatar has to be
|
||
// visible to the people who see the messages it sits next to.
|
||
// The check is by the exact URL the column stores, so the file
|
||
// stops being public the instant the avatar is replaced.
|
||
isAvatar, avatarErr := database.IsAvatarFileURL(r.Context(), service.AvatarFileURL(fileID))
|
||
if avatarErr != nil {
|
||
slog.Error("failed to check avatar file", "id", fileID, "error", avatarErr)
|
||
}
|
||
switch {
|
||
case isAvatar:
|
||
// Public while in use — fall through to serving.
|
||
// Unlinked attachment — only the uploader may access.
|
||
// M-2: Legacy rows (NULL uploader_id) are now denied rather than
|
||
// served to any authenticated user.
|
||
case aa.UploaderID == nil:
|
||
slog.Warn("legacy attachment access denied (NULL uploader_id)", "id", fileID)
|
||
writeJSON(w, http.StatusForbidden, errorResponse{
|
||
Error: "FORBIDDEN",
|
||
Message: "you do not have access to this file",
|
||
})
|
||
return false
|
||
case user == nil || *aa.UploaderID != user.ID:
|
||
writeJSON(w, http.StatusForbidden, errorResponse{
|
||
Error: "FORBIDDEN",
|
||
Message: "you do not have access to this file",
|
||
})
|
||
return false
|
||
}
|
||
} else if aa.ChannelType != "dm" {
|
||
// Linked attachment in a guild channel — check channel
|
||
// permissions. The DM case is handled unconditionally above.
|
||
if user == nil || !permSvc.HasChannelPerm(r.Context(), user.ID, *aa.ChannelID, permissions.ReadMessages) {
|
||
writeJSON(w, http.StatusForbidden, errorResponse{
|
||
Error: "FORBIDDEN",
|
||
Message: "you do not have access to this file",
|
||
})
|
||
return false
|
||
}
|
||
}
|
||
}
|
||
|
||
return true
|
||
}
|