14 KiB
14 KiB
ROADMAP — full feature checklist
Living source of truth for what's done ✅, in progress 🚧, and planned ⬜. Every feature is
designed to be optional via flags (features={{ … }}) — a consuming project enables only what it wants.
Update this file as work lands. It is the authoritative cross-developer / cross-AI record.
Legend
✅ done & verified · 🚧 in progress · ⬜ planned · 🔑 needs an API key/paid plan
1. UI & theming
- ✅ macOS Photos shell: sidebar, top toolbar, content area, window chrome (optional)
- ✅ Sidebar: Library, Collections, Pinned (Favourites/Recently Saved/Map/Videos/Screenshots/People & Pets/ Recently Deleted w/ lock icon), Albums, Sharing (Shared Albums/Activity), Utilities, Projects
- ✅ Light mode · ✅ Dark mode · ✅ Semi-dark (glass dark sidebar + light content)
- ✅ macOS vibrancy/"glass": translucent backdrop-blur menus, sidebar, toolbar, Info panel & search dropdown
(theme-aware fills + hairline borders +
--apg-radius-menu);@supportsfallback to a solid fill wherebackdrop-filteris unavailable - ✅ Responsive desktop/laptop/tablet/mobile + ultra-narrow (Galaxy Fold ~280px); mobile drawer sidebar
- ✅ Theme switch control in UI (Light/Dark/Semi-Dark/System menu) · ⬜ optional weather-aware auto theme
- ✅ Theming via props: accentColor + borderRadius (CSS vars); ⬜ density/font presets
- ✅ Accessibility: focus traps in overlays, ARIA dialog roles, keyboard nav, reduced-motion, contrast (AA)
2. Library, viewing & navigation
- ✅ Library views: Years / Months / All Photos (Days grouping supported) — date/time grouping
- ✅ Collections (Memories, Pinned, Albums, People, Featured, Shared, Recent Days, Trips, Utilities, Objects)
- ✅ Adaptive responsive grid + zoom in/out, lazy images
- ✅ Lightbox photo viewer (prev/next, keyboard, actions) — 🚧 polish to 100% macOS parity
- ✅ Video player (native controls in lightbox) — 🚧 macOS-style custom controls/scrubber
- ✅ Multi-select (click toggles select/deselect; Select All ↔ Unselect All), Copy to Album + Move to Album (album views), keyboard shortcuts (⌘A, Delete, F, Esc, Space)
3. Albums
- ✅ Create / rename / delete / duplicate; nested folders; covers
- ✅ Add / remove / move items; "Remove from Album"
- ✅ Smart albums (rule engine): Favourites, Videos, Screenshots, RAW, Live, Panoramas, Recently Saved
- ✅ Object albums (auto, from detection) via the Objects browser → object focus
- ✅ People (auto, from face clustering) — populates the People & Pets view; click → person-focused grid
- ✅ Documents smart album (auto, from OCR
hasTextrule) — in sidebar + Collections - ⬜ "Copy into tag folder" materialized albums (e.g. a real "Table" album) — currently virtual via object focus
4. Import & capture
- ✅ Import via file browse + drag-and-drop (images & videos); accepted-type allow-list
- ✅ Reads dimensions / video duration; source auto-classification (camera/screenshot/download/social/scan/ai)
- ✅ Real EXIF extraction (GPS→location, DateTimeOriginal→capture date, Make/Model, lens, ISO) via
exifr - ✅ Custom camera: capture photo, record video (getUserMedia), front/back switch, rule-of-thirds grid
- ✅ Live annotation while capturing (shapes + measurement arrows; saved with the capture)
- ✅ Detailed metadata: format, extension, byte size, dimensions, lat/lon, date/time, source (Info panel)
- ✅ Geolocation detect on capture (Geolocation API, permission-gated, in the custom camera)
- ✅ Object detect on import AND capture → auto-tag + object albums (AIAnalyzer runs on new media)
5. Map & places
- ✅ Leaflet map, free tiles (OSM + Esri satellite), no API key
- ✅ Map / Satellite / Grid modes; markers for located media; markers re-sync on library change
- ✅ macOS thumbnail pins (photo cover + count badge + tail), zoom-aware clustering; tap a pin → that location's photos in a date-grouped sheet; any GPS item (incl. screenshots) pins automatically
- ✅ Grid tab = Memories mosaic: date sections, full-width auto-sliding hero + irregular varied tiles
- ✅ Mini-map in the photo info panel
- Note: demo seed intentionally locates ~half the photos; real photos populate via EXIF GPS (§4)
6. Editor (photo & video)
- ✅ Photo: Adjust (13 sliders), Filters (10 presets), Crop/Rotate/Flip — non-destructive
- ✅ Annotation layer: rectangle, ellipse/oval, line, arrow, double-arrow with center text (measurement, e.g. "12 cm"), text, freehand — with color; in gallery edit + read-only in lightbox
- ✅ Annotation in custom camera (live) and on video (markup layer in the video editor)
- ✅ Full video editor — Adjust, Filters, Trim, Markup (annotations), Overlay (composite an image), Audio (mute original + add a music track w/ volume); exports a new clip via canvas + MediaRecorder + WebAudio (free, no ffmpeg); Save (overwrite) or Save as Copy (pick album), Cancel-confirm — mirrors the photo editor
- ✅ Edited result persists (CSS-filter model + Gemini/canvas bakes; video bakes to a new webm)
- ✅ Save vs Save as Copy (overwrite the photo, or create a new copy and pick its album) + Cancel confirmation when there are unsaved edits (Escape too)
7. AI (all optional; free unless marked 🔑)
- ✅ Object detection — TensorFlow.js COCO-SSD, in-browser, no key. Powers tags/search/find-similar/Objects
- ✅ Generative editor — Gemini (Remove BG / Restore / Colorize / Replace Sky / prompt). 🔑 needs image-gen
quota (billing); free-tier key returns 429. Key is server-side only via
/api/ai/edit - ✅ Face detection + clustering → People —
@vladmandic/face-api(TF.js), in-browser, no key. Detects faces + 128-D descriptors during analysis; the SDK clusters them (lib/cluster.ts) into People. Click a person → library filters to their photos. Models lazy-loaded from jsDelivr (CSP-allow-listed). - ✅ OCR (tesseract.js, in-browser, no key) → text extracted per image, searchable (search a word printed inside a photo and it's found), feeds the Documents smart album. A per-word confidence filter rejects the gibberish tesseract emits for photos without text, so only real documents qualify.
- ✅ Semantic search "show me snowy mountains" — CLIP (transformers.js,
Xenova/clip-vit-base-patch16, in-browser, no key); image embeddings computed during analysis, query embedded on search, ranked by cosine and blended after keyword hits. Models from the HF CDN (allow-listed); ~512-D vectors persist with each item - ⬜ Captions (transformers.js BLIP or HF, free)
- ⬜ Pluggable Hugging Face provider option (Inference API / transformers.js)
7b. Advanced-features backlog (audited; prioritized — next candidates)
From a full feature audit vs. macOS Photos. HIGH = most-requested / highest value.
- ✅ Custom video player (glass scrubber, buffered/played, volume, PiP, fullscreen, keyboard)
- ⬜ HIGH — Lightbox zoom/pan (scroll / double-click / pinch) for detail viewing
- ⬜ HIGH — Editable metadata in the Info panel (caption, keywords/tags, title; bulk edit)
- ⬜ HIGH — Slideshow / Memories playback (auto-advance + Ken Burns transitions)
- ⬜ MED — Lightbox filmstrip of adjacent media; timeline scrubber to jump by date
- ⬜ MED — Keyboard-shortcut help modal (
?); album drag-to-reorder - ⬜ MED — Skeleton loaders on library load; selection-count bar inside the lightbox
- ⬜ LOW — Smart-album rule builder UI; materialized tag albums; print dialog; import-from-URL; undo/redo beyond the editor; true windowed virtualization
8. Backend & storage (all optional adapters)
- ✅ Default zero-config localStorage + IndexedDB adapter (
StorageAdapterinterface) - ✅ Supabase: Postgres (data) + Supabase Storage (blobs) adapter
(
apps/web/src/lib/adapters/supabaseAdapter.ts); imports/captures upload blobs viaputBlob; metadata in JSONB tables. Wired in the demo when env vars are set; falls back to localStorage otherwise. Rundocs/supabase-setup.sqlonce (creates tables + RLS + storage policy), then reload. 🔑 creds in.env.local. - ⬜ Alternate adapters documented as options: S3 / R2 / GCS / Azure / MinIO; Postgres/MySQL/SQLite/Mongo; Prisma/Drizzle; REST/GraphQL/WebSocket; NestJS/Fastify service; BullMQ/Redis workers; vector DB (Qdrant/Pinecone/Weaviate/Chroma) for semantic search
9. Search
- ✅ Text search (name, place, tag, detected object, source)
- ✅ Click-object → find every photo with it (object focus)
- ✅ OCR text search — words printed inside an image are matched by the normal search
- ✅ Natural-language semantic search (CLIP) — "looks like" matches blended after keyword hits (§7)
10. Cross-cutting
- ✅ Security: nonce CSP, headers, input validation, URL allow-list, server-only keys, sanitization
- ✅ Recycle bin (30-day), duplicate detection + merge, export/download + metadata
- ✅ Sharing: Share a photo / multiple / one-or-more albums → generates a copyable link (+ Download); Shared Albums (copy-link / revoke) + Activity feed of shares. Client-side share records (localStorage).
- ✅ Recently Deleted password lock: set/change/remove a password (Web Crypto SHA-256, device-local), sidebar lock↔unlock icon, lock screen prompts for the password; settable from the ⋯ menu or the trash header
- ✅ Lazy-load
@supabase/supabase-js(dynamic import) — /gallery first load trimmed 234 KB → 176 KB - ⬜ Performance: true windowing/virtualization for very large libraries (currently lazy + auto-fill)
- ✅ Docs: README +
docs/SETUP.md+docs/ARCHITECTURE.md+ this roadmap + project-localCLAUDE.md - ✅ Testing: Playwright e2e (manual runs); ⬜ automated CI suite
Web-meaningful UI (done 2026-06-29)
- ✅ "All Projects / App Store" (iOS-only) → "All Albums" overview (My Albums + Create + Recent Days).
- ✅ Sidebar Albums section: All Albums + New Album + user albums (indented).
New requests
- ✅ Advanced video editor (2026-07-07): multi-segment trim (keep several ranges, cut middles,
per-segment speed), image/watermark overlays that actually composite (bug fixed), text
overlays, keyframe animation (move/fade/scale/rotate over time), crop + 90° rotate + flips
for video, audio (mute/volume + music + master fade in/out), poster/thumbnail picker, and
export quality (480p/720p/1080p, fps). Built on a rewritten canvas+MediaRecorder timeline
engine (
lib/videoBake.ts+ sharedlib/videoTimeline.ts); no ffmpeg. Bake failures now surface a clear error instead of silently dropping edits. - ✅ Auto object smart albums (2026-07-07): one live smart album per detected object (Person, Car, Chair, Table…) in a new sidebar Objects section; Collections "Objects" cards open the album. Membership is resolved live; the album set refreshes on analysis completion.
- ✅ Upload / analysis / persistence fixes (2026-07-07): reliable file-picker ("Choose files"
button); uploaded photos now get the same AI analysis as captures (newest-first + drain-loop, no
starvation); versioning increments correctly and survives reload (load-path no longer strips
versions/comments); Save-as-Copy carries its own history; imports/captures persist durable URLs (no deadblob:after reload); Supabase setup now creates the publicmediabucket. - ✅ Free deployment guide —
docs/DEPLOY.md(Vercel + Supabase free tier) +docs/DEPLOY-MANUAL.md(no-Git manual upload: Vercel CLI / self-host Node / static export). - ✅ Swappable AI backend (no paid Gemini) —
docs/AI-SETUP.md: analysis (objects/faces/OCR/embeddings) + Remove Background already run FREE in-browser (no key); generative edits (/api/ai/edit) now pick a backend viaAI_EDIT_PROVIDER= local (own Stable Diffusion — free+private), huggingface (free token), or gemini, with anautofallback. - ✅ Versioning + Audit Log (photos and videos, 2026-07-02): every save appends a new version (v1 =
original, never overwritten); each version carries a human-readable audit log of what changed. Info panel →
Version history (per-version thumbnail preview, timestamp, expandable "What changed", Restore); sidebar
Versions & Audit view browses all edited/commented items. Persisted inline on
MediaItem→ Supabase JSONB. - ✅ Comments (photos and videos, 2026-07-02): threaded comments with author + timestamp, add/delete, shown
in the Info panel; persisted with the item. Author remembered locally (
apg:comment-author). - ✅ Editor straighten/tilt slider + ✅ interactive crop (free + fixed-ratio: Square/4:3/3:4/16:9/9:16/Original; square stays square while dragging) — bakes on Done (canvas) and uploads the result to Supabase Storage
- ✅ Search dropdown defaults: Recently Viewed / Recently Edited / Recently Added (focus the search box)
- ✅ Import existing IPTC/XMP keywords + location on import (exifr iptc+xmp)
- ✅ Local Remove Background (
@imgly/background-removal) — runs fully in-browser (WASM), no key; the editor's Remove BG uses it directly (Gemini not required). Other generative ops still use Gemini. - ✅ Info mini-map click → opens full Map centered on the photo; ✅ tag click → date-grouped images
- ✅ Camera annotations now applied to the captured still (saved); ✅ Undo/Clear in camera + editor
- ✅ Geolocation tagged on capture (prefetched, permission-gated); ✅ device info in capture EXIF
- ✅ Auto Camera + Screenshots albums (created on first capture/import of that source)
- ✅ Recycle bin: 30-day retention enforced (purge on load); restore/permanent-delete sync to Supabase
Suggested build order (remaining)
- ✅ Map/Annotation/EXIF/Info/Semi-dark/theming + ✅ Custom camera + ✅ web-meaningful UI (done 2026-06-29)
- ⬜ Supabase adapter (Postgres + Storage) ← next (needs creds; no localStorage reliance after)
- ⬜ Editor straighten + ratio crop; search defaults; import tags; local remove-bg; map/tag nav
- ⬜ Face clustering → People; OCR → Documents; semantic search (free, HF/transformers.js)
- ⬜ Video editor/annotations; macOS-parity viewer/player polish; perf virtualization; CI