SafeOSGuardian
Experimental Supplemental Monitoring Tool
A free, lo-tech monitoring aid using standard webcams and microphones.
Designed for tech-savvy parents or those willing to learn. Portable by design.
This is NOT a replacement for human supervision
SafeOS Guardian is a supplemental experimental tool only. It cannot and should not replace direct human care and attention. Technology can fail. Always maintain proper supervision of children, pets, and elderly family members.
Takes less than 2 minutes · No account required
Built by Frame — the team behind AgentOS, the open-source agent runtime with cognitive memory, and Paracosm, an agent swarm simulation engine. Same local-first philosophy.
Lo-Tech & Portable
Uses standard webcams and microphones you already own. No special hardware required.
Supplemental Alerts
Get notified as a backup layer—never as your primary supervision method.
Privacy First
All processing happens locally on your device. Your data never leaves.
Deep learning, in your browser.
Every frame is screened by motion, audio, and pixel-change detectors running locally. When motion is detected, the frame is routed to on-device computer vision models: COCO-SSD spots objects, a Vision Transformer cross-checks ambiguous scenes. No uploads. No cloud round-trips. Tap any card to see the architecture underneath.
Real-time object detection
COCO-SSD · TensorFlow.js~5 MBMotion-gated object detection. When the per-frame pixel-diff detects movement, COCO-SSD spots people, pets, and 80+ object classes at 10–30 FPS on consumer hardware. Idle GPU when nothing's moving.
Real-time object detection
Motion-gated object detection. When the per-frame pixel-diff detects movement, COCO-SSD spots people, pets, and 80+ object classes at 10–30 FPS on consumer hardware. Idle GPU when nothing's moving.
- ▸Runs on TensorFlow.js with WebGL acceleration (WebGPU on supported browsers).
- ▸Bounding-box localization plus confidence scoring per class.
- ▸Frame buffer keeps the most recent 5–10 minutes; older frames are discarded automatically.
- ▸Configurable confidence thresholds per scenario (pets, baby, elderly).
Scene classification fallback
ViT-base · Transformers.js~89 MBWhen detection is ambiguous, a Vision Transformer cross-checks the scene to reduce false positives.
Scene classification fallback
When detection is ambiguous, a Vision Transformer cross-checks the scene to reduce false positives.
- ▸Hugging Face Xenova/vit-base-patch16-224 quantized for browser use.
- ▸Runs entirely client-side via Transformers.js — no inference API needed.
- ▸Loaded on demand and cached by the service worker after the first run.
- ▸Used as a tie-breaker, not a primary path, to keep latency low.
Visual fingerprinting for Lost & Found
Color + edge signatures< 1 KB / photoUpload 1–5 reference photos of a missing pet or person. The browser builds a perceptual fingerprint and samples the live feed at 1–2 FPS, matching each candidate frame by cosine similarity.
Visual fingerprinting for Lost & Found
Upload 1–5 reference photos of a missing pet or person. The browser builds a perceptual fingerprint and samples the live feed at 1–2 FPS, matching each candidate frame by cosine similarity.
- ▸32-bucket color histogram per reference photo.
- ▸Top-5 dominant colors via k-means clustering.
- ▸8×8 edge signature grid (Sobel-derived) for shape matching.
- ▸Aspect-ratio and size estimates for sanity-check matching.
- ▸Real-time cosine similarity against the live frame; configurable sensitivity.
Audio distress detection
Web Audio APINo model requiredA FFT-based analyzer listens for crying, barking, glass breaks, and prolonged silence — entirely in the browser.
Audio distress detection
A FFT-based analyzer listens for crying, barking, glass breaks, and prolonged silence — entirely in the browser.
- ▸Spectral analysis via the Web Audio API.
- ▸Configurable thresholds per scenario (infant cry, distress vocalizations, elderly fall sounds).
- ▸Optional Ollama / cloud LLM secondary classification when ambiguity is high.
- ▸Volume-ramping escalation: starts quiet, gets louder until you acknowledge.
Offline-first by design
PWA · Service workerDisconnect after first loadThe whole app is a Progressive Web App. After the first visit, every model and every page is cached. Pull the WiFi and it keeps running.
Offline-first by design
The whole app is a Progressive Web App. After the first visit, every model and every page is cached. Pull the WiFi and it keeps running.
- ▸Service worker caches the app shell, fonts, and model weights on first load.
- ▸Settings, alert history, and fingerprints persist locally in IndexedDB.
- ▸No origin server required — host the static `out/` folder on GitHub Pages, Netlify, or any CDN.
- ▸Optional API server is just that: optional. Only needed for SMS/Telegram fan-out or Ollama LLM bridging.
Your data never leaves
IndexedDB · No telemetry100% localFrames are analyzed in-place and discarded. Settings, alert metadata, and reference photos stay in your browser's storage.
Your data never leaves
Frames are analyzed in-place and discarded. Settings, alert metadata, and reference photos stay in your browser's storage.
- ▸Rolling video buffer trimmed to 5–10 minutes; older frames overwritten.
- ▸No analytics, no third-party trackers, no model-improvement uploads.
- ▸Blurred / anonymized previews for any optional human-review handoff.
- ▸All optional integrations (Twilio SMS, Telegram, Ollama) are opt-in and run server-side only when you choose to deploy them.
Verified by reading the source — see the client-side inference pipeline on GitHub →
Works 100% offline — server is optional
Full functionality with no server setup. All AI detection, local audio alerts, browser notifications, and data storage run entirely in your browser. Your data never leaves your device.
Optional API server — only needed for:
- SMS alerts via Twilio
- Telegram bot notifications
- Multi-device sync
- Ollama local LLM integration
Supplementary Use Cases
SafeOS provides additional awareness as a backup layer. It is NOT a replacement for human supervision, professional care, or proper security systems.
Baby Monitoring
Supplemental alerts for short naps
A supplementary alert layer for when you AND your infant are napping nearby. Provides audio cues if movement or sounds are detected — NOT a replacement for supervision.
- SUPPLEMENTARY ONLY — not a babysitter replacement
- Best for short naps when parent is also resting nearby
- Audio/visual alerts to wake you if needed
- +2 more features
Pet Care
Extra awareness for brief absences
A supplementary layer to get alerts about your pets during brief absences from the room. Play custom sounds when detected — but NEVER leave pets unattended for long periods.
- SUPPLEMENTARY ONLY — not a pet-sitter replacement
- Best for brief room absences (bathroom, quick errands)
- Custom sound recordings for pet recall
- +2 more features
Elderly Care
Supplemental wellness check-ins
A supplementary alert system for additional peace of mind. Get notified of extended inactivity — but this is NOT a replacement for proper care, medical monitoring, or regular check-ins.
- SUPPLEMENTARY ONLY — not a caregiver replacement
- Additional awareness layer, not primary care
- Inactivity alerts as backup notification
- +2 more features
Lost & Found
Aid in locating missing subjects
Upload a photo to help locate a missing pet or person. This is a supplementary search aid — continue active searching and contact authorities for missing persons.
- SUPPLEMENTARY SEARCH AID — not primary search method
- Helps increase coverage of search area
- Works with pets, people, and objects
- +2 more features
Security
Supplemental intruder awareness
A supplementary alert layer for home awareness. Provides motion/person alerts — but is NOT a replacement for proper security systems, locks, or professional monitoring.
- SUPPLEMENTARY ONLY — not a security system replacement
- Additional awareness layer for peace of mind
- On-device alerts (sound + browser notifications)
- +2 more features
Wildlife Watching
Observe backyard visitors
Capture wildlife activity in your yard. This is for observation and enjoyment — the AI detects animals and logs sightings for nature enthusiasts.
- Casual observation tool for nature lovers
- Animal detection and classification
- Motion-triggered recording
- +2 more features
Abuse prevention & rate limiting
We actively monitor for misuse patterns and inappropriate behavior. Users who attempt to abuse this service or use it in ways it's not intended will receive rate-limitation warnings and may be restricted from access.
Note: This service may be temporarily taken offline while we develop better safeguards. We are committed to responsible deployment and will not rush features that could enable harm.
Future optional service: we may offer an administrative service with higher-level alerts, manual operator controls, and enhanced AI/LLM integrations for users who choose to opt in. This service would be entirely optional and may involve usage-based costs. This is not live yet and will only be developed if community demand warrants it.
SafeOS Guardian will always be free. We will never charge for this humanitarian service. Ever.