- https://github.com/open-world-agents/MediaRef: Pydantic media reference for images and video frames (with timestamp support) from data URIs, HTTP URLs, file URIs, and local paths. Features lazy loading and optimized batch video decoding.
- https://github.com/open-world-agents/ocap: ocap (Omnimodal CAPture) captures all essential desktop signals in synchronized format. Records screen video, audio, keyboard/mouse input, and window events.
- https://github.com/open-world-agents/open-world-agents: A versatile and efficient monorepo that embraces and grows multiple projects, containing all the essential building blocks for agent development.
- https://github.com/open-world-agents/owa-dataset-visualizer: Browser-based visualization tool for exploring OWAMcap datasets with synchronized playback of screen recordings and interaction events.
- https://worv-ai.github.io/d2e/: D2E: Scaling Vision-Action Pretraining on Desktop Data for Transfer to Embodied AI. Code will coming soon!
open-world-agents
Everything you need to build open-source multimodal desktop agents.
Pinned Loading
Repositories
Showing 10 of 10 repositories
-
- MediaRef Public
Portable frame-level media reference primitive — container-agnostic, fps-free, RFC-based. (uri, pts_ns) is the entire schema.
- open-world-agents Public
Everything you need to build state-of-the-art foundation multimodal desktop agent, end-to-end.
- owa-dataset-visualizer Public
Browser-based visualization tool for exploring OWAMcap datasets with synchronized playback of screen recordings and interaction events.
-
- staged-recipes Public Forked from conda-forge/staged-recipes
A place to submit conda recipes before they become fully fledged conda-forge feedstocks
-
- desktop-env Public
A real-time, high-frequency, real-world desktop environment that is suitable for desktop-based ML development (agents, world models, etc.)
Top languages
Loading…
Most used topics
Loading…