Skip to content

feat(experimental): pointcloud agent encoding - #4226

Draft
hvent90 wants to merge 1 commit into
mainfrom
feat/exp/pointcloud-agent-encode
Draft

hvent90 wants to merge 1 commit into
mainfrom
feat/exp/pointcloud-agent-encode

Conversation

@hvent90

@hvent90 hvent90 commented Sep 19, 2026

Copy link
Copy Markdown
Contributor

description incoming

Adds dimos/experimental/agent_encode: PointCloud2.agent_encode answers named
geometric queries (overlap, closest, sweep), grid fields (height, distance,
masks, regions), renders (depth view, occupancy map, field map) and picking,
within a fixed response budget, with a guide for agents. Also an odometry
encoder on Odometry.
@codecov

codecov Bot commented Sep 19, 2026

Copy link
Copy Markdown

❌ 1 Tests Failed:

Tests completed Failed Passed Skipped
6124 1 6123 103
View the full list of 1 ❄️ flaky test(s)
dimos.e2e_tests.test_voice_browser::test_hold_to_talk_ships_a_decodable_recording[firefox]

Flake rate in main: 100.00% (Passed 0 times, Failed 4 times)

Stack Traces | 22.6s run time
voice_bridge = ('http://127.0.0.1:64059/', [])
fake_mic_page = <Page url='http://127.0.0.1:64059/'>

    def test_hold_to_talk_ships_a_decodable_recording(
        voice_bridge: tuple[str, list[AudioChunk]], fake_mic_page: Page
    ) -> None:
        url, chunks = voice_bridge
        chunks.clear()  # the module fixture is shared across both engines
        fake_mic_page.goto(url)
        mic = fake_mic_page.get_by_test_id("chat-audio_in-mic")
        # Enabled == transport connected; the manifest already placed the panel.
        expect(mic).to_be_enabled(timeout=120_000)
        expect(mic).to_have_attribute("data-state", "idle")
    
        mic.hover()
        fake_mic_page.mouse.down()
>       expect(mic).to_have_attribute("data-state", "recording", timeout=15_000)
E       AssertionError: Locator expected to have attribute 'recording'
E       Actual value: arming 
E       Call log:
E         - Expect "to_have_attribute" with timeout 15000ms
E         - waiting for get_by_test_id("chat-audio_in-mic")
E       
E       Aria snapshot:
E       - button "hold to talk": talk

chunks     = []
fake_mic_page = <Page url='http://127.0.0.1:64059/'>
mic        = <Locator frame=<Frame name= url='http://127.0.0.1:64059/'> selector='internal:testid=[data-testid="chat-audio_in-mic"s]'>
url        = 'http://127.0.0.1:64059/'
voice_bridge = ('http://127.0.0.1:64059/', [])

dimos/e2e_tests/test_voice_browser.py:104: AssertionError

To view more test analytics, go to the Test Analytics Dashboard
📋 Got 3 mins? Take this short survey to help us improve Test Analytics.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant