Artur Mukhamadiev f7895585d8 [pi][agent-browser] added agent-browser & pi configuration

:Release Notes:
- pi configuration do not configured to work with devtools mcp server

:Detailed Notes:
- Added configuration for agent-browser, but no good results was
  received. Seems like on a complex webpages like rutube.ru we could
  encounter several buttons which compacting to the identical nodes,
  leading to a problems with navigation
- agent-browser compaction of a11y tree seems to be a good starting
  point, but not sufficient

:Testing Performed:
- prompt: Launch <Movie> on rutube in both opencode and pi

:QA Notes:
-

:Issues Addressed:
-

2026-07-14 20:30:42 +03:00

2.6 KiB

Raw Permalink Blame History

name, description

name	description
ms-teams-tables	Insert, fill, or modify a table in the Microsoft Teams chat compose box using agent-browser. Covers the hidden toolbar overflow button and table picker. Use only when the user asks to create or edit a table in a Teams message.

MS Teams tables

Teams supports tables in the compose editor, but Insert table is hidden behind a formatting-toolbar overflow button.

Insert a table

Focus the editor.
Open formatting with agent-browser press Control+Shift+x or click “Show Formatting options”.
Inspect with agent-browser snapshot -i -c.
If the overflow control is not accessible by name, use a narrow DOM query. In the main .ms-FocusZone.ui-toolbar with more than ten buttons, the overflow button has historically been index 18 and aria-haspopup="dialog":

agent-browser eval '(() => { const tb=Array.from(document.querySelectorAll(".ms-FocusZone.ui-toolbar")).find(t=>t.querySelectorAll("button").length>10); const b=tb && Array.from(tb.querySelectorAll("button"))[18]; if (!b) return "overflow not found"; b.click(); return "clicked"; })()'

Take a fresh snapshot. Prefer a currently exposed button whose accessible name matches Insert N by M table; click its ref. If needed:

agent-browser eval '(() => { const b=Array.from(document.querySelectorAll("button")).find(x=>x.getAttribute("aria-label")==="Insert 3 by 3 table"); if (!b) return "not found"; b.click(); return "clicked"; })()'

The first table cell should receive focus.

Fill cells

Type into the focused cell and press Tab to move left-to-right, top-to-bottom:

agent-browser keyboard type 'A1'
agent-browser press Tab
agent-browser keyboard type 'B1'
agent-browser press Tab
agent-browser keyboard type 'A2'
agent-browser press Tab
agent-browser keyboard type 'B2'

Use Shift+Tab to move backward. Formatting shortcuts such as Control+b work inside cells.

Modify an existing table

When the caret is in a table, the toolbar may expose:

Insert column or row
Delete column, row, or table

Take a fresh snapshot and click the appropriate named control. Confirm destructive table deletion if the user's intent is unclear.

Verify

agent-browser eval '(() => { const e=document.querySelector("[role=textbox]"); const t=e && e.querySelector("table"); return JSON.stringify(t ? {rows:t.rows.length,cols:t.rows[0]?.cells.length||0,cells:Array.from(t.querySelectorAll("td")).map(c=>c.innerText.trim())} : null); })()'

Do not look for Insert table in Teams' Actions and apps menu; use the formatting toolbar overflow.

2.6 KiB Raw Permalink Blame History