BrowserSkill Files

What's Changed

• fix(geometry): unify cross-frame coordinates and screenshot conversion | 统一跨 frame 坐标与截图转换 by @Ljy-0827 in https://github.com/Tencent/BrowserSkill/pull/195
• refactor(observation): decouple DOM processing from capture orchestration | 解耦 DOM 处理与采集流程 by @Ljy-0827 in https://github.com/Tencent/BrowserSkill/pull/198
• refactor(observation): unify cross-frame capture coordination and data ownership | 统一跨 frame 采集协调与数据归属 by @Ljy-0827 in https://github.com/Tencent/BrowserSkill/pull/200
• fix(observation): validate DOM identity across capture phases | 校验跨采集阶段的 DOM 身份一致性 by @Ljy-0827 in https://github.com/Tencent/BrowserSkill/pull/203
• fix(geometry): preserve OOPIF scale with occupied scrollbars by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/206
• feat(interaction): add explicit focus and blur primitives by @NianJiuZst in https://github.com/Tencent/BrowserSkill/pull/126
• feat(interaction): add scroll-to-element primitive by @NianJiuZst in https://github.com/Tencent/BrowserSkill/pull/127
• fix(skill): preserve custom installed instructions by @NianJiuZst in https://github.com/Tencent/BrowserSkill/pull/20
• feat(interaction): add real mouse-wheel primitive by @NianJiuZst in https://github.com/Tencent/BrowserSkill/pull/128
• feat(i18n): add Korean localization by @dr-coton in https://github.com/Tencent/BrowserSkill/pull/161
• feat(extension): make the local daemon port configurable in the popup by @shnpd in https://github.com/Tencent/BrowserSkill/pull/175
• fix(daemon): verify IPC for discovery and process management by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/221
• Support host-managed daemons in sandboxed agents by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/223
• fix(installer): resolve Windows installation and upgrade failures by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/208
• feat(audit): add local task execution history by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/224
• fix(client): guard observationTabOpen against a missing right-column tree (DSH 0.1.5 / better-sidebar 0.19+) by @hZsFN in https://github.com/Tencent/BrowserSkill/pull/231
• feat: add browser automation settings and fix confirmation waits by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/225
• feat(vom): discover canvas candidates and resolve visible regions | 发现 canvas 候选并计算可见区域 by @Ljy-0827 in https://github.com/Tencent/BrowserSkill/pull/205
• feat(vom): add typed visual refs and target identity validation | 支持类型化视觉 ref 与目标身份验证 by @Ljy-0827 in https://github.com/Tencent/BrowserSkill/pull/209
• feat(vom): support visible-region screenshots for canvas visual refs | 支持按 Canvas visual ref 截取可见区域 by @Ljy-0827 in https://github.com/Tencent/BrowserSkill/pull/211
• feat(vom): expose canvas visual refs in observations with cursor continuation | 在观察结果中呈现 Canvas 视觉入口并支持过多内容时翻页 by @Ljy-0827 in https://github.com/Tencent/BrowserSkill/pull/217
• feat(vom): support screenshot-bound point interactions on canvas regions | 支持基于截图坐标的 canvas 点选操作 by @Ljy-0827 in https://github.com/Tencent/BrowserSkill/pull/220
• Fix/canvas visual geometry by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/237
• feat: add full-page screenshots to extension and CLI by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/226
• feat(extension): add authenticated remote gateways and background task tabs by @lyingbug in https://github.com/Tencent/BrowserSkill/pull/227
• fix(dsh): use native sidebar with floating fallback by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/236
• docs: prepare 0.3.0 guidance and streamline browser skills by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/254
• fix: handle stalled and stale full-page captures by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/256
• fix: improve browser input readiness and observed form state by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/261
• docs: clarify remote setup and persistent daemon startup by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/263
• chore(release): prepare 0.3.0 by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/264
• perf(vom): avoid repeated sibling scans for duplicate action labels by @lyingbug in https://github.com/Tencent/BrowserSkill/pull/271
• fix(dsh-plugin): bound output draining after child exit by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/278
• fix(navigation): preserve readiness across cancelled redirects by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/280
• fix(bsk): keep controlled tabs progressing in background | 支持受控标签页在后台持续执行 by @Ljy-0827 in https://github.com/Tencent/BrowserSkill/pull/249
• fix(bsk): capture controlled tabs without activating them | 支持无需激活的受控后台标签页的视口截图 by @Ljy-0827 in https://github.com/Tencent/BrowserSkill/pull/250
• fix(bsk): support full-page screenshots of controlled background tabs | 支持受控后台标签页的整页截图 by @Ljy-0827 in https://github.com/Tencent/BrowserSkill/pull/253
• fix(cli): detach Windows daemons from caller pipes and jobs by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/282
• fix: make browser session starts recoverable by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/290
• fix(extension): bound request-help cleanup wait by @dvd233 in https://github.com/Tencent/BrowserSkill/pull/284
• fix(dsh-plugin): re-arm lazy tools from history after a plugin reload by @drakeo338 in https://github.com/Tencent/BrowserSkill/pull/283
• test(skill-install): serialize harness tests around the home env vars by @lyingbug in https://github.com/Tencent/BrowserSkill/pull/293
• docs(skill): say that page content is data, never instructions by @basil-k-aji-dev in https://github.com/Tencent/BrowserSkill/pull/289
• fix: improve explicit browser profile selection across CLI and DSH by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/298
• fix(record): record a page reload instead of dropping it as a same-URL navigation by @MaxFreedomPollard in https://github.com/Tencent/BrowserSkill/pull/184
• fix(extension): return visible labels from select by @MaxFreedomPollard in https://github.com/Tencent/BrowserSkill/pull/307
• fix(daemon): let navigation timeout results outlive the transport deadline by @lyingbug in https://github.com/Tencent/BrowserSkill/pull/291
• fix(dsh-plugin): settle runner promises when the child never emits close by @MaxFreedomPollard in https://github.com/Tencent/BrowserSkill/pull/183
• Split skill bundles into on-demand references with safe upgrades by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/310
• docs(skill): document prerequisites and link setup guide by @lyingbug in https://github.com/Tencent/BrowserSkill/pull/207
• feat(i18n): add 7 extension locales (zh-TW, ja-JP, fr-FR, it-IT, es-ES, de-DE, pt-BR) by @iAstro in https://github.com/Tencent/BrowserSkill/pull/248
• feat(debug): add persistent website diagnostics and network controls by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/295
• fix(extension): treat overlay host as the click blocker by @kevin9327 in https://github.com/Tencent/BrowserSkill/pull/299
• fix(extension): accept lowercase special keys in press by @kevin9327 in https://github.com/Tencent/BrowserSkill/pull/303
• fix(extension): treat ARIA loading tokens as case-insensitive by @kevin9327 in https://github.com/Tencent/BrowserSkill/pull/304
• feat(extension): add human-readable browser instance names by @imnemo in https://github.com/Tencent/BrowserSkill/pull/302
• feat(extension): answer remote gateway UI requests outside the tool queue by @lyingbug in https://github.com/Tencent/BrowserSkill/pull/296
• feat(extension): preserve observed popups while enabling task control by @lyingbug in https://github.com/Tencent/BrowserSkill/pull/297
• fix(extension): bound renderer reads and stop fallback reads after a timeout by @lyingbug in https://github.com/Tencent/BrowserSkill/pull/318
• fix(vom): preserve page actions beside nonmodal sidebars by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/324
• Fix full-page screenshots at fractional DPI and in inactive tabs by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/325
• fix(extension): prevent control overlay from swallowing clicks by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/323
• Fix screenshot tool cards on current DSH hosts by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/326
• Align DSH SDK dependencies with the current host by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/327
• chore(release): prepare 0.3.1 by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/328
• fix(cli): scope doctor skill status to bundled version by @Sthreal in https://github.com/Tencent/BrowserSkill/pull/329
• fix(extension): fix agent download capture for attachments opened in new tabs | 修复新标签页附件下载无法被 Agent 捕获 by @Ljy-0827 in https://github.com/Tencent/BrowserSkill/pull/259
• fix(extension): 用线性正则匹配 request-help 的 URL 完成条件 by @starsstreaming in https://github.com/Tencent/BrowserSkill/pull/322
• fix(record): keep recordings stoppable after a blob: tab opens | 修复打开 blob: 标签页后录制无法停止并卡死 by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/343
• fix(dsh-plugin): reconnect the observation stream after a fatal failure by @djtzemx in https://github.com/Tencent/BrowserSkill/pull/315
• fix(protocol): preserve explicit null results in ResponseFrame by @cyberspace-cs in https://github.com/Tencent/BrowserSkill/pull/287
• fix(download): preserve dispatched effects when the trigger fails by @NianJiuZst in https://github.com/Tencent/BrowserSkill/pull/351
• fix(emulate): scope remembered overrides to the session and attachment by @NianJiuZst in https://github.com/Tencent/BrowserSkill/pull/352
• fix(click): emit every press in a DOM multi-click sequence by @NianJiuZst in https://github.com/Tencent/BrowserSkill/pull/353
• fix(download): bound trigger lifetime and retire cancelled input by @NianJiuZst in https://github.com/Tencent/BrowserSkill/pull/354
• docs(skill): add preflight guidance for parallel tasks by @xiyanjun in https://github.com/Tencent/BrowserSkill/pull/152
• fix(extension): ignore stale overlay state by generation by @kevin9327 in https://github.com/Tencent/BrowserSkill/pull/300
• fix(input): harden readiness around persistent background leases by @lymerin in https://github.com/Tencent/BrowserSkill/pull/311
• fix(daemon): report a connected extension that cannot run commands by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/319
• fix(update): keep Windows daemons serving across self-update by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/346
• fix(dsh-plugin): support DSH 0.2 hosts by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/365
• fix(extension): explain why profile instructions cannot be copied by @WhyBusyy in https://github.com/Tencent/BrowserSkill/pull/360
• feat(extension): simplify browser profile controls by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/369
• fix(debug): redact HTML-encoded sensitive input attributes by @MakerFlyFly in https://github.com/Tencent/BrowserSkill/pull/368
• fix(dsh-plugin): allow browser starts after ancestor archival by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/371
• fix: guide WorkBuddy and CodeBuddy daemon startup by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/372
• chore(release): prepare 0.3.2 by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/375
• fix(input): restore a dropped background lease before hidden input by @ArcueidMP in https://github.com/Tencent/BrowserSkill/pull/374
• feat(cli): list connected browsers when a selector matches nothing by @PerryLink in https://github.com/Tencent/BrowserSkill/pull/313
• fix(download): detect ignored transfer directory by @lymerin in https://github.com/Tencent/BrowserSkill/pull/362
• fix(extension): avoid fetching nonexistent overlay CSS by @KennyMcSimpson in https://github.com/Tencent/BrowserSkill/pull/403
• fix(extension): preserve Yandex debugger across tab and session cleanup by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/410
• feat: add wait_for_element tool and related waits improvements by @klren0312 in https://github.com/Tencent/BrowserSkill/pull/407
• feat: add task-tab video recording and MP4 export by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/412
• fix(video): select AVC level for larger capture frames by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/417
• feat(dsh): expose element condition waits by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/414
• fix(extension): restrict fill to editable controls and editor roots by @kevin9327 in https://github.com/Tencent/BrowserSkill/pull/301
• ci: sign Windows CLI releases through BlueKing by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/448
• feat(extract): export tables and lists as JSON/CSV with provenance by @NianJiuZst in https://github.com/Tencent/BrowserSkill/pull/382
• fix(dsh)!: namespace BrowserSkill tools and recover failed activation by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/446
• feat: background agent windows with external link routing by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/447
• fix(cli): exit 4 when navigate lifecycle wait times out by @Li-john1021 in https://github.com/Tencent/BrowserSkill/pull/442
• chore(release): prepare 0.3.3 by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/450
• feat: support opt-in incognito Agent Windows by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/467
• fix(evals): support cross-drive scaffold imports on Windows by @legend91019 in https://github.com/Tencent/BrowserSkill/pull/459
• fix(runners): preserve UTF-8 across child output chunks by @wcy12378 in https://github.com/Tencent/BrowserSkill/pull/469
• fix(cli): report argument errors through the --json contract by @ArcueidMP in https://github.com/Tencent/BrowserSkill/pull/411
• fix(extract): respect content-visibility hidden subtrees by @ch-z-hc in https://github.com/Tencent/BrowserSkill/pull/453
• docs: clarify windowless GUI host daemon startup by @huong8373tt-beep in https://github.com/Tencent/BrowserSkill/pull/473
• fix: stabilize browser input and file-transfer readiness by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/476
• feat: enable default human-agent browser collaboration by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/478
• ui: refine the orange cooperation card by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/479
• feat(dsh): expose opt-in incognito Agent Windows and harden runtime guards by @martinm86867-ops in https://github.com/Tencent/BrowserSkill/pull/472
• fix(extension): reduce idle overlay and Accessibility overhead by @NianJiuZst in https://github.com/Tencent/BrowserSkill/pull/408
• fix(dialog): let agents decide native JavaScript dialogs by @NianJiuZst in https://github.com/Tencent/BrowserSkill/pull/379
• fix: recover refs for JavaScript click listeners by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/482
• fix(dsh): restore observation sidebar auto-open on DSH 0.2.0+ by @wcy12378 in https://github.com/Tencent/BrowserSkill/pull/485
• fix(runners): advance fake timers past the Windows kill grace by @zhuhaoran291 in https://github.com/Tencent/BrowserSkill/pull/486
• ci: run DSH runner tests on Windows by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/491
• fix(remote): report authorization store contention as retryable on Windows by @cyberspace-cs in https://github.com/Tencent/BrowserSkill/pull/483
• ci: cover remote authorization and server tests on Windows by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/492
• feat(process): add structured issue forms for bug reports and feature requests by @legend91019 in https://github.com/Tencent/BrowserSkill/pull/464
• fix: stop selecting controls disabled during focus by @ch-z-hc in https://github.com/Tencent/BrowserSkill/pull/451
• fix(daemon): bound local WS connections and time out stalled upgrades by @wcy12378 in https://github.com/Tencent/BrowserSkill/pull/489
• docs: explain Windows named-pipe access denied for sandbox users by @NianJiuZst in https://github.com/Tencent/BrowserSkill/pull/498
• Fix/vom token estimate by @NianJiuZst in https://github.com/Tencent/BrowserSkill/pull/494
• fix(cooperation): stop live page text from refusing every action by @NianJiuZst in https://github.com/Tencent/BrowserSkill/pull/497
• Name recurring failure modes for agents (issue [#465]) by @Faisal-Fayaz in https://github.com/Tencent/BrowserSkill/pull/487
• fix: preserve primitive exception messages by @ch-z-hc in https://github.com/Tencent/BrowserSkill/pull/437
• fix(interaction): compose input events across shadow roots by @ch-z-hc in https://github.com/Tencent/BrowserSkill/pull/436
• fix(network): preserve request metadata for response body failures by @ch-z-hc in https://github.com/Tencent/BrowserSkill/pull/435
• test(video): stabilize playback checks and retain CI evidence by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/500
• fix(cooperation): tolerate media progress while preserving action guards by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/501
• fix(extension): preserve plus keys in keyboard chords by @MaxFreedomPollard in https://github.com/Tencent/BrowserSkill/pull/308
• fix(extension): generate wxt types during install so the documented checks work by @u7-u7 in https://github.com/Tencent/BrowserSkill/pull/499
• fix(extension): restore edge glow and unify control UI by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/505
• fix(extension): explain required daemon upgrades by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/506
• feat(extension): identify Agent Windows with orange tab groups by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/507
• feat(release): sign and notarize macOS CLI through BK-CI by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/508
• fix(evals): bound complete agent run IDs to the server limit by @u7-u7 in https://github.com/Tencent/BrowserSkill/pull/503
• fix(evals): escape relative scaffold import URLs by @u7-u7 in https://github.com/Tencent/BrowserSkill/pull/504
• docs: refresh bilingual README and add updated browser demos by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/509
• fix: end browser tasks when controlled tabs leave their window by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/510
• fix: address release readiness regressions by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/512
• feat: add native drag gestures with VOM targets by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/513
• feat: add click-move-click range selection and VOM state by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/516
• feat: save observations and add single-action step orchestration by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/517
• fix(dsh): expose drag and saved observation workflows by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/520
• chore(release): prepare 0.4.0 by @iuyo5678 in https://github.com/Tencent/BrowserSkill/pull/521

New Contributors

• @dr-coton made their first contribution in https://github.com/Tencent/BrowserSkill/pull/161
• @hZsFN made their first contribution in https://github.com/Tencent/BrowserSkill/pull/231
• @lyingbug made their first contribution in https://github.com/Tencent/BrowserSkill/pull/227
• @dvd233 made their first contribution in https://github.com/Tencent/BrowserSkill/pull/284
• @drakeo338 made their first contribution in https://github.com/Tencent/BrowserSkill/pull/283
• @basil-k-aji-dev made their first contribution in https://github.com/Tencent/BrowserSkill/pull/289
• @MaxFreedomPollard made their first contribution in https://github.com/Tencent/BrowserSkill/pull/184
• @kevin9327 made their first contribution in https://github.com/Tencent/BrowserSkill/pull/299
• @imnemo made their first contribution in https://github.com/Tencent/BrowserSkill/pull/302
• @Sthreal made their first contribution in https://github.com/Tencent/BrowserSkill/pull/329
• @starsstreaming made their first contribution in https://github.com/Tencent/BrowserSkill/pull/322
• @djtzemx made their first contribution in https://github.com/Tencent/BrowserSkill/pull/315
• @cyberspace-cs made their first contribution in https://github.com/Tencent/BrowserSkill/pull/287
• @lymerin made their first contribution in https://github.com/Tencent/BrowserSkill/pull/311
• @WhyBusyy made their first contribution in https://github.com/Tencent/BrowserSkill/pull/360
• @MakerFlyFly made their first contribution in https://github.com/Tencent/BrowserSkill/pull/368
• @ArcueidMP made their first contribution in https://github.com/Tencent/BrowserSkill/pull/374
• @PerryLink made their first contribution in https://github.com/Tencent/BrowserSkill/pull/313
• @KennyMcSimpson made their first contribution in https://github.com/Tencent/BrowserSkill/pull/403
• @Li-john1021 made their first contribution in https://github.com/Tencent/BrowserSkill/pull/442
• @legend91019 made their first contribution in https://github.com/Tencent/BrowserSkill/pull/459
• @wcy12378 made their first contribution in https://github.com/Tencent/BrowserSkill/pull/469
• @ch-z-hc made their first contribution in https://github.com/Tencent/BrowserSkill/pull/453
• @huong8373tt-beep made their first contribution in https://github.com/Tencent/BrowserSkill/pull/473
• @martinm86867-ops made their first contribution in https://github.com/Tencent/BrowserSkill/pull/472
• @zhuhaoran291 made their first contribution in https://github.com/Tencent/BrowserSkill/pull/486
• @Faisal-Fayaz made their first contribution in https://github.com/Tencent/BrowserSkill/pull/487
• @u7-u7 made their first contribution in https://github.com/Tencent/BrowserSkill/pull/499

Full Changelog: https://github.com/Tencent/BrowserSkill/compare/cli-v0.2.1...ext-v0.4.0