独立运营 · 不出售排名位置  · 我们怎么评估工具 →
Anclum 提交收录
C

chensirui3/FIling-agent

本站为独立目录,非该工具官网;下方信息取自其公开仓库。

Research agent that answers analyst questions from SEC filings using the XBRL API, filing search and a calculator. (原文为英文)

装之前:没有可直接复制的命令 · 许可证 MIT · 链接可访问

第一步:这条暂时没有可执行的下一步,可先看原仓库 https://github.com/chensirui3/FIling-agent

更新 2026-11-15
在 GitHub 查看 ↗链接已于 2026-11-17 核查 · HTTP 200 · 打开的是厂商自己的官网
★ 数取值
0 ★ · chensirui3/FIling-agent · 取自 GitHub 搜索 API · (2026-11-19 20:00:48 核对)
来源明细
从该仓库的 GitHub 页面直接读取 · 条目类型:开源项目
收录与活跃
收录于 2026-11-15 · 最近见到 2026-11-20 · 共见到 6 次 · 被 2 个来源列出
评分构成
综合分 203 · 2 个来源 · repo
常见问题(答案都来自我们的记录)
它适合谁 / 用来做什么?
我们把它归在这些标签下: 开源项目。标签来自条目自身,不是我们强加的分类。
谁维护它、还在更新吗?
仓库 chensirui3/FIling-agent;我们收录于 2026-11-15;最近见到 2026-11-20。这里没有"官方认证"或"质量评级"——我们只记录来源与时间。
README 原文(英文,未翻译) · 在 GitHub 读完整 README →

# Filing Research Agent

以下摘录自该仓库的 README(片段)

An agent that answers analyst questions about US public companies, such as "What is 3M's FY2018 capital expenditure?" or "Does 3M have a healthy quick ratio in Q2 FY2023?". It uses the SEC's XBRL financial-data API, search over filing text, and a calculator. It is graded on the open-source sample of FinanceBench.
The evaluation is the core of the project:
component metrics (retrieval recall, XBRL coverage)
attribution of each failure to retrieval, table reading or arithmetic
before/after scores with confidence intervals for every fix
The tools are also exposed as an MCP server.
> Status: complete. Headline results are below; docs/RESULTS.md has every run and docs/ERROR_ANALYSIS.md every failure.
## Results
The frozen system is Claude Opus 5.5 at medium effort, with filing search, page reading, SEC XBRL facts and a calculator. Each row is one run; 95% Wilson intervals are in parentheses.
| Evaluation | Full agent |
| FinanceBench dev (50 questions) | 96% (86–99%) |
| FinanceBench test (100) | 85% (76.7–90.7%); 88% after correcting 2 wrong golds and a judge error |
| Fresh benchmark: filings published after the model's training cutoff (114) | 100% (96.7–100%) |
| Fresh hard tier: segment figures, two-year changes, ratios without formulas (75) | 94.7% (87.1–97.9%); 98.7% counting the readings 3 ambiguous questions allowed |
A memorization check ran the same model closed book, with no tools and no documents, once on each kind of question:
| Memorization check | Closed book |
| FinanceBench dev (50 questions) | 80% |
| Fresh benchmark (114) | 0% (all refusals) |
FinanceBench is largely memorized. With no documents, the model answers 80% of dev questions, but none about filings published after its training cutoff. The fresh benchmark (docs/FRESH.md) is built from 38 post-cutoff 10-Ks and 10-Qs, with golds taken from the filings' own XBRL tags and checked against the SEC API.
The agent's accuracy is research, not recall. It scores 100% on the post-cutoff questions. It uses the XBRL API only when the figure exists nowhere else (23 of 25 two-year-change questions, against 2 of 114 in the first tier).
The SEC API alone answers most metric questions. The agent answered 34 of FinanceBench's 50 metric questions correctly without opening a filing, a lower bound on what the XBRL data covers.
Almost every failure is on the question side. Of 21 failures in 339 questions, 2 are agent errors (both used a source for the wrong period). The rest are unstated definitions, judgment calls, ambiguous questions, wrong golds and one judge error. There are no retrieval, table-reading or arithmetic failures.
The grading holds up. A blind human check of 40 judge verdicts found no lenient ones (32 of 32 "correct" verdicts agreed). Where the two differed, the judge had been the stricter.
The one measured fix was rejected. A prompt change targeting the period error fixed it, but dev dropped 96% → 90% on three judgment questions (p = 0.25). The pre-registered rule rejected it, and the negative result is reported.
The baseline ladder on dev shows where the accuracy comes from. Tools add 12 to 16 points over memory, a single search without follow-up does worse than memory, and the full agent is within one question of being handed the evidence pages (docs/RESULTS.md has the paired tests).
收录徽章(可选)
想把收录标记放进 README 就复制这行,可选,不影响收录。
[![Listed on Anclum](https://anclum.com/badge/listed.svg)](https://anclum.com/zh/s/chensirui3-filing-agent/)
来源
github · https://github.com/chensirui3/FIling-agent
按领域浏览
开源项目
收录来源
2 个独立来源
收录于
今天

更多条目

全部 1,875 →

所属领域与标签

每个标签都能点进去看同类的全部条目。数字是当前库里的真实条数。

浏览全部领域 →

← 返回索引