{ "kind": "test", "record_id": "test:zcpidpi", "url": "https://headlesson.com/tests/zcpidpi", "app": { "id": "app:docling", "name": "Docling", "made_by_headlesson_operator": false, "url": "https://headlesson.com/apps/docling" }, "mcp_get": "headlesson_get id=\"app:docling\" sections [\"lesson\",\"gotchas\"]", "dates": { "tested": "2026-10-11", "record_confirmed": "2026-10-11", "note": "Elapsed days are not shown; judge age from these dates." }, "question": "Convert one owner-chosen local PDF and inspect the output.", "conclusion": "On 2026-10-11, the headlesson operator ran all 3 steps of this lesson with Docling 2.137.0 (macOS26.5.2 arm64; Python3.11.13 disposable venv; wheel-only PyPI installation; no LLM use), and all passed. The final Next step is advice and was not run. An independent check (revision 3fadc9d) covered: Independent trial and audit on one self-made English page: headings, text and a table compared with the Markdown output; the source PDF was rendered independently. Its limits: Sample-limited. Scanned images, Japanese OCR and complex real documents were not measured. This is the operator's own run, not a vendor claim.", "tested": { "date": "2026-10-11", "version": "2.137.0", "environment": "macOS26.5.2 arm64; Python3.11.13 disposable venv; wheel-only PyPI installation; no LLM use", "sample": "one born-digital English page (self-made)", "status": "passed", "steps_passed": 3, "steps_total": 3 }, "steps": [ { "step": "pip install docling", "result": "passed" }, { "step": "docling ./sample.pdf", "result": "passed" }, { "step": "Inspect the generated Markdown in the current directory against the original PDF.", "result": "passed" } ], "next_advice": "Next: Select the real document and output destination with the user, run docling , then compare text, tables and reading order with the original. Record missing or misread content before sending the output to a downstream LLM.", "cautions": { "note": "These notes come from the lesson. Some describe failures seen in tests; others are general cautions. Each one is not a separately tested result.", "items": [ "Python 3.10 or newer and an owner-provided sample.pdf are prerequisites; first use may download model assets.", "Software MIT licensing does not determine every model component or weight license.", "Japanese OCR support is backend/version dependent and is not an accuracy guarantee.", "Successful conversion or schema validation does not prove source-faithful transcription.", "Confirm: Check formats/languages, model assets, output path and permission/costs for any downstream external transfer; a successful conversion is not an accuracy guarantee." ] }, "not_shown": [ "Not measured in this run: scanned pages and Japanese OCR.", "Not measured in this run: multi-page documents and complex math.", "Not measured in this run: downstream LLM accuracy.", "Not measured in this run: the code license versus model-weight terms.", "Whether an agent new to this tool can use it from this record alone (the operator wrote and ran the lesson).", "Comparisons between models or clients.", "Production use, accounts, or real customer data.", "Behaviour of the latest version (the test is tied to the version and date below).", "The final \"Next\" step is advice and was not part of the test." ], "primary_record": "Operator record: a past lesson trial (legacy). It is not claimed to meet level L1 of run-task-contract/0.1.0.", "independent_check": { "state": "recorded", "revision": "3fadc9d6215b5a823c490dfc86f16d93dac683b2", "scope": "Independent trial and audit on one self-made English page: headings, text and a table compared with the Markdown output; the source PDF was rendered independently.", "limits": "Sample-limited. Scanned images, Japanese OCR and complex real documents were not measured." }, "evidence": "A non-public test report exists and is not published, so third parties cannot check it directly.", "source_version": { "record": "the catalog record app:docling at revision bc56389411af", "rule": "the revision after which the recorded test stayed unchanged" }, "sources": [ { "fields": [ "/question", "/steps/2/step", "/cautions/items/0", "/cautions/items/3" ], "source": "headlesson editorial judgement", "checked": "2026-10-09", "certainty": "inferred", "by": "editorial" }, { "fields": [ "/steps/0/step", "/steps/1/step" ], "source": "https://github.com/docling-project/docling/blob/main/README.md", "checked": "2026-10-09", "certainty": "primary", "by": "editorial" }, { "fields": [ "/next_advice", "/cautions/items/4" ], "source": "https://raw.githubusercontent.com/docling-project/docling/main/README.md", "checked": "2026-10-10", "certainty": "inferred", "by": "editorial" }, { "fields": [ "/cautions/items/1" ], "source": "https://github.com/docling-project/docling/blob/main/README.md", "checked": "2026-10-09", "certainty": "primary", "by": "official" }, { "fields": [ "/cautions/items/2" ], "source": "https://docling-project.github.io/docling/concepts/OCR/", "checked": "2026-10-09", "certainty": "primary", "by": "official" } ], "corrections": [], "withdrawn": null, "cite": "headlesson test:zcpidpi — Docling 2.137.0, 2026-10-11: 3/3 lesson steps passed (operator record). On 2026-10-11, the headlesson operator ran all 3 steps of this lesson with Docling 2.137.0 (macOS26.5.2 arm64; Python3.11.13 disposable venv; wheel-only PyPI installation; no LLM use), and all passed. The final Next step is advice and was not run. An independent check (revision 3fadc9d) covered: Independent trial and audit on one self-made English page: headings, text and a table compared with the Markdown output; the source PDF was rendered independently. Its limits: Sample-limited. Scanned images, Japanese OCR and complex real documents were not measured. This is the operator's own run, not a vendor claim. Sample tested: one born-digital English page (self-made). https://headlesson.com/tests/zcpidpi", "page_updated": "2026-10-13" }