Open test

PDF to Word accuracy benchmark

How well does a free PDF to Word converter really work? We ran Altto through a public test of 200 real PDFs with hand-checked answers, and put the results next to 14 published scores from other converters. Here are the numbers, the method and the weak spots.

By James Sherratt · Tested 11 Oct 2026 · 6 min read

Result: Altto’s PDF to Word converter scored 0.884 out of 1 on 200 public PDFs (11 October 2026). That puts it level with Docling (0.882) and Nutrient (0.885), and behind OpenDataLoader’s hybrid mode (0.907). The others are developer tools; Altto is a free website with nothing to install, and your PDF never leaves your device.

The results

Each converter is scored on three things, each out of 1, where 1 is a perfect match with the hand-checked answer. Reading order checks that the text comes out complete and in the right order. Tables checks that tables come out as real tables with the right cells. Headings checks that headings are marked as headings, at the right level. Overall is the average.

opendataloader-bench, 200 PDFs · higher is better · Altto tested 11 Oct 2026, other scores as published by the benchmark
#ConverterOverallReading orderTablesHeadings
1OpenDataLoader (hybrid mode)
Open source, Apache-2.0
0.9070.9340.9280.821
2Nutrient
Commercial SDK
0.8850.9250.7080.819
3Altto PDF to Word
Free website (this site)
0.8840.9060.8620.831
4Docling (IBM)
Open source, MIT
0.8820.8980.8870.824
5OpenDataLoader (hybrid, Hydrogen)
Open source, Apache-2.0
0.8770.9260.7960.769
6Marker
Open source, GPL-3.0
0.8610.8900.8080.796
7OpenDataLoader (hybrid, Helium)
Open source, Apache-2.0
0.8450.8790.8070.755
8Unstructured (hi-res)
Open source, Apache-2.0
0.8410.9040.5880.749
9EdgeParse
Open source, Apache-2.0
0.8370.8940.7170.706
10OpenDataLoader
Open source, Apache-2.0
0.8310.9020.4890.739
11MinerU
Open source, AGPL-3.0
0.8310.8570.8730.743
12PyMuPDF4LLM
Open source, AGPL-3.0
0.7320.8850.4010.412
13Unstructured (fast)
Open source, Apache-2.0
0.6860.8820.0000.388
14MarkItDown (Microsoft)
Open source, MIT
0.5890.8440.2730.000
15LiteParse
Open source, Apache-2.0
0.5760.8660.0000.000

Reading order is scored on all 200 PDFs, tables on the 42 that contain tables, and headings on the 107 that contain headings. Scores for the other converters come from the opendataloader-bench repository (published April 2026); we did not re-run them. Download our per-document scores: pdf-to-word-benchmark.json.

What the numbers mean in practice

  • 112 of the 200 PDFs scored 0.9 or more with Altto: text in order, tables intact, headings recognised. These are mostly reports, papers, letters and forms.
  • 10 scored under 0.7. These are the pages to watch: posters set as one big picture, slides with text scattered across the page, and tables that are only a picture inside the PDF.
  • Averages hide differences. Altto and Docling have almost the same average, but document by document Docling did better on 109 PDFs and Altto on 63. Altto’s strength is headings and complete text; Docling is more consistent across odd layouts.

How Altto has improved

We use this test to find and fix problems in the converter, and we re-run it after each round of changes. The scores below are for the whole 200-PDF set.

Altto on opendataloader-bench over time · overall score out of 1
DateOverallWhat changed
1 Oct 20260.648First run. Headings came out as bold text, so the heading score was 0.
1 Oct 20260.788Real Word headings that other apps recognise too.
1 Oct 20260.811Tables drawn with only horizontal lines, merged table cells, page headers and footers in the right place.
2 Oct 20260.825Long ruled tables kept whole, row names beside tables kept, contents pages.
11 Oct 20260.884Ten days of real-world fixes: forms, posters, sideways pages, charts, two-column journals and more (see What’s new).

Altto vs iLovePDF on the hardest PDFs

The other converters in the table are developer tools, not websites, so on 1 October 2026 we also ran the 8 PDFs Altto then found hardest through iLovePDF’s free PDF to Word and scored both the same way. Altto kept tables (0.89 vs 0.76) and headings (0.58 vs 0.37) better; iLovePDF was slightly ahead on reading order (0.90 vs 0.88). The full write-up is in our iLovePDF comparison. We haven’t tested Smallpdf or Adobe Acrobat on this set yet; when we do, the results will go here.

Where Altto still struggles

  • Tables that are pictures. Some PDFs contain a table only as an image. Altto keeps the picture, so it looks right but the cells aren’t editable (and score 0 here).
  • Designed one-page posters and slides with text dotted around the page. Altto keeps the look, but the benchmark expects one reading order, and there often isn’t an obvious one.
  • Charts. Altto keeps charts as pictures, so their labels aren’t editable text. Some converters turn the labels into text, which scores better here even though the chart itself is lost.

Read this before quoting the numbers

  • We built and tested Altto on this set. Since 1 October we have used these 200 PDFs to find bugs, so Altto’s score here is probably kinder than its score on PDFs it has never seen. That’s why we also test on our own collection of real-world files (forms, bank statements, posters, journals) before every release.
  • Different outputs. Altto makes a Word file; the others make Markdown. To score Altto we turn its Word file into Markdown with pandoc, which can only lose detail, never add it. Pictures are removed before scoring for every tool.
  • Not the same date. The other converters were scored by the benchmark’s authors in April 2026 on the versions then current; newer versions may do better.
  • Looks aren’t scored. The test checks text, tables and headings, not fonts, colours or page layout, which matter a lot in a Word file.
How to repeat the test
  1. Download opendataloader-bench (200 PDFs, hand-checked answers and scoring code, Apache-2.0).
  2. Convert each PDF on the Altto homepage with the default settings. We used headless Chromium to do all 200 automatically; it took about 15 minutes.
  3. Turn each Word file into Markdown: pandoc -f docx -t gfm --wrap=none file.docx, and remove picture links.
  4. Put the Markdown files in prediction/altto/markdown and run python src/evaluator.py --engine altto.

Common questions

How accurate is Altto's PDF to Word converter?

On the 200 public PDFs of opendataloader-bench, tested on 11 October 2026, Altto scored 0.884 out of 1 overall: 0.906 for reading order, 0.862 for tables and 0.831 for headings. 112 of the 200 documents scored 0.9 or more, and 10 scored under 0.7.

Which converters were compared?

Altto and 14 published results from the benchmark itself: OpenDataLoader (four modes), Nutrient, Docling, Marker, MinerU, Unstructured (two modes), EdgeParse, PyMuPDF4LLM, MarkItDown and LiteParse. Their scores come from the benchmark repository; we did not re-run them. Smallpdf and Adobe Acrobat have not been tested yet.

Can I repeat the test myself?

Yes. The 200 PDFs, the hand-checked answers and the scoring code are public on GitHub (opendataloader-bench, Apache-2.0). Convert each PDF with the Altto homepage, turn the Word files into Markdown with pandoc, and run the benchmark's evaluator. Our per-document scores are in a downloadable JSON file on this page.

Does Altto upload my PDF to run the conversion?

No. The converter tested here runs in your browser on your own device, so the PDF is never uploaded. The test was run the same way, in a browser, with the same page visitors use.

The best test is still your own file. Try the PDF to Word converter: it runs in your browser, so your PDF never leaves your device.