-
Notifications
You must be signed in to change notification settings - Fork 71
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
fix: fix duplicate title and heading + add e2e tests for html and docx (
#186) * add real e2e tests for html and docx Signed-off-by: Peter Staar <[email protected]> * updated the output of itxt Signed-off-by: Peter Staar <[email protected]> * reformatted the text Signed-off-by: Peter Staar <[email protected]> * fixed the tests Signed-off-by: Peter Staar <[email protected]> * fixed the tests (2) Signed-off-by: Peter Staar <[email protected]> * fixed the examples (1) Signed-off-by: Peter Staar <[email protected]> * fixed the output of the test Signed-off-by: Peter Staar <[email protected]> * updated the tests, moved the ground-truth Signed-off-by: Peter Staar <[email protected]> * moved the ground-truth data Signed-off-by: Peter Staar <[email protected]> * fixed the html tests Signed-off-by: Peter Staar <[email protected]> * restructure title fix (#187) Signed-off-by: Panos Vagenas <[email protected]> --------- Signed-off-by: Peter Staar <[email protected]> Signed-off-by: Panos Vagenas <[email protected]> Co-authored-by: Panos Vagenas <[email protected]>
- Loading branch information
1 parent
dda2645
commit f542460
Showing
49 changed files
with
13,737 additions
and
61 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
File renamed without changes.
Binary file not shown.
Binary file not shown.
File renamed without changes.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,12 @@ | ||
| item-0 at level 0: unspecified: group _root_ | ||
| item-1 at level 1: title: Introduction | ||
| item-2 at level 2: paragraph: This is the first paragraph of the introduction. | ||
| item-3 at level 2: section_header: Background | ||
| item-4 at level 3: paragraph: Some background information here. | ||
| item-5 at level 3: picture | ||
| item-6 at level 3: list: group list | ||
| item-7 at level 4: list_item: First item in unordered list | ||
| item-8 at level 4: list_item: Second item in unordered list | ||
| item-9 at level 3: ordered_list: group ordered list | ||
| item-10 at level 4: list_item: First item in ordered list | ||
| item-11 at level 4: list_item: Second item in ordered list |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,197 @@ | ||
| { | ||
| "schema_name": "DoclingDocument", | ||
| "version": "1.0.0", | ||
| "name": "example_01", | ||
| "origin": { | ||
| "mimetype": "text/html", | ||
| "binary_hash": 13782069548509991617, | ||
| "filename": "example_01.html" | ||
| }, | ||
| "furniture": { | ||
| "self_ref": "#/furniture", | ||
| "children": [], | ||
| "name": "_root_", | ||
| "label": "unspecified" | ||
| }, | ||
| "body": { | ||
| "self_ref": "#/body", | ||
| "children": [ | ||
| { | ||
| "$ref": "#/texts/0" | ||
| } | ||
| ], | ||
| "name": "_root_", | ||
| "label": "unspecified" | ||
| }, | ||
| "groups": [ | ||
| { | ||
| "self_ref": "#/groups/0", | ||
| "parent": { | ||
| "$ref": "#/texts/2" | ||
| }, | ||
| "children": [ | ||
| { | ||
| "$ref": "#/texts/4" | ||
| }, | ||
| { | ||
| "$ref": "#/texts/5" | ||
| } | ||
| ], | ||
| "name": "list", | ||
| "label": "list" | ||
| }, | ||
| { | ||
| "self_ref": "#/groups/1", | ||
| "parent": { | ||
| "$ref": "#/texts/2" | ||
| }, | ||
| "children": [ | ||
| { | ||
| "$ref": "#/texts/6" | ||
| }, | ||
| { | ||
| "$ref": "#/texts/7" | ||
| } | ||
| ], | ||
| "name": "ordered list", | ||
| "label": "ordered_list" | ||
| } | ||
| ], | ||
| "texts": [ | ||
| { | ||
| "self_ref": "#/texts/0", | ||
| "parent": { | ||
| "$ref": "#/body" | ||
| }, | ||
| "children": [ | ||
| { | ||
| "$ref": "#/texts/1" | ||
| }, | ||
| { | ||
| "$ref": "#/texts/2" | ||
| } | ||
| ], | ||
| "label": "title", | ||
| "prov": [], | ||
| "orig": "Introduction", | ||
| "text": "Introduction" | ||
| }, | ||
| { | ||
| "self_ref": "#/texts/1", | ||
| "parent": { | ||
| "$ref": "#/texts/0" | ||
| }, | ||
| "children": [], | ||
| "label": "paragraph", | ||
| "prov": [], | ||
| "orig": "This is the first paragraph of the introduction.", | ||
| "text": "This is the first paragraph of the introduction." | ||
| }, | ||
| { | ||
| "self_ref": "#/texts/2", | ||
| "parent": { | ||
| "$ref": "#/texts/0" | ||
| }, | ||
| "children": [ | ||
| { | ||
| "$ref": "#/texts/3" | ||
| }, | ||
| { | ||
| "$ref": "#/pictures/0" | ||
| }, | ||
| { | ||
| "$ref": "#/groups/0" | ||
| }, | ||
| { | ||
| "$ref": "#/groups/1" | ||
| } | ||
| ], | ||
| "label": "section_header", | ||
| "prov": [], | ||
| "orig": "Background", | ||
| "text": "Background", | ||
| "level": 2 | ||
| }, | ||
| { | ||
| "self_ref": "#/texts/3", | ||
| "parent": { | ||
| "$ref": "#/texts/2" | ||
| }, | ||
| "children": [], | ||
| "label": "paragraph", | ||
| "prov": [], | ||
| "orig": "Some background information here.", | ||
| "text": "Some background information here." | ||
| }, | ||
| { | ||
| "self_ref": "#/texts/4", | ||
| "parent": { | ||
| "$ref": "#/groups/0" | ||
| }, | ||
| "children": [], | ||
| "label": "list_item", | ||
| "prov": [], | ||
| "orig": "First item in unordered list", | ||
| "text": "First item in unordered list", | ||
| "enumerated": false, | ||
| "marker": "-" | ||
| }, | ||
| { | ||
| "self_ref": "#/texts/5", | ||
| "parent": { | ||
| "$ref": "#/groups/0" | ||
| }, | ||
| "children": [], | ||
| "label": "list_item", | ||
| "prov": [], | ||
| "orig": "Second item in unordered list", | ||
| "text": "Second item in unordered list", | ||
| "enumerated": false, | ||
| "marker": "-" | ||
| }, | ||
| { | ||
| "self_ref": "#/texts/6", | ||
| "parent": { | ||
| "$ref": "#/groups/1" | ||
| }, | ||
| "children": [], | ||
| "label": "list_item", | ||
| "prov": [], | ||
| "orig": "First item in ordered list", | ||
| "text": "First item in ordered list", | ||
| "enumerated": true, | ||
| "marker": "1." | ||
| }, | ||
| { | ||
| "self_ref": "#/texts/7", | ||
| "parent": { | ||
| "$ref": "#/groups/1" | ||
| }, | ||
| "children": [], | ||
| "label": "list_item", | ||
| "prov": [], | ||
| "orig": "Second item in ordered list", | ||
| "text": "Second item in ordered list", | ||
| "enumerated": true, | ||
| "marker": "2." | ||
| } | ||
| ], | ||
| "pictures": [ | ||
| { | ||
| "self_ref": "#/pictures/0", | ||
| "parent": { | ||
| "$ref": "#/texts/2" | ||
| }, | ||
| "children": [], | ||
| "label": "picture", | ||
| "prov": [], | ||
| "captions": [], | ||
| "references": [], | ||
| "footnotes": [], | ||
| "annotations": [] | ||
| } | ||
| ], | ||
| "tables": [], | ||
| "key_value_items": [], | ||
| "pages": {} | ||
| } |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,15 @@ | ||
| # Introduction | ||
|
|
||
| This is the first paragraph of the introduction. | ||
|
|
||
| ## Background | ||
|
|
||
| Some background information here. | ||
|
|
||
| <!-- image --> | ||
|
|
||
| - First item in unordered list | ||
| - Second item in unordered list | ||
|
|
||
| 1. First item in ordered list | ||
| 2. Second item in ordered list |
Oops, something went wrong.