{"id":2144,"date":"2022-12-13T20:00:16","date_gmt":"2022-12-13T11:00:16","guid":{"rendered":"https:\/\/bestpathresearch.com\/www\/?p=2144"},"modified":"2023-06-02T20:03:34","modified_gmt":"2023-06-02T11:03:34","slug":"202212131011","status":"publish","type":"post","link":"https:\/\/bestpathresearch.com\/en\/2022\/12\/13\/202212131011\/","title":{"rendered":"Publication of the paper \u201cExtending TrOCR for Text Localization-Free OCR of Full-Page Scanned Receipt Images\u201d"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-post\" data-elementor-id=\"2144\" class=\"elementor elementor-2144\" data-elementor-post-type=\"post\">\n\t\t\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-77096bde elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"77096bde\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-d066e99\" data-id=\"d066e99\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-22a28e13 elementor-widget elementor-widget-text-editor\" data-id=\"22a28e13\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<span class=\"text\">Best Path Research has published its latest research on End-to-end Optical Character Recognition (OCR) using state-of-the-art encoder-decoder transformer models on the arXiv academic paper repository at:\n<p class=\"top10px\"><\/p>\n<a href=\"https:\/\/arxiv.org\/abs\/2212.05525\">https:\/\/arxiv.org\/abs\/2212.05525<\/a>\n<p class=\"top10px\"><\/p>\nThe research was conducted primarily by Hongkuan Zhang, a PhD student at Nagoya University, who worked with us remotely as a research intern for 6 months in 2022.\n<p class=\"top10px\"><\/p>\nThe technique we developed together used a pre- trained encoder-decoder transformer model called \u201cTrOCR\u201d, which was developed and released by Microsoft, as the base model. Building on this strong baseline, we developed a novel method to \u201cfine-tune\u201d the base model on progressively larger image chunks until the model was being trained on whole receipt images.<\/span>\n\n\n\n<style>\/*! elementor - v3.13.3 - 28-05-2023 *\/<br \/>.elementor-widget-image{text-align:center}.elementor-widget-image a{display:inline-block}.elementor-widget-image a img[src$=\".svg\"]{width:48px}.elementor-widget-image img{vertical-align:middle;display:inline-block}<\/style>\n\n<img fetchpriority=\"high\" decoding=\"async\" src=\"https:\/\/bestpathresearch.com\/www\/wp-content\/uploads\/2022\/12\/post_img_ocr.png\" sizes=\"(max-width: 640px) 100vw, 640px\" srcset=\"https:\/\/bestpathresearch.com\/www\/wp-content\/uploads\/2022\/12\/post_img_ocr.png 1024w, https:\/\/bestpathresearch.com\/www\/wp-content\/uploads\/2022\/12\/post_img_ocr-300x182.png 300w, https:\/\/bestpathresearch.com\/www\/wp-content\/uploads\/2022\/12\/post_img_ocr-768x465.png 768w\" alt=\"\" width=\"640\" height=\"388\" \/>\n\n<span class=\"text\">\nWe used the SROIE English-language receipt dataset for our experiments and analyzed the effect of different image chunk sizes on the OCR error rate. This allowed the final model to take in whole images of receipts as input, without any kind of image pre-processing, such as image rectification or text detection, and output a string of text corresponding to what appeared on the receipt. The best results of 4.98% character error rate were obtained using chunks smaller than the whole image, due to the relatively small, fixed size of the \u201cpatch\u201d used by the base TrOCR model.\n<p class=\"top10px\"><\/p>\nWe believe that both this research work and this publication are a significant contribution to the state of the art, and demonstrates how Best Path Research works with research students to develop and advance technologies that benefit both the company and the student.\nBest Path Research is very happy to host interns to work on cutting-edge machine learning research and development projects and will pay a competitive salary to do so. If you are currently a student interested in pursuing an internship with us, please get in touch!\n<p class=\"top10px\"><\/p>\nKeywords: Optical Character Recognition (OCR), PyTorch, Encoder-Decoder Transformer Models, TrOCR, End-to-end Training, Fine-tuning, Collaboration, arXiv\n<\/span>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>Best Path [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_locale":"en_US","_original_post":"http:\/\/smartdemowp.com\/detox\/invalid-data-markup-did-cause-action-copy\/","footnotes":""},"categories":[27],"tags":[],"class_list":["post-2144","post","type-post","status-publish","format-standard","hentry","category-news_en","en-US"],"_links":{"self":[{"href":"https:\/\/bestpathresearch.com\/wp-json\/wp\/v2\/posts\/2144","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/bestpathresearch.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/bestpathresearch.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/bestpathresearch.com\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/bestpathresearch.com\/wp-json\/wp\/v2\/comments?post=2144"}],"version-history":[{"count":5,"href":"https:\/\/bestpathresearch.com\/wp-json\/wp\/v2\/posts\/2144\/revisions"}],"predecessor-version":[{"id":2149,"href":"https:\/\/bestpathresearch.com\/wp-json\/wp\/v2\/posts\/2144\/revisions\/2149"}],"wp:attachment":[{"href":"https:\/\/bestpathresearch.com\/wp-json\/wp\/v2\/media?parent=2144"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/bestpathresearch.com\/wp-json\/wp\/v2\/categories?post=2144"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/bestpathresearch.com\/wp-json\/wp\/v2\/tags?post=2144"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}