Automate document analysis with Azure Form Recognizer using AI and OCR

Extract text automatically from forms, structured or unstructured documents, and text-based images at scale with AI and OCR using Azure’s Form Recognizer service and the Form Recognizer Studio. Build intelligent document processing apps using Azure AI services. Leverage pre-trained models or build your own custom models to help speed up app development with the SDK and APIs.  
Use a pre-built model for W2 forms
Build and train custom models to extract data from 1099, 1040, and W9 forms
Extract data from receipts with handwritten tips, in different languages, currencies, and date formats.
Bema Bonsu, from Azure's AI engineering team in Azure, joins Jeremy Chapman to share updates to custom app experiences for document processing.
► QUICK LINKS:
00:00 - Introduction
01:50 - Form Recognizer updates
03:27 - Extract data from tax forms
04:56 - Extract data from handwritten text and other languages
06:00 - Build and train custom models
08:27 - Extract data from unstructured docs
10:15 - Code behind custom apps
12:07 - Wrap up
► Link References:
Get started with Azure Form Recognizer Studio at aka.ms/formrecognizerstudio
Find out more about Contracts 365 and their services at: www.contracts365.com/
H&R Block and how they use Form Recognizer: techcommunity.microsoft.com/t...
► Unfamiliar with Microsoft Mechanics?
As Microsoft's official video series for IT, you can watch and share valuable content and demos of current and upcoming tech from the people who build it at Microsoft.
• Subscribe to our RUclips: / microsoftmechanicsseries
• Talk with other IT Pros, join us on the Microsoft Tech Community: techcommunity.microsoft.com/t...
• Watch or listen from anywhere, subscribe to our podcast: microsoftmechanics.libsyn.com...
► Keep getting this insider knowledge, join us on social:
• Follow us on Twitter: / msftmechanics
• Share knowledge on LinkedIn: / microsoft-mechanics
• Enjoy us on Instagram: / msftmechanics
• Loosen up with us on TikTok: / msftmechanics
#AzureAI #OpenAI #API #Azure

[@perryuploads776]

This is really wonderfull. This is like OCR next level. Hopefully we get a offline version, that would really be awesome. The AI trained datasets could be downloadable to download specific template for the user. Like how Word or Excel uses for online content and addons. Thanks Microsoft!

[@abhijithsugunan6768]

Is multipage extraction now available? Last time when I checked if the extracted information lies within two pages, it's not possible with custom model.

[@Abhisingh-cl9xm]

Is there any code snippet available

[@agodina]

Fantastic!! Thank you for sharing this.

[@MSFTMechanics]

Glad it helped!

[@user-tf9pu9ep8h]

I need this entire code to develop the application.Can i get the code? its very useful for my current project

[@julianlugod]

I hope this will be available offline. I am using Surface Pro 9 SQ3. I hope we can fully utilize with NPU processor.

[@efhalsey]

Is there a GitHub repo for the custom app demo'd?

[@petersmith8153]

Yes that would help us recreating it.. Will this be available?

[@og.m8582]

Great question

[@MountainBiky]

Hi Microsoft, I have a scenario where we'll be processing invoices and receipts, but we do not know their layout as they will come from a variety of unknown vendors. I'd like to to set the structure myself as to what data to etract such as "vendor name", "vehicle", "License Plate", etc. These invoices may reference these fields with another name, so I don't want form recogniser to start coming up with its own labelling each time. What service would I use in this scenario where I want to spec a structure and we have invoices/recipts coming in from unknown vendors so we can't train on them specifically?

[@TheBillionDollarSaaS]

Hi, we have a similar usecase. Would you interested in connecting?

[@danillopinheironeto]

@@TheBillionDollarSaaS @MountainBiky Hello, did you guys got any news about this?
I have the same usecase.

[@imranullah3097]

Really great guys. I recommend azure over aws. ❤ Love you 😊

[@srikark3532]

Super!

[@user-jq1fe1bq8t]

Bro i got manilla folders with scribble scrabble on them in NO set location. 😂 im so screwed. I don't think this will work

[@andonii46]

How is human validation handled?

[@MSFTMechanics]

You can build it into your workflow if needed. A good option would be to set thresholds using the confidence percentage.

[@andonii46]

@@MSFTMechanics shall it be built as a custom web app (for instance)?

[@notevencare3209]

So there is pre-built in human-in-the-loop functionality, line Google's Document AI has?

[@andonii46]

@@notevencare3209 It does not seem so...

[@ekkamailax]

Can the ai hallucinate?

[@kamaludeenmohamedbatcha3149]

Is this supporting Arabic language

[@mysterium364]

6:18