Just Use Pydantic

Pydantic is great for data validation and parsing, giving us a much better option that standard for working with data in Python. In this video I will show you how to create Pydantic models from shopify product json where we don't want to include large amounts of the data. by adding in to our models only the fields we are interested in we can omit the rest of the data and avoid having to write and rewrite complex indexing and gets on our dictionary, improving readability and usage
Scraper API www.scrapingbe...

[@ericxls93]

Will try this! Thank you. I have use the Spotify rest, but somehow I find their API super convoluted… getting sales and refunds by day is an industry 🤦‍♂️

[@julians.2597]

it's great, but it very slow, by an order of magnitude more than plain classes, simple namespace, named tuples, dataclasses, attrs, etc.
So use it for parsing and validation for which it's made and great, but don't use it as a general purpose data structure.

[@graczew]

Good content as always. 👍👍👍

[@JohnWatsonRooney]

thanks mate i appreciate it

[@user-mh2zy2gs4w]

I have tried the same method using the dataclasses. I got issue that when declaring the `Product` dataclass, it requires to declare all the attributes in the JSON response, not just `ID` and `title` like in your example.

[@Julian-sn9vc]

Hi! Great video on scraping Shopify data into Pydantic Models! I'm considering using Pydantic with an API and SqlAlchemy for my project. Could you create a follow-up video on mapping Pydantic Models to SqlAlchemy models and then writing the data into a database? This would be incredibly helpful. Thanks!

[@JohnWatsonRooney]

Great thanks! Sure i will do a follow up to include sqla!

[@Hellbending]

Might be worth doing using fastAPI then ;)

[@hoeszyslak6989]

just save your self tons of quality of life issues and use attrs and cattrs instead of pydantic + you get good performance while still keeping your project entirely python... the new pydantic uses rust to solve some problems that attrs already solved ages ago. And it's more reliable because NASA uses it on it's mars rover.

[@bramjanssen8865]

Hey! I'm just starting to work with Python. I know this is not directly related to this video, but how do you "pretty print" those values in terminal?

[@JohnWatsonRooney]

I use the package “rich” to print - pip install rich, then in your code from rich import print, and then print() as normal

[@bramjanssen8865]

@@JohnWatsonRooney thnx alot!!

[@oerickmuller]

Awesome content, concise and helpful. Thanks!

[@HermannWinter]

excellent 👍

[@aktiecase]

this is so good, thank you

[@MrPsychoTreatment]

Hi John, great tutorial! Is there any reason to use Pydantic over Dataclasses?

[@AnthonyBecker9]

Pydantic gives you powerful data validation and error messages.

[@ErikS-]

brilliant example!

[@techatival]

Sholdn't be the price mapped to a float instead of a string?

[@yafethtb]

Can we do this with dataclasses instead?

[@JohnWatsonRooney]

Yes but you don’t get validation

[@yafethtb]

@@JohnWatsonRooney is it like __post_init in dataclasses?

[@user-mh2zy2gs4w]

I have tried the same method using the dataclasses. I got issue that when declaring the `Product` dataclass, it requires to declare all the attributes in the JSON response, not just `ID` and `title` like in your example.

[@ricardor8044]

What font do you use ? It looks so unique

[@SAMWELLFPS]

please do a Bet 305 odds and how to scrap it

[@roshansirohi3191]

I m not getting didi website data getting 501 response can u give me suggestions please

[@thebuggser2752]

Neat!

[@younesboukroun3060]

pwerful yeh

[@ZainAli-hq1gu]

upload the on your repo