Видео

Hello, thanks for this tutorial. At the very beginning, when trying to run the "dbt deps" command I'm getting this error : "Encountered an error loading local configuration: dbt_cloud.yml credentials file for dbt Cloud not found. Download your credentials file from dbt Cloud to `C:\Users\a.schirina\.dbt`". I'm using dbt command locally and my profiles.yml in the .dbt folder is data_pipeline: target: dev outputs: dev: type: snowflake account: jpb45436 # User/password auth user: alices password: mypassword role: dbt_role database: dbt_db warehouse: dbt_wh schema: dbt_schema threads: 4 client_session_keep_alive: False Does anyone know the problem?

Thank you for the video jayzern. When I push code into Git, should I push code of dbt only, or I need to push all code of dbt-dag ?

Best tutorial I've seen so far. Was confused between Glue and EMR for a future projects requiring big compute power with control over each node.

nice

Great guide bro...

Thank you brother

Thanks a lot for this tutorial

So to my understanding, the singular tests really mean to check if nothing is the result of the query been tested. If the test is true, then nothing equates to the query been tested - Great your data is fine. If false, you should run that query to see what exactly are those rows. Confusing at first but makes sense now.

What are the versions of pandas and matplotlib used in your project?

Garcia Michelle Davis Jose Jones Jason

very sincere and very true points, thank you very much

i am impressed with your video can you comment those books which you are referring , it will help me a lot.

Ziemann Bypass

Dagster is amazing but rather complex. This course is amazing!!

Thank you very much. This is very nice and concise tutorial, exactly what I need.

Thompson Timothy Lewis Anthony Lee Richard

Is data engineering dead with advent of AI ? What is the future of data engineering careers in your opinion ?

19395 Bryana Station

Hello, I followed the video and tried to compile and got the this error, please let e know if any one can assist 16:32:38 Running with dbt=1.8.0 16:32:38 Registered adapter: snowflake=1.8.3 16:32:38 Unable to do partial parsing because profile has changed 16:32:38 Unable to do partial parsing because a project dependency has been added 16:32:38 Unable to do partial parsing because a project config has changed 16:32:39 Encountered an error: Parsing Error Error reading oms_dbt_proj: staging\tpch_source.yml - Runtime Error Syntax error near line 9 ------------------------------ 6 | schema: tpch_sf1 7 | tables: 8 | - name: orders 9 | columns: 10 | - name: o_orderkey 11 | tests: 12 | - unique Raw Error: ------------------------------ while parsing a block collection in "<unicode string>", line 8, column 7 did not find expected '-' indicator in "<unicode string>", line 9, column 7

Gonzalez Margaret Clark Linda Brown Eric

Thank you, thank you THANK YOU! This was so helpful, easy to follow and made perfect sense.

Thank you very much

Miller Barbara Thomas Sarah Williams Edward

Im 23 and switching careers from aviation maintenance mechanic to the tech industry trying to get into the data field as i’ve heard the phrase “data is king” i was debating between coding and cybersecurity but i feel like data is the best spot and data engineering sounds like my niche question is should i go to a regular community college (BCC for me in south Florida) or a university aswell or can i break into the field through certifications through technical/vocational school and what certifications are baseline i should go for im trying to find the most efficient and fastest way to break in considering my age (23) im fully committed to this aswell

why do you need to create a VPC?

Roberts Isle

Johnson Dorothy Martinez Susan Hall Anna

Hi, thanks for the top view of the Dagster, do you plan to do the next one, but how to test the whole pipeline or their elements?

In the video at this timestamp ruclips.net/video/Xe8wYYC2gWQ/видео.htmlfeature=shared&t=675, I noticed you're using `setuptools` in `setup.py` instead of relying on a `requirements.txt` file. I'm curious-what are the advantages of using `setuptools` over the more common `pip` or `pipenv` approaches? Many of the packages you listed seem to be available via `pip`, so it seems to add a bit of complexity. Could you explain the reasoning behind this choice? By the way, I’m not criticizing the approach, just genuinely interested in understanding the benefits.

Omg yr Malaysia!

Brown Gary Martinez Dorothy Garcia James

the type of video that makes me wanna quit the field because of how bad i feel about the level I am in , but its a very helpful video though

This is a great video. Thanks for providing real value.

thank you!! I watched the RUclips demo and it was really helpful. I also want to study spark on eks

🙏

Jay! Thanks for the video and content very cool to see. Curious why Airflow over something like FiveTran besides the ability to self host? Any gotchas?

bro is so busy in guiding us, he forgot to drink 4 liters of water everyday

Currently working full time while I get my degree I would love to get a job in Database engineering when I graduate helpful info ty!

Does This applies for Freshers also?

26:00 item_discount_amount is supposed to be negative because the macro defined it as such. I also checked the data on snowflake and they're all negative amounts. Did I miss something?

Hi @jayzern, thanks a lot for your video, really valuable content!

This is such an amazing video @jayzern! The project taken was not overly complex but also not barebones and covered a lot of important stuff! Thanks for being thoughtful and including the code along link (else some of formatting issues would have bugged many newbies)! I think you should keep creating more videos as you are a good teacher. Only suggestion I have is may be include a bit more explanation, which will help beginners even more! Kudos!

Hello did anyone else face this error at Airflow after @32:50 Broken DAG: [/usr/local/airflow/dags/dbt-dag.py] Traceback (most recent call last): File "/usr/local/lib/python3.12/site-packages/cosmos/operators/base.py", line 361, in __init__ self.full_refresh = full_refresh ^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/airflow/models/baseoperator.py", line 1198, in __setattr__ if key in self.__init_kwargs: ^^^^^^^^^^^^^^^^^^ AttributeError: 'DbtRunLocalOperator' object has no attribute '_BaseOperator__init_kwargs'. Did you mean: '_BaseOperator__instantiated'? please send help

Thanks @jayzern. This tutorial is awesome. I will be recommending it to folks who struggle with connecting dbt with any database engine.

hi guys kindly help me out, does only snowflakes and dbt is enought are i have to learn hadoop, spark etc i am working as data analyst for last 1 year and planning to switch to de

"Death by a thousand microservices" comes to mind lol

I'm starting my learning journey from here. It's a completely new world for me, both because I'm not a native English speaker and because I'm totally new to all this technology. I've made up my mind: I want to become a Data Engineer, and I'm going to work really hard to achieve that! Thank you so much for the guidance; I’m going to put it into practice now.

AN ABSOLUTE GOLDMINE OF AN INFORMATION WHICH NOT AY UDEMY OR RUclips TUTOR HAS PROVIDED YET!

Just for the information to all the learners this is not how things to be done in tech industries....you need to understand Terra form scripts along with jenkins which deploys aws services....you will not get access to go on management console and play around and do stuff.

Hi Jay, Im from Latin America, im going to start this month a career related to Web developing and design, I speak english really well and got XP as a field engineering in many places, how can i apply to a job in US/EU from SouthAmerica? Any tip will be considered, Ty!