Build Your Own Search Using Amazon OpenSearch Service [FULL COURSE in 15MIN]

Поделиться
HTML-код
  • Опубликовано: 19 авг 2024
  • Want to build your own search solution? The Amazon OpenSearch Service on AWS could be the solution for you. OpenSearch is a distributed, community-driven, Apache 2.0-licensed, 100% open-source search and analytics suite used for a broad set of use cases like real-time application monitoring, log analytics, and website search. OpenSearch provides a highly scalable system for providing fast access and response to large volumes of data with an integrated visualization tool, OpenSearch Dashboards, that makes it easy for users to explore their data. OpenSearch is powered by the Apache Lucene search library, and it supports a number of search and analytics capabilities such as k-nearest neighbors (KNN) search, SQL, Anomaly Detection, Machine Learning Commons, Trace Analytics, full-text search, and more. In this Video I take you through the steps to set up your first domain.
    LINK TO GITHUB TUTORIAL RESOURCES:
    💾 Code Repo: github.com/joh...
    SUPPORT THE CHANNEL:
    ☕ Buy Me A Coffee: www.buymeacoff...
    🖥️ My VPN: go.nordvpn.net...
    ▬▬▬▬▬▬ T I M E S T A M P S ⏰ ▬▬▬▬▬▬
    00:10 - Intro
    01:12 - OpenSearch Service Theory
    02:50 - Navigate To OpenSearch
    03:33 - Create Search Domain
    05:39 - Add Single Document to Index
    08:17 - Upload Mulitple Documents to Index
    10:10 - Search Index Via API
    11:22 - Search Index Via UI
    13:43 - Delete Cluster To Clean Up Resources
    14:07 - Outro
    OTHER USEFUL LINKS:
    ℹ️ My Website: johnnychivers....
    🔗 Linkedin: / johnny-chivers
    💻 OpenSearch: github.com/ope...
    😎 About me
    I have spent the last decade being immersed in the world of big data working as a consultant for some the globe's biggest companies.My journey into the world of data was not the most conventional. I started my career working as performance analyst in professional sport at the top level's of both rugby and football. I then transitioned into a career in data and computing. This journey culminated in the study of a Masters degree in Software
    Enjoy 🤘

Комментарии • 39

  • @rafaelmartinsdecastro7641
    @rafaelmartinsdecastro7641 Год назад +1

    Good stuff, way better, and much clearer than going through AWS's docs.

  • @waqasshah6331
    @waqasshah6331 Год назад

    Happy that you are back! Keep these tuts coming

  • @kapilagarwal2911
    @kapilagarwal2911 Месяц назад

    But the information is to useful, Thanks Johnny!

  • @nishvanth
    @nishvanth Год назад +1

    Your channel is so underrated. Thank you Johnny. Bought you a coffee. Can you suggest which one should I choose for Data Engineering, Mac or Windows?

    • @JohnnyChivers
      @JohnnyChivers  Год назад

      Thanks you!
      You’ll find yourself using a lot of Linux in data engineering. Mac is unix based, and can run bash, so you can get a near Linux experience. Windows now offers Linux for the windows sub system, which offers a good experience… so really it’s personal preference at this stage.

    • @nishvanth
      @nishvanth Год назад

      @@JohnnyChivers Thank you Johnny.

  • @jfpimentel
    @jfpimentel Год назад +1

    Great tutorial, it was pretty handy. Thanks!

  • @615rip2
    @615rip2 5 месяцев назад +1

    can you teach how to use the pipeline to syncrhonize data from rds?

  • @baptizeishere
    @baptizeishere Год назад

    Excellent tutorial Johnny

  • @user-ch1hk5ii8p
    @user-ch1hk5ii8p 5 месяцев назад

    Awesome !!! Johnny...

  • @user-mh2kc5jc5k
    @user-mh2kc5jc5k 6 месяцев назад +1

    As beautiful as your face is, it's a little too zoomed in for this video. Great content, thank you for sharing

  • @assetwolf
    @assetwolf 10 месяцев назад

    Super video, very clear and helpful.

  • @vs7035
    @vs7035 Месяц назад

    Great content thank tou

  • @user-gf3xy2fb7u
    @user-gf3xy2fb7u 6 месяцев назад +1

    hello, I tried following those steps but on my own json data, I keep getting this error : curl: (3) URL rejected: Port number was not a decimal number between 0 and 65535 , do you have any idea why? and thank you for this video !

    • @balthasarsaubot1454
      @balthasarsaubot1454 5 месяцев назад

      hello, did you solve this issue ? i encounter the same error.

  • @sebastianmeckovski9980
    @sebastianmeckovski9980 8 месяцев назад

    good stuff. Could you make a video on how ot sort geo-points by distance from given location?

  • @vaibhavjain1in
    @vaibhavjain1in Месяц назад

    Hey there, if I am already have OpenSearch running and if I want to add another domain, do I need to do anything else to have a similar setup as the existing cluster?

  • @wiseman9960
    @wiseman9960 3 месяца назад

    Liked and subscribed 🤟

  • @user-tt1li5ew1l
    @user-tt1li5ew1l Год назад +1

    amazing
    I have a .csv and a .json file with many records, is there a way to consume them all at once?

  • @therus000
    @therus000 5 месяцев назад

    Great
    what the way to use policy to delete index's? can u explain that please?

  • @khandoor7228
    @khandoor7228 Год назад

    Good topic Johnny!

  • @iyiempire4667
    @iyiempire4667 10 месяцев назад +1

    your video is great. does opensearch is diffrent than cloudwatch or we can do same things in cloudwatch too?

  • @TheOfficialMovmnt
    @TheOfficialMovmnt Год назад

    Great video 🔥

  • @ToddCunningham
    @ToddCunningham Год назад

    awesome, as always. Thank you

  • @crade47
    @crade47 3 месяца назад

    amazing

  • @ShahzadRasul-uo7gu
    @ShahzadRasul-uo7gu 5 месяцев назад

    How can I create automated backups of Opensearch in S3 on a cronjob?

  • @jamesmcmahon2504
    @jamesmcmahon2504 10 месяцев назад

    I wanted the OpenSearch Service to be in the same VPC as my EC2 instance, so rather than a publicly accessible instance I set the OpenSearch instance to be within that VPC. When I putty in to my EC2 instance and attempt to do the first curl, I get no response. Any thoughts how to debug this?

  • @Dennis-dx5qp
    @Dennis-dx5qp 8 месяцев назад

    Hi! How do you determine how many shards you want to use? I want struggling to be able to change it dynamically, when shards are too few. I was also wondering if this is also possible to be set with cloudformation?

  • @meirgoldenberg5638
    @meirgoldenberg5638 Год назад

    These instance types are not displayed for me. Only the "large" options are present.

  • @bestquotes2765
    @bestquotes2765 10 месяцев назад

    What is the use of it?

  • @NewnessOfNature
    @NewnessOfNature Год назад

    Does OpenSearch have the ability to loose/fuzzy search?

  • @Salmankhan-qt8uy
    @Salmankhan-qt8uy 7 месяцев назад

    Came here after learning ELK

  • @prempant6428
    @prempant6428 Год назад

    How can you use your own data for this? Currently, I have a Dynamo DB which is where I store my data, how can I incorporate this with my dynamo service?

  • @sahilkishnani5522
    @sahilkishnani5522 Год назад

    Is this free to use?

  • @kapilagarwal2911
    @kapilagarwal2911 Месяц назад

    Can you please zoom out little bit, It's too scary !