
- Видео 94
- Просмотров 288 027
Neeraj Garg
Индия
Добавлен 9 сен 2011
•\tData and AI Architect
•\tend-to-end serverless and data solutions over cloud covering a range of cloud services including AWS Big Data Stack, Data Lakehouse, Apache Spark, MongoDB, ETL, Azure Big Data Stack including ADLS, Azure Databricks
•\tLed and developed Generative AI based discussions and proof of concepts covering various use cases like text summarization, sentiment analysis, Q&A
•\tHelp clients understand the significance of modern data architecture; the ability to drive the value from the data in a cost effective and efficient way
•\tTeam Leadership - enabling teams on new and emerging technologies
neeraj garg
#neerajgarg #generativeai #coumptervision #naturallanguageprocessing #nlp #largelanguagemodels #deeplearning #machinelearning #awstutorial #dynamodb #mongodbtutorialforbeginners #mongodbtutorial #mongodb #bigdata #apachespark
#cloudcomputing
•\tend-to-end serverless and data solutions over cloud covering a range of cloud services including AWS Big Data Stack, Data Lakehouse, Apache Spark, MongoDB, ETL, Azure Big Data Stack including ADLS, Azure Databricks
•\tLed and developed Generative AI based discussions and proof of concepts covering various use cases like text summarization, sentiment analysis, Q&A
•\tHelp clients understand the significance of modern data architecture; the ability to drive the value from the data in a cost effective and efficient way
•\tTeam Leadership - enabling teams on new and emerging technologies
neeraj garg
#neerajgarg #generativeai #coumptervision #naturallanguageprocessing #nlp #largelanguagemodels #deeplearning #machinelearning #awstutorial #dynamodb #mongodbtutorialforbeginners #mongodbtutorial #mongodb #bigdata #apachespark
#cloudcomputing
Part9 Amazon CodeWhisperer | AWS Gen AI services | NITTTR Chandigarh workshop
In this video, a high level overview of Amazon CodeWhispere has been covered. The steps to self paced workshop are also shown in the video. AWS Gen AI services offer an end to end machine learning/ deep learning/ gen ai workflow. The users of these services need not to bother about the various stages of the deep learning life cycle.
Amazon CodeWhisperer resources:
aws.amazon.com/codewhisperer/resources/
docs.aws.amazon.com/codewhisperer/latest/userguide/what-is-cwspr.html
Amazon CodeWhisperer workshop can be accessed here catalog.us-east-1.prod.workshops.aws/workshops/6838a1a5-4516-4153-90ce-ac49ca8e1357/en-US
Please note that the workshops attempts might cost you based on your AWS services u...
Amazon CodeWhisperer resources:
aws.amazon.com/codewhisperer/resources/
docs.aws.amazon.com/codewhisperer/latest/userguide/what-is-cwspr.html
Amazon CodeWhisperer workshop can be accessed here catalog.us-east-1.prod.workshops.aws/workshops/6838a1a5-4516-4153-90ce-ac49ca8e1357/en-US
Please note that the workshops attempts might cost you based on your AWS services u...
Просмотров: 40
Видео
Part8 Amazon Bedrock | Amazon Sagemaker | AWS Gen AI services
Просмотров 1506 месяцев назад
In this video, you can get an high level overview of Amazon Bedrock and Amazon Sagemaker AI/ML/ Gen AI services from AWS. These services offer end to end machine learning/ deep learning/ gen ai workflow. The users of these services need not to bother about the various stages of the deep learning life cycle. This video provides an introduction to these services. Please refer official documentati...
Part7 Build your own Gen AI app in minutes | No Code | AWS PartyRock App Demo
Просмотров 2686 месяцев назад
Build your own Gen AI app in minutes. No coding experience is required. No need to write any code. Simply drag and drop and publish your application in minutes. Put your idea in production in minutes. Some of your following queries will be answered in this video: What is AWS Party Rock? Is Amazon PartyRock free? Can I build an AI application without any knowledge of the coding or writing the co...
Part6 Gen AI Demo AWS Stylist App (AWS Gen AI services based) | Amazon Bedrock
Просмотров 1417 месяцев назад
Chapters: A quick introduction to AWS AI stylist app 00:00 AWS AI stylist app Scenario 01:29 aistylist.awsplayer.com/ ruclips.net/video/OfrFhATw0-M/видео.html&t ruclips.net/video/ayUEEgR8fGU/видео.html&t ruclips.net/video/cYg9ChXu1KQ/видео.html ruclips.net/video/b3H5tucSXoU/видео.html ruclips.net/video/fJmepqRjSms/видео.html ruclips.net/video/l4qoF3umrAM/видео.html ruclips.net/video/jxpin-FrQKQ...
Part5 AWS Gen AI services A Quick Introduction | NITTTR Chandigarh workshop
Просмотров 1087 месяцев назад
Chapters: A quick introduction to AWS Gen services 00:00 AWS Generative AI Stack 3:05 Some of the queries which can be answered are listed below: Does AWS have generative AI? What is bedrock in AWS? How do I create a generative AI on AWS? Does Amazon have its own AI? Does Amazon have AI chatbot? ruclips.net/video/OfrFhATw0-M/видео.html&t ruclips.net/video/ayUEEgR8fGU/видео.html&t ruclips.net/vi...
Part 4 What are Foundation Models | NITTTR Chandigarh workshop
Просмотров 338 месяцев назад
Chapters An Introduction 0:00 Quiz-1 Foundation Models 3:15 Foundation Models vs Traditional Models 3:22 Transformers - An overview 3:54 Quiz-2 Foundation Models 5:39 How Foundation Models are different from traditional models? What are foundation models in AI? Why are LLM called foundation models? What is an example of a foundation model? ruclips.net/video/OfrFhATw0-M/видео.html&t ruclips.net/...
Part3 Gen AI : Key concepts Terms | NITTTR Chandigarh workshop
Просмотров 918 месяцев назад
Chapters: Key Concept Introduction 00:00 Foundation Models 00:05 Pretraining of Models 00:32 Fine Tuning 00:46 RLHF (Reinforced Learning from Human Feedback) 1:07 RAG (Retrieval Augmented Generation) 2:03 Prompt Engineering 4:35 Word Vector Embedding 9:25 Hallucination 11:14 Prompt Engineering Techniques - An overview 11:55 What are the key concepts of generative AI? What is the primary goal of...
Part2 Demo : Gen AI application gamma.app | AWS Gen AI services | NITTTR Chandigarh workshop
Просмотров 478 месяцев назад
ruclips.net/video/OfrFhATw0-M/видео.html&t ruclips.net/video/cYg9ChXu1KQ/видео.html ruclips.net/video/b3H5tucSXoU/видео.html ruclips.net/video/fJmepqRjSms/видео.html ruclips.net/video/owd1f3lIBEY/видео.html ruclips.net/video/l4qoF3umrAM/видео.html ruclips.net/video/jxpin-FrQKQ/видео.html ruclips.net/video/-Kb0HxEBXvY/видео.html Github link : github.com/neerajg5/gen-ai-aws Prerequisite: github.c...
Part1 An Introduction Gen AI | AWS Gen AI services | NITTTR workshop
Просмотров 1338 месяцев назад
Chapters Pre Quiz 00:00 An introduction to Gen AI 2:27 How can Naive or Beginner use Gen AI 3:34 How can experts use Gen AI 5:12 What is meant by generative AI? What are examples of generative AI? What is generative AI good for? ruclips.net/video/ayUEEgR8fGU/видео.html&t ruclips.net/video/cYg9ChXu1KQ/видео.html ruclips.net/video/b3H5tucSXoU/видео.html ruclips.net/video/fJmepqRjSms/видео.html ru...
Foundation Models in Generative Intelligence | Gen AI Fundamentals | What is foundation model
Просмотров 112Год назад
Understand the basics of Foundation models in Generative AI. What does that mean when someone mentions foundation model. What are the possible domains and applications where foundation models can be applied. Opportunities and risks of foundation models. Chapters: 00:00 An introduction 01:05 Foundation Model? 03:29 Opportunities and Risks of Foundation Models 06:12 Role of Humans in Foundation M...
Generative AI : An Introduction | Large Language Models | Gen AI Fundamentals
Просмотров 353Год назад
This video covers very basics of Generative AI. This is first video in this video series on Generative AI covering lot of key terms and concepts in this space. Chapters: 00:00 An introduction 03:00 What is Generative AI? 04:00 How can a naive user use it? 06:26 How can an expert user use it? 08:41 Key concepts/ Terms : Generative AI 11:45 ChatGPT Demo 14:53 Gamma.app Demo 16:55 Future Coverage ...
DynamoDB Indexes Reduce Cost | DynamoDB Indexes | Neeraj Garg
Просмотров 6122 года назад
DynamoDB Indexes Reduce Cost | DynamoDB Indexes | Neeraj Garg DynamoDB Sparse Indexes | GSI overloading | Aggregation DynamoDB Indexes best practices Chapters: 00:00 An introduction 01:35 Sparse Indexes and how can these contribute in reducing the cost 03:24 Sparse Index example 04:42 Aggregation through DynamoDB Streams 07:19 GSI overloading 08:03 GSI overloading example AWS DynamoDB Tutorial ...
DynamoDB Local Secondary Index | DynamoDB LSI | AWS DynamoDB Tutorial
Просмотров 1,6 тыс.2 года назад
DynamoDB Local Secondary Index | DynamoDB LSI | AWS DynamoDB Tutorial Chapters 00:00 Introduction 00:51 DynamoDB LSI Criteria 02:02 DynamoDB LSI projection 03:03 DynamoDB LSI important concepts 05:36 DynamoDB LSI Read Capacity Units 05:55 DynamoDB LSI Write Capacity Units 06:18 DynamoDB LSI cost factors 07:06 DynamoDB LSI storage calculation 07:24 DynamoDB LSI Demo What are DynamoDB indexes? Do...
Demo DynamoDB Global Secondary Index | DynamoDB GSI | Neeraj Garg
Просмотров 7222 года назад
DynamoDB Global Secondary Index | DynamoDB GSI | AWS DynamoDB Chapters 00:00 Introduction 00:43 DynamoDB GSI using NoSQL workbench 03:46 Querying DynamoDB GSI 05:30 DynamoDB GSI console walkthrough 07:29 Create new DynamoDB GSI 09:37 How DynamoDB GSI uses RCU/ WCU and its cost What are DynamoDB indexes? Does DynamoDB have indexes? How many indexes can a DynamoDB table have? What are types of in...
DynamoDB Global Secondary Index | DynamoDB GSI | Neeraj Garg
Просмотров 8542 года назад
DynamoDB Global Secondary Index | DynamoDB GSI | Neeraj Garg
DynamoDB Secondary Index | AWS DynamoDB | DynamoDB Tutorial
Просмотров 6842 года назад
DynamoDB Secondary Index | AWS DynamoDB | DynamoDB Tutorial
DynamoDB Secondary Indexes | AWS DynamoDB Tutorial | Neeraj Garg
Просмотров 9212 года назад
DynamoDB Secondary Indexes | AWS DynamoDB Tutorial | Neeraj Garg
DynamoDB Partition Key | How to choose Right key | Neeraj Garg
Просмотров 2,7 тыс.2 года назад
DynamoDB Partition Key | How to choose Right key | Neeraj Garg
DynamoDB NoSQL Workbench | NoSQL workbench for DynamoDB | DynamoDB GUI
Просмотров 10 тыс.2 года назад
DynamoDB NoSQL Workbench | NoSQL workbench for DynamoDB | DynamoDB GUI
DynamoDB Localhost | How to use AWS DynamoDB Local | DynamoDB Tutorial
Просмотров 9 тыс.2 года назад
DynamoDB Localhost | How to use AWS DynamoDB Local | DynamoDB Tutorial
Demo AWS DynamoDB | DynamoDB Tutorial for Beginners | Neeraj Garg
Просмотров 2,6 тыс.2 года назад
Demo AWS DynamoDB | DynamoDB Tutorial for Beginners | Neeraj Garg
How to get AWS access key and secret key | AWS Tutorials 2022 | Amazon Web Services
Просмотров 8 тыс.2 года назад
How to get AWS access key and secret key | AWS Tutorials 2022 | Amazon Web Services
AWS DynamoDB Tutorial for beginners | what is amazon DynamoDB | AWS Tutorials 2022
Просмотров 6 тыс.2 года назад
AWS DynamoDB Tutorial for beginners | what is amazon DynamoDB | AWS Tutorials 2022
MongoDB Serverless Demo | MongoDB Tutorial 2022 | MongoDB Atlas
Просмотров 1,4 тыс.2 года назад
MongoDB Serverless Demo | MongoDB Tutorial 2022 | MongoDB Atlas
MongoDB Schema Design Patterns | MongoDB Schema Design Best Practices | neeraj garg
Просмотров 2,6 тыс.2 года назад
MongoDB Schema Design Patterns | MongoDB Schema Design Best Practices | neeraj garg
MongoDB Schema Design Best Practices | MongoDB Data Modelling
Просмотров 2,9 тыс.2 года назад
MongoDB Schema Design Best Practices | MongoDB Data Modelling
MongoDB Schema Design, MongoDB Data Modelling Exercises and Scenarios
Просмотров 2 тыс.2 года назад
MongoDB Schema Design, MongoDB Data Modelling Exercises and Scenarios
MongoDB Schema Design Best Practices - Operational Factors
Просмотров 2,1 тыс.2 года назад
MongoDB Schema Design Best Practices - Operational Factors
MongoDB Schema Design | MongoDB Data Modelling | MongoDB Tutorials
Просмотров 2,5 тыс.2 года назад
MongoDB Schema Design | MongoDB Data Modelling | MongoDB Tutorials
MongoDB Schema Design | MongoDB Data Modelling | MongoDB Tutorials
Просмотров 3,4 тыс.2 года назад
MongoDB Schema Design | MongoDB Data Modelling | MongoDB Tutorials
Great it works perfectly. I wish you could show us on how to add this to mongo config file since this will stop working once you restart the instance.
Can we configure AWS Glue to communicate with MongoDB via the VPC endpoint by using Terraform? Can you please guide me.
Sir please make videos on other aws services as well. Your playlist is awesome
Great one Sir, thanks
So nice of you
Congratulations sir
Thank you so much sir for the video...Great work sir...please make more videos on estimating and costing
Thank you so much Suraj, please help me understand your requirement. Estimating and costing of what. I mean, is there any specific requirement i.e. are you looking for costing and estimates on Atlas or any cloud provider like (AWS, Google, Azure) or what is the dataset size etc. costing and estimating will depend on lot of factors. Kindly help me understand. Once I've clarity, will definitely record a video on the same. Happy learning !!
@@NeerajGarg Yes sir specifically I want to know all about AWS Price calculator. How can we calculate estimate for a Project. Like for AWS VPC, EC2 Instances, S3 Bucket, Databases, Application Load balancer, Auto scaling, SSL certificates etc.
is it possible to conenct it with springboot project using maven dependency ? if you have any video or repo link . so please share with me
Hi Sumit, I'm not sure about it. However, if you can please share what is your requirement and purpose. I can try to find it out.
Nice one sir
Thanks. Glad that you liked it !!
Thank you for the demo
you are most welcome !! hope you have liked it and it has added some value in your knowledgebase. 🙂
please make a video on different servers for primary and config and mongos
sure, noted your feedback. will try to do it. thank you so much for taking out time and sharing your view and requirement.
It is exactly what I was looking for. Thanks for this series man, I gave you a thumbs up man! Hugs from Brazil!
I'm glad that It helped you in some way. Thank you so much for your kind words.
Thank you. Explanation is clear and simple.
Glad it was helpful!
the sorting of playlist has issues you said like we did in GSI but GSI is later on in this playlist
thank you for he suggestion
@@NeerajGarg Video 4 has to be after Video 6
Thank you so much
You're most welcome
Hi @NeerajGarg, I really loved this video, but I WOULD LIKE TO KNOW LIKE SUPPOSE I HAVE 3 EC2 INSTANCES RUNNING IN DIFFERENT IP'S. 13.201.228.176 65.0.179.114 13.232.181.75 HOW CAN I CREATE THE SHARDED CLUSTER ON IT. AS I HAVE ALREADY INSTALLED MONGODB INSIDE IT SUCCESSFULLY. PLEASE GUIDE. BY THE WAY, LOVED THE CONTENT ❤
Hi Akshay, apology for delayed resopose. thank you for sharing the feedback. I'm glad that you have been able to setup the mongodb sharded cluster.. Just curious to know that are you setting this up for learning purpose or there is a use case you have been working on. However, please note that following components are required for a sharded cluster (from mongodb documentation at www.mongodb.com/docs/manual/core/sharded-cluster-components/). shard (you've this setup as described by you above): Each shard contains a subset of the sharded data. Each shard must be deployed as a replica set. mongos (you need to set this up): The mongos acts as a query router, providing an interface between client applications and the sharded cluster. mongos can support hedged reads to minimize latencies. config servers (set up this as well please): Config servers store metadata and configuration settings for the cluster. Config servers must be deployed as a replica set (CSRS). Hope this helps. Please let me know if there is any further query. I'll be glad to support to the best of my capacity.
I will embeed publisher id in each book
Thank you so much, man. I was struggling so much with how to set up sharding with MongoDB even when I tried to follow the official documentation. This was the only video that I found that actually helped me and now it's working perfectly! Thanks again :)
Thank you so much for sharing your views and nice gesture. I'm glad that this has helped you in some way.
any downside, latency if add members using public IP sir?
Hi, thank you for sharing your query. Can you please elaborate your use case and the requirement. That will help me to suggest in an appropriate way.
Hi, I am beginner to mongodb, while learning through videos , at the end of every video, i cant see text as the next suggestion videos of your series blocks the content. Its very disturbing. kindly remove it. Will be helpful.
Appreciate you taking time to share the feedback. Thank you.
Help me sir
Please watch video and have patience
Hi sir, thank you for the video. Very useful. I have a quick question as I'm very new to MongoDB. According to your embedding approach example, user with access, what if one day we need to query only the access information regardless of the users eg. how many access are there currently ... ? Should we change it to a referencing approach and a user will have a reference to access's object id instead? Or we can still use embedding in that scenario?
Hi, thank you for sharing your feedback and query. There could be couple of options. You can aggregate the access information and put in some collection based on time etc. (if that is the use case). OR there could be another option based on the access pattern. You should list all the possible query access patterns on your data. Then you will be able to find out the appropriate approach of selecting embedding or referencing. Hope this helps. please don't hesitate to reach out if still in doubt.
Thanks for this series sir 👌
👍👍
Great learned something new.
Thanks a lot Amit Bhai, I'm glad that you got something
after creating pipeline, how do you run it?
Hi, The aggregation pipeline in compass given an option to export it to various language constructs like node.js, python or shell. The given code can be embedded in your choice of query execution engine ( programming language or shell). db.collection.aggregate(pipeline, options) an example from mongodb docs: db.orders.aggregate( [ { $match: { status: "A" } }, { $group: { _id: "$cust_id", total: { $sum: "$amount" } } }, { $sort: { total: -1 } } ] ) The following links can also be looked at for more details. www.mongodb.com/docs/manual/core/aggregation-pipeline/ www.mongodb.com/docs/compass/current/create-agg-pipeline/ www.mongodb.com/docs/manual/core/aggregation-pipeline/#run-an-aggregation-pipeline Hope this helps you. Please don't hesitate to get back.
Good
sir, I have a doubt. I am new to backend development. My question is, whether this serverless mongodb plan will handle user volume of 2000 at a single time with the read/write operations from my mobile app as frontend.
Hi, thank you for sharing your query. Can you please help me understand more about your use case. What could be the potential maximum peak load at any time. Does the load (2000 users at a time) mentioned by you hold true for whole day or any specific time of the day. Is it true for all the days or it is for a certain time of the day/week/month/year. How have you arrived to a figure of 2000 users at a single time. Is this figure the maximum or you are expecting more load in near future or in the long term. Having explored all the above queries ( there could be many more based on your answers), I would recommend to do a proof of concept with serverless and then decide if your requirements are fulfilled by serverless (assuming you have complete insights around your workload, the size of collections and data, the shards, the indexes and the query performance). Please let me know if this helps you and feel free to post your queries. You may also like to explore the cost of serverless vs shared/dedicated servers www.mongodb.com/pricing Best wishes!!
👍
Sir Mara account kholo😢
Please watch the steps in the video
👌👍
👌👍 very informative
Glad you think so!
Paano po mag balek nang account
Can you please translate your question in English.
hi, i also got the same error as other in mongos instance - You are not connected to a mongos. This command may not work as expected - MongoServerError[CommandNotFound]: no such command: 'addShard'" i guess nohup mongos --configdb ... is not working i checked after running that and there is no mongos running in my instance note: for this instance, i also installed full mongo-org, just like the others please help me. thanks
Please share more details like the OS version, MongoDB version Are you experimenting on a single machine or it is a cluster of nodes. is there any issue in networking or VPC etc. Thank you for reaching out with your query.
Great Explanation sir I have one question sir if I have around 27 gb of data in mongodb database and we have some huge collections which contains 80lacs data for all different projects and users are facing buffering issues, loading issues so is it good if we go with the replica set approach or we can create separate collection for different projects. Our server has configuration of 64 gb of RAM and 6cores. Please suggest some approach or solutions to resolve this issue.
Thank you for your kind words. In order to help you, need more details as mentioned below: Have you considered using indexes. If not, please create the indexes on the slow collection. If these indexes have been created, try using explain to understand the query which is running slow. ruclips.net/video/8dd52h-M7x8/видео.html ruclips.net/video/TfJgBbTf1RQ/видео.html Have you considered sharding your collection. If not, please select the appropriate shard key and then observe for a certain timeframe. This should help as well. ruclips.net/video/zGF_7kQBLq4/видео.html Check my videos on schema design best practices and see if there are any issues related to schema design. ruclips.net/video/ZeTwxU4C07o/видео.html ruclips.net/video/lZDxMjHtaOY/видео.html All the above points are so critical and can help you to get rid of performance issues. If these don't help, please feel free to share your concern again with more details like sample documents, kind of queries you have been running, indexes created, output of explain command. Hope this helps. Best wishes !!
@@NeerajGarg Thanks alot sir for helping me out.
👍keep it up
Thank you for encouraging words.
Nice start
Please move your picture to the top when you are explaining something in the lower part of the screen. A smaller pic would be more appreciated :)
Thank you for sharing your feedback. Point notes and will be taken care of in future videos. Thank you once again.
Hi, was wondering if it’s possible to create a docker-compose.yml file that could create dynamodb locally with a table and items in it. I am working on it and find that the container is unable to follow the AWS commands such as aws dynamodb create table inside the running container (throwing command not found error). Also tried using .sh file …. Still no luck.
To run aws commands , aws CLI is required followed by the configuration. I need to check this as well. You have raised a good point. Thanks for sharing this.
You should also explain why it is behaving this way
Hi, please see if you can elaborate your feedback a little. I can try to address it. Thank you for taking out to share your feedback.
👌👍
Hello sir i am not able to connect this command nohup mongos --configdb config_repl/localhost:28041,localhost:28042,localhost:28043 --bind_ip localhost & receive this error : [1]+ Exit 14 nohup mongos --configdb config_repl/localhost:28041,localhost:28042,localhost:28043 --bind_ip localhost
nohup in linux is used to run the process in the background. this is the expected behavior of the command. Can you try running ps command to check if mongos process is running in the background. Also, will request more details like OS version, Mongo version etc. Hope, you have followed all the steps listed in the video.
Hello Sir, Could you please let me know the entire process for do the mongodb database point in time restore using the mongodb opps manager console?
Thank you so much for your query. In case you haven't found any solution around this, I can check and confirm. Please let me know.
@@NeerajGarg Please do sir. Because I am not able to find any documents regarding this. Hence requesting you to please share if you have any documents with you please.
Such a good channel but idk why it is so underrated.. there should be more viewers and subscribers.
thanks a lot for your feedback and comments
While configuring the config server i am receiving the below errors in never ending loop on ubuntu Linux command: mongod --configsvr --port 27020 --replSet rs0 --dbpath /u/mongo_date/configdb01 --bind_ip localhost Exceptions: error","attr":{"error":{"code":26,"codeName":"NamespaceNotFound","errmsg":"Unable to retrieve storageStats in $collStats stage :: caused by :: Collection [local.oplog.rs] not found."},"stats":{},"cmd":{"aggregate":"oplog.rs","cursor":{},"pipeline":[{"$collStats":{"storageStats":{"waitForLock":false,"numericOnly":true}}}],"$db":"local"}}} {"t":{"$date":"2024-01-15T15:04:07.002+00:00"},"s":"W", "c":"QUERY", "id":23799, "ctx":"ftdc","msg":"Aggregate command executor error","attr":{"error":{"code":26,"codeName":"NamespaceNotFound","errmsg":"Unable to retrieve storageStats in $collStats stage :: caused by :: Collection [local.oplog.rs] not found."},"stats":{},"cmd":{"aggregate":"oplog.rs","cursor":{},"pipeline":[{"$collStats":{"storageStats":{"waitForLock":false,"numericOnly":true}}}],"$db":"local"}}} {"t":{"$date":"2024-01-15T15:04:07.004+00:00"},"s":"W", "c":"QUERY", "id":23799, "ctx":"ftdc","msg":"Aggregate command executor error","attr":{"error":{"code":26,"codeName":"NamespaceNotFound","errmsg":"Unable to retrieve storageStats in $collStats stage :: caused by :: Collection [local.oplog.rs] not found."},"stats":{},"cmd":{"aggregate":"oplog.rs","cursor":{},"pipeline":[{"$collStats":{"storageStats":{"waitForLock":false,"numericOnly":true}}}],"$db":"local"}}} {"t":{"$date":"2024-01-15T15:04:07.593+00:00"},"s":"I", "c":"-", "id":4939300, "ctx":"monitoring-keys-for-HMAC","msg":"Failed to refresh key cache","attr":{"error":"ReadConcernMajorityNotAvailableYet: Read concern majority reads are currently not possible.","nextWakeupMillis":12200}} {"t":{"$date":"2024-01-15T15:04:08.000+00:00"},"s":"W", "c":"QUERY", "id":23799, "ctx":"ftdc","msg":"Aggregate command executor
I'm sorry to hear about the issue. However, can you please share more details like OS version, MongoDB version. Are you running it on a single node or over multiple nodes. Also, please see if you can share why you didn't select MongoDB Atlas (managed service). thanks. Look forward to hear from you.
Any clue why config/shard server keep going down frequently? where to look for logs, config files etc? also i am running each shard and config server on 3 different ec2 instances and mongo Router on 4th ec2 instance?
Hi Mayank, apology for the delayed response. Please see if following helps. Also, please share more details about your env i.e. which MongoDB, OS version are you using. Why didn't you choose to use MongoDB Atlas (managed service). Logs can be configured www.mongodb.com/docs/manual/reference/log-messages/#configuring-log-message-destinations www.mongodb.com/docs/manual/reference/command/getLog/#getlog Please let me know if this helps. Would be glad to support in whatever capacity I can. thank you for sharing your issue.
Congratulations neeraj
how to consult
What is this regarding. You can send me a message on LinkedIn as well.
@@NeerajGarggot my first client, building a blood bank mern project currently using mongo atlas free one, how to proceed and deploy when project finishes which atlas plan should i buy and hosting too
Many congratulations on your first client. Best wishes for successful delivery. The product deployment and selection of plan will depend on a lot of factors like the expected workload (number of users, what time, how many requests per second/ per day etc. to name a few) on the DB. You can connect me on LinkedIn and we can have more detailed discussion over a call, if required. This platform may not be appropriate for you to share all such information. Hope, this helps.
@@NeerajGarg thanks a lot! what's you linkedin and happy new year 🎊
www.linkedin.com/in/neerajgarg5/
Hi, where to get database files which you used "zips.json". can you share that too. TIA!
Please share your email id. Will share over there. I will have to find those as my system was attacked by ransomware
Hi , sir I have a problem : the collection test in chunkMetadata have only 'shard_repl1' not like you the two shards .how to do?
Hi, apology for late response. Can you please share the MongoDB version and operating system you have been using.
Sir where are the sample data files zips and test (json files from which you imported data)?
I think I've forgotten to share the link here. Let me find out the underlying data and share with you. Can you please share your email id with me.