Excellent - Thank you. This will benefit many other viewers so I added it to the video. Just so you know, you need to start with "0:00 " to get RUclips to pick it up and apply it to the video, so I added "0:00 Intro"
An interesting take on the subject. I like how these are more business level functionality focused rather than more developer-focused and granular like I have on my video on the subject. Nice stuff 🙏 PS: I historically had scaling issues with Seq and I can't really recommend it to anyone, at least not if you want long term retention (7-15 days+) in a high throughput environment
Your channel is very different, its very granular and low level examples of how to optimize code where as Tim Corey has a broader perspective and more of a overview. Both are are obviously great depending what you are out after.
I am a beginner to C# and I have found your every video really good, informative and helpful, So I wanna thank to you for your great contribution in the learning community, Thanks a lot sir!!!!!!!!!
Hey Tim, just got my first job as a Trainee Web Developer. My main language is Javascript(I've been a React/Nodejs developer for more than a year) but they asked me to learn C# at work. Your videos are helping a lot.
Yo. If I may ask a question about your choice, why did you choose C#, and have you considered Kotlin (since, AFAIU, it brings a lot of the good parts of C# to JVM world)?
@@MagicNumberArg I did not really have a choice. On my new job there is some C# software that i will have to maintain. So i started using C# for my own projects. I want to keep personal complexity as low as possible since i am just kind of starting out. But thanks for pointing that out. I might have a look at Kotlin :)
Also if you need log viewer you can use my open source project at github.com/Analogy-LogViewer/Analogy.LogViewer it supports many log frameworks and even has real time server
I just wanted to take this moment to say Thank You!! Your content is amazing in fact i bought a few courses on your website. So far i have learned alot and i am not even halfway through. So thank you! Keep going your helping a lot of devs this way.
If you more interested in MassTransit you should check this playlist by the creator of the package himself: ruclips.net/p/PLx8uyNNs1ri2MBx6BjPum5j9_MMdIfM9C
@@GeorgiMarokov I used an earlier version of MassTransit for an event driven system we had at my previous place of employment. We had upwards of 100,000,000+ messages a day going through the system. I would definitely use MassTransit again for a future project. As a matter of fact . . . now that I'm at a place that is Linux based, I look forward to trying out the latest MassTransit using .NET Core.
I would say Quartz is much better than Hangfire but it really depends on what you want to do. Quartz has more features and it's even easier with Crystal Quartz (Remote UI) to schedule jobs,maintain and re trigger them. Great video Tim.
The "don't use real email addresses" part remembers me of a one-day-trail at a local web solutions company. I had to send some template mails, and i was new to javascript at that time. I ended up flooding the inbox of the company ceo with thousands of sample mails. Maybe i would've got the job if i flooded a testserver instead :D
Valuable lesson learned and Thank You for sharing. Hopefully others can learn from this. Don't use real "data", even if you think its secured and completely under your control. CEO's email address as test data did not work so well in this case. Avoid using real data (Actual account numbers, email addressed, credit card numbers, personal information, etc.) even when you are on a test server. I have seen too many "fails" where testing has impacted real world production environments.
The most classic example I can think of was from the 90s. One guy in a large Bank made a test email supposed to go to those with more than than a certain amount in the Account. He started them with Dear Rich Bastard. Unfortunately it went out to the actual customers :). He got fired for that. Not sure I would have been offended personally, kinda funny thing to get from your bank :).
Really enjoying all of your videos! Great explanations and easy to follow along. This video is really helpful and I think important so we don't think to hard and overcomplicate things. Thank you for your work!
Wow, the timing couldn't have been better! I was on the phone with another developer just last night, discussing a new project and was asking him if he knew of any libraries for reading / exporting excel files! Thanks for these resources
@@marcusmaunula5018 I agree it's always best to just buy the license and at that point it will be great to consider devexpress or telerik and others too.
I have a video request: Could you create a video where you explain Semaphores in detail? And maybe explain the differences between them, Mutex and Lock and also some best practices.
Hope i'm not hijacking the thread, but would be curious if anyone knows of a good generalized text parser? And will add another note for useful library. This one handles command line parse, especially when it might get a little involved. Really handy, why so good? You define a class for various alternate command line settings. Worked on an app that might spin off one one of 12 other programs, and this helped. But still in a more traditional single/stand-alone app. Effectively you define a class, the library will inspect your define ProgramArgs class, and will handle the validation and error reporting of the message as defined. The library allows annotating your defined class with attributes to allow you to build up and customize it. And even better if parsed and no exception, immediately you have access to an instance the command argument class that match for the valid config. On larger applications have seen where the validation, error message and reporting starts getting rather disjoint at times. Not sure NuGet or GitHub is easier for all? Nugget: -> in VS CommandLineParser (in VS) Nuget/web -> www.nuget.org/packages/CommandLineParser/2.6.0 GitHub: => github.com/commandlineparser/commandline
How is EPPlus better then OpenXMLand ExcelDataReader for reading and creating Excel spreadsheets? I spent a lot of time figuring out how to use those and find examples to create spreasheets with validation and import/export those spreadsheets for my business. I used ExcelDataReader because it was simple to read a spreadsheet created by someone else and skip the headers and columns that didn't match my criteria. I have something that works and unless it is WAY simple, I don't want to change anything at the moment, although I would like to upgrade my desktop application to .NET 5.0 and take advantage of new features. However, I'm stuck with some windows functionality in my library (yes probably a bad practice) to popup errors when trying to import spreadsheets and allow a retry.
Great list. I tried a different library called ExcelMapper once epplus changes its licensing model. Really cool library to convert excel to pocos. Really made working with excelfiles a breeze.
I used to rely on RDL/RDLC reports back in the framework days as well. I moved to DocX and EPPlus to create my Word and Excel-based reports, respectively. There aren't the visual cues you get from designing your report, but I found it easier to create my reports exactly like I want with the data I want.
@@andreasbramftl1106 thanks for the info. My company has an .NET Framework add in for MS Project that interacts with Excel. All of our clients have excel installed. Given that scenario, is there any benefit to using EPPlus over Interop?
Thank you Tim it's really helpful. Please can you create shay your ideas on how to add Layers into a project? What are the main common Layers ? What other Layers you may add it if needed? Thank you. And happy new year
I'd love a video on creating PDF/printable reports on .NET 5 Razor/MVC state of the art. Everything I find seems to be old, ugly or generally both. I used Crystal Reports many years ago. That was quite powerful (although, again, ugly and not friendly to use). But I'm not sure what people are using nowadays to create some custom reports from a business web application.
Agreed! Like you, I looked around and was disappointed with the choices. Crystal isn't even an option anymore (except for people sticking to .NET Framework). SAP's (who owns Crystal) forum threads about it show that they have no clue what .NET Core is and say they will never support it. Our company is giving SSRS a try, and it seems decent so far. It lets you use a GUI tool to lay out the reports (taking that load off of the C# programmer), and then your C# code can grab the report via URL (and pass parameters and get back a PDF or whatever).
An email library is what we use to send email from C# code. It still needs to connect to an email server (like Gmail) to send the actual email. Think of a C# email library as replacing the user typing out the message in an email client. C# does the typing and hits send. It relies on an email server to do the rest.
In regards to your comments about logging, I have a routine that copies data from an Oracle server to an MS SQL Server. It massages some of the data. I like to log what I call exceptions. Data that doesn't fit the norm, but not NECESSARILY incorrect data. If a user calls and indicates that something looks amiss I can pull up that log to see if an exception existed and if so, what didn't it like about it? Do I read the logs? Not normally - only when warranted.
Just be careful there, because that logged data could be sensitive in nature. It is also not connected with the actual data, so you could run into legal issues if a user asks to be forgotten and you leave their information in the log files.
@@IAmTimCorey Thank you for the advice - and it's very solid advice. In this case the exceptions aren't tied to any personal data whatsoever and everything in this data that I'm retrieving is considered public information. I haven't implemented this logging as of yet, just something that I'm looking into. I need for staff to know what data that looked suspicious such as missing a property description. The program makes a safe assumption but it might not be the correct assumption. The owner of the data needs to be aware of the issue and decide whether it is a problem or not.
I used Hangfire for job scheduling and it is easy to implement it. But only problem is to process parallel jobs we have to purchase the license Hangfire Ace packages
I'd love a video or video-series about software-architecture and clean code. I've seen your videos about SOLID and DRY and Refactoring and many more that kinda talk about that topic. But as my applications are growing I still think they become a bit messy. Like where do i put all the Interfaces for dependency Injection. Where do i put all the Repositories for a repository pattern and so on. But also something like, how to manage overloads, or to many parameters for a method. Or I also struggle sometimes to find out which responsibility is something. Let's say for example a chess programm, who stores the position of a chess piece? The piece itself, the board, a tile on the board, or an extra gamestate class,...? And then further who would move those pieces..? I know there a no clear answers to those questions. But any tip or trick on those questions can be really helpfull.
Been using epplus for years. One thing u didn’t mention about it, is that it does not require excel or ms office to be installed on any server. Other libs require that 🙂
Thanks for a very interesting video. It would be great if you would teach more on Hangfire and share a little more details how you used it before. I would also really like a comparison between Hangfire and a Windows Service - when to use which and maybe to mix them. A .Net Core Windows Service is very easy to use as you already demonstrated in one of your videos if you need something to run every 5 minutes (or whatever interval) but what about once a day at a set hour or other variations? That cannot be done without some workarounds but maybe Hangfire is useful there???
Any time you have an application that wants to talk to another application in a disconnected manner. Microservices use this technique heavily but it doesn't have to be only them. Having this disconnect means that you can separate out parts of your application and update them without taking down the whole system or even losing anything while they are down.
@@IAmTimCorey Thanks for the very informative explanation, so compared to basic API communication in case using messages brokers we won't need to handle the acknowledgment part, am I right? Also, one more question related to Hangfire Can it be used to keep that data sync between applications? if not, what's the process to keep the data sync?
i would be glad if can make a video from a library who is working with the task scheduler system what you can write in your csharp application like the nuget packge task scheduler
I'm new to C# and I'm enjoying your videos very much. I was reviewing this video on Libraries and I tried downloading one. The big question I have now is, where do you get documentation on what's in the library and how to use it. I did a lot of googling but didn't find any answer. Thanks for any help you can provide. My particular hurdle right now is CSV files.
Hi Tim, Thanks for sharing such a wonderful post once again. I was wandering whether there are some inbuilt tools to validate Excel data while importing to database. I want to validate my excel file such as columns datatype,sequence,number of columns etc and then store into DB and azure BLOB storage. Thanks Uttam tam,
Hi Tim, which tool do you recommend for logs, Serilog with Seq or Azure application insights? I know those are different but for register and monitoring errors, which do you recommend?
Both, usually. Applicaiton Insights is good at giving you a big picture on what is going on in your application landscape. Logging is good for digging into specific problems.
Do you think that is a good idea to use Hangfire instead to RabbitMQ in microservices, I know that they are different but at the same time very similar, because I think that Hangfire looks cool but at long term maybe is just a toy that is difficult to scale, what do you think?
These are two different technologies that do different things. Hangfire is about scheduling jobs to be run. RabbitMQ is about passing messages between applications. Both are great tools and both have their place. They just aren't interchangeable.
That's pretty much the biggest problem. And especially with these two requirements, unfortunately, it's usually the case that the ones you can use are usually quite expensive.
Interesting - will look at EPPlus as it may put a lot of protections against the inconsistency of the Excel reference And I like the though of better logging And the email one Papercut makes sense for us.
Hi Tim, I would like to know what is best for create and manage jobs? Azure web jobs vs Azure Functions vs HangFire? I appreciate it your comment, Thanks
I am a newby somewhat - I use windows task scheduler for my recurring jobs. Is hangfire basically the same or are there major differences I am not seeing
Hangfire will give you a much better picture of what has been done (great dashboard), it will have better reschedule/retry operations, and you can be more granular in how you schedule your tasks. Basically, you will have a lot more power. If you don't need the additional power, stick with what works.
@@IAmTimCorey I would like a video about the mailing libraries and the difference between the two and how to know which one is better for a specific project and I would like also a video about serialog and the Seq, and some videos about the steps to deploy an ASP.NET Web App on a physical server (with Docker and Sql Server ) and the best approach to secure it i know i am demanding a lot from you but you are so good at what you do and you are a gr8 developer
You might not have access to a service like that in whatever system you're on. And HangFire can do a bit more than run things on schedule. Can't speak for it in depth as I've only used it once a few years ago, but it's a great tool, for sure.
A service typically runs in the background on your computer. It might fire every minute and you can "schedule" it to do things. However, hangfire can do things like weekly, daily, etc. schedules, plus they can do chained tasks and more. You could write enough code to do what hangfire does, but it would take a lot of work.
How to pop up selectable data rows from textbox i.e. a textbox in a form when space key pressed a pop up will appear from db and we can select the name of the firm that we want for transaction, on selection the selected value will go inside the textbox child ti parent .
Great tutorial really appreciated, it's good to know what other developers are using so you don't get lost into the myriads of tools while there are better tools out there. How would you suggest the use of Hangfire for task automation over let say creating your own windows service with another tool like topshelf which make it easier to create windows services, you have also discussed it in one of your videos? Can a windows service do all what can Hangfire do or hangfire is super easy to implement than a windows services? Email is one of things that are almost needed in business application, if you could discuss in one of your videos how to use these email application tools like MailKit (pop3/imap,smtp) , papercut the better way. Thanks a lot
Hangfire is about scheduling. Services are about running outside of a user's account. The two can be used together quite successfully. You can create a service that uses hangfire to schedule jobs to be run. By default, a service just runs all of the time. It is not set up to run things on a schedule (with retry, etc.) This is what hangfire adds.
hey Tim, thanks for all your works. New to your channel, i will defenetly stick around. Question about all commercial licences like the EPPlus 5 you presented us. If i'm a freelancer making programs for customers. If i (as an external developper) pay for the licence, are my customers in right to use the program even if they are not the licence owners?
Each company will specify what you can and cannot do with their software. In the case of EPPlus specifically, you can probably just purchase a license for yourself. Here is the FAQs that explain a bit better: www.epplussoftware.com/en/LicenseOverview/LicenseFAQ
In asp.net core web api, is it possible to raise an event from an class, and listen to this event from another class and based on the event, do some task. How to achieve this? Also what is event-event handler-event bus? Very confusing. I was trying to decouple events in a standard .net library and was trying to move all events in one library. But got very confused.
You are right about EPP but what I don't like. Is when they start out as "free" libraries then change everything out of the blue. I'd much prefer if they were upfront with their long term plans from get go. Same problem with Identity Server 4 imho. But it is up to them of course. But then. MS makes Excel, they make VStudio. Would it be too much to ask for them to add something like this in the package? It's not like they have travel far to find the specs :).
Hangfire does store jobs in a database, along with the outcome of the executions of those jobs. As for per-user hangfire, I'm not sure what you mean. The hangfire service will run as one user. However, you could create jobs for each user.
@@IAmTimCorey ohh okay, so I am building an app where I'll have recurring jobs per user. So for example, a user will input that every Sunday to execute a purchase of X dollar bitcoin using an API. Would I be able to store the user recurring jobs in the dB and would hangfire be able to handle these types of recurring buys? Thanks!
Really nice picks of libraries :) When theres so much choice its hard to pick the best ones. It would be cool to find some newly emerged Libraries that are really cool but not a low of people have downloaded them yet
I was hoping to find in this video a library to generate PDFs (let's say to create invoices for example), but alas... Tim, do you have any suggestion though?
the only thing i would comment is that these are third party libraries and they wont offer you much benefit behind a firewall. Third party libraries get flagged in things like Veracode, Checkmarx, etc all the time and most companies dont let you use third party libraries in production. Ive written my own email class, csv class, logging class... probably a dozen times and THAT is what makes good class code - writing it yourself so that you understand how and why certain .NET methods are used. If you leave the logic up to a third party library then you cant specify important things like impersonation, smtp, encryption, process flow, business logic, etc. I highly recommend to all new devs, WRITE IT YOURSELF FIRST and if you fail find the third party library and figure out how they wrote it and how it fits their use case, then start from scratch again and figure out how it fits your own use case.
I disagree when it comes to the firewall issue. That would be the case for full applications (like Seq) potentially, but NuGet packages are just C# code. They shouldn't be flagged by a system unless your own code might also get flagged. The only exception to this would be if the system did not properly allow NuGet packages, which would be a problem since even Microsoft is breaking their systems apart into NuGet packages for modularity.
@@IAmTimCorey ok i see a nuget package is indistinguishable from any other C# code in the project. That issue sounds familiar so most likely the case in my situation thanks for that i did not realize these werent binaries
Hi Time. I stopped using hangfire cos I realized when it is used to fire a long running task, it would time out and call the task again causing duplicate calls.. So I fell back to using windows services for running repeated/scheduled task
2:38 SharpZipLib
4:02 FluentEmail
5:22 MailKit
6:14 Papercut SMTP
8:56 EPPlus
11:53 Hangfire
16:19 MassTransit
18:34 Polly
22:20 Serilog
26:05 Seq
Excellent - Thank you. This will benefit many other viewers so I added it to the video. Just so you know, you need to start with "0:00 " to get RUclips to pick it up and apply it to the video, so I added "0:00 Intro"
Thanks.
Thanks!
Thank you!
An interesting take on the subject. I like how these are more business level functionality focused rather than more developer-focused and granular like I have on my video on the subject. Nice stuff 🙏
PS: I historically had scaling issues with Seq and I can't really recommend it to anyone, at least not if you want long term retention (7-15 days+) in a high throughput environment
Interesting. I'll check it out. Thanks for sharing.
Your channel is very different, its very granular and low level examples of how to optimize code where as Tim Corey has a broader perspective and more of a overview. Both are are obviously great depending what you are out after.
This is by far the greatest c# channel on youtube, great work! Thank you!
Glad you enjoy it!
I am a beginner to C# and I have found your every video really good, informative and helpful, So I wanna thank to you for your great contribution in the learning community, Thanks a lot sir!!!!!!!!!
You are welcome.
Hey Tim, just got my first job as a Trainee Web Developer. My main language is Javascript(I've been a React/Nodejs developer for more than a year) but they asked me to learn C# at work. Your videos are helping a lot.
That is awesome!
i got into software development by learning java first. just recently switched to c# and i highly appreciate what you are doing here. keep it up!
Yo. If I may ask a question about your choice, why did you choose C#, and have you considered Kotlin (since, AFAIU, it brings a lot of the good parts of C# to JVM world)?
@@MagicNumberArg I did not really have a choice. On my new job there is some C# software that i will have to maintain. So i started using C# for my own projects. I want to keep personal complexity as low as possible since i am just kind of starting out. But thanks for pointing that out. I might have a look at Kotlin :)
Welcome to our world of C#! I'm glad my resources are of help.
This video was perfectly timed because I was just starting to look for a logging solution. Thanks for the great info.
Glad it was helpful!
Same 👋
Also if you need log viewer you can use my open source project at github.com/Analogy-LogViewer/Analogy.LogViewer
it supports many log frameworks and even has real time server
I just wanted to take this moment to say Thank You!!
Your content is amazing in fact i bought a few courses on your website.
So far i have learned alot and i am not even halfway through.
So thank you! Keep going your helping a lot of devs this way.
Awesome, thank you!
Would love to see a video about MassTransit
Also Hangfire :)
If you more interested in MassTransit you should check this playlist by the creator of the package himself:
ruclips.net/p/PLx8uyNNs1ri2MBx6BjPum5j9_MMdIfM9C
I appreciate the suggestion and added it to my list.
@@GeorgiMarokov I used an earlier version of MassTransit for an event driven system we had at my previous place of employment. We had upwards of 100,000,000+ messages a day going through the system. I would definitely use MassTransit again for a future project. As a matter of fact . . . now that I'm at a place that is Linux based, I look forward to trying out the latest MassTransit using .NET Core.
Been following this guys videos for years now, absolute god send!
I'm glad my content has been helpful.
I would say Quartz is much better than Hangfire but it really depends on what you want to do. Quartz has more features and it's even easier with Crystal Quartz (Remote UI) to schedule jobs,maintain and re trigger them. Great video Tim.
Fair enough! Thanks for sharing your perspective.
Very informative video, appreciate it. It would be good idea to do such videos from time to time.
Glad you liked it!
Thank you Tim, You are Time Saver.
Glad to help
Tim-e saver
The "don't use real email addresses" part remembers me of a one-day-trail at a local web solutions company.
I had to send some template mails, and i was new to javascript at that time. I ended up flooding the inbox of the company ceo with thousands of sample mails. Maybe i would've got the job if i flooded a testserver instead :D
Valuable lesson learned and Thank You for sharing. Hopefully others can learn from this. Don't use real "data", even if you think its secured and completely under your control. CEO's email address as test data did not work so well in this case. Avoid using real data (Actual account numbers, email addressed, credit card numbers, personal information, etc.) even when you are on a test server. I have seen too many "fails" where testing has impacted real world production environments.
@@IAmTimCorey
So what you're saying is use common sense😊
The most classic example I can think of was from the 90s. One guy in a large Bank made a test email supposed to go to those with more than than a certain amount in the Account. He started them with Dear Rich Bastard. Unfortunately it went out to the actual customers :). He got fired for that. Not sure I would have been offended personally, kinda funny thing to get from your bank :).
@@Dave-nv5rv But the sense is not common with everybody!
@@Dave-nv5rv common sense is neither sensical nor common
This was very helpful and put several tools on my radar. THANK YOU!!
You are welcome.
I was just starting to add e-mail and logging to my project when I saw this video. Thank you!
Glad it was helpful!
i've been using EPPlus for years. It's amazing!
It really is.
Thank you so much, I didn't know about those libraries 😊 Love your channel, keep it up!
Thank you! Will do!
"Never wanna send out an email to real people for test purpose". Yes, you got me. But that's fun.
Testing fails - now there is a fun (and scary) topic.
Email no, SMS yes :)
never send advertising emails to clients after midnight, its not fun at all, you can ask my boss 😅
How else would you know they are real?
Happy new year Tim Corey! your video help me a lot
Happy new year!
Excellent Tim. Thanks a lot.
You are welcome.
Several of these will be very useful to me. Thanks Tim.
You bet
Really enjoying all of your videos! Great explanations and easy to follow along. This video is really helpful and I think important so we don't think to hard and overcomplicate things. Thank you for your work!
Glad it was helpful!
AWESOME video. Thanks for the good pointers to interesting libraries.
👍
Thank you!
Polly looks really interesting. I have been planning on using it in my next project
Go for it!
Wow, the timing couldn't have been better!
I was on the phone with another developer just last night, discussing a new project and was asking him if he knew of any libraries for reading / exporting excel files!
Thanks for these resources
Great! You are welcome.
Thanks for the great libs! I would like to see more videos like this in the future :)
I noted your recommendation and have added to my list, thanks.
I used Polly and hangfire. And this libraries is great. Thanks safe this video for feature
Thanks for sharing
Another good one to look at: PowerAssert - when the unit test fails it shows you exactly why straight away.
Happy new Year Tim, I want to thanks you for all your videos that really helped me a lot. Do you have a plan this year to start a Xamarin course?
Not this year because of the changing coming with .NET 6.
@@IAmTimCorey Thanks Tim
*EPPlus is free for commercial applications below v 5.0
Thanks for the tip.
Syncfusion also has a generous free tier for small operations. It gets some tasks done rather quickly.
@@bangonkali You have to keep track of the revenue of your customers though. Max 1m USD per year. Might just be easier to buy a package.
@@marcusmaunula5018 I agree it's always best to just buy the license and at that point it will be great to consider devexpress or telerik and others too.
@@bangonkali I am a little tempted by the SF Blazor Package. You have any experience with it?
Super useful video, thank you Tim
Glad it was helpful!
Happy New Year, Tim!
Happy new year!
I love it!, Just added a pair library. Thanks for sharing it.
Thanks for commenting.
You are welcome.
Man!! That was awesome
Glad you liked it!
I have a video request: Could you create a video where you explain Semaphores in detail? And maybe explain the differences between them, Mutex and Lock and also some best practices.
I appreciate the suggestion and added it to my list.
Hope i'm not hijacking the thread, but would be curious if anyone knows of a good generalized text parser? And will add another note for useful library. This one handles command line parse, especially when it might get a little involved. Really handy, why so good? You define a class for various alternate command line settings. Worked on an app that might spin off one one of 12 other programs, and this helped. But still in a more traditional single/stand-alone app.
Effectively you define a class, the library will inspect your define ProgramArgs class, and will handle the validation and error reporting of the message as defined. The library allows annotating your defined class with attributes to allow you to build up and customize it. And even better if parsed and no exception, immediately you have access to an instance the command argument class that match for the valid config. On larger applications have seen where the validation, error message and reporting starts getting rather disjoint at times.
Not sure NuGet or GitHub is easier for all?
Nugget: ->
in VS CommandLineParser (in VS)
Nuget/web -> www.nuget.org/packages/CommandLineParser/2.6.0
GitHub: => github.com/commandlineparser/commandline
Hi Tim. Some of the alerting you mentioned for Seq can also be done with Grafana and App metrics.
Thanks for sharing.
How is EPPlus better then OpenXMLand ExcelDataReader for reading and creating Excel spreadsheets? I spent a lot of time figuring out how to use those and find examples to create spreasheets with validation and import/export those spreadsheets for my business. I used ExcelDataReader because it was simple to read a spreadsheet created by someone else and skip the headers and columns that didn't match my criteria. I have something that works and unless it is WAY simple, I don't want to change anything at the moment, although I would like to upgrade my desktop application to .NET 5.0 and take advantage of new features. However, I'm stuck with some windows functionality in my library (yes probably a bad practice) to popup errors when trying to import spreadsheets and allow a retry.
Great list. I tried a different library called ExcelMapper once epplus changes its licensing model. Really cool library to convert excel to pocos. Really made working with excelfiles a breeze.
Thanks for the tip.
Hi Mr.Tim,
Do you recommend a library to preview or export RDL/RDLC reports because ReportViewer is not supported on .Net Core yet?
Ff
Not a free one, no.
@@IAmTimCorey Please what do you recommend instead?
I used to rely on RDL/RDLC reports back in the framework days as well. I moved to DocX and EPPlus to create my Word and Excel-based reports, respectively. There aren't the visual cues you get from designing your report, but I found it easier to create my reports exactly like I want with the data I want.
I use most of those libraries. They are very useful indeed!
Thanks for sharing.
Great video, well done
Thank you very much!
Tim you are a legend ,
Thanks for sharing.
wow ... i would love to see a video about Hangfire ... it would be fun
We appreciate the suggestion and I have added it to Tim's list.
Tim, I’d love to see more EPPlus and how it’s better than just adding a reference to Microsoft.Office.Interop.Excel and working with that library.
Topic suggestion noted and have added to my list, thanks.
@@andreasbramftl1106 thanks for the info. My company has an .NET Framework add in for MS Project that interacts with Excel. All of our clients have excel installed. Given that scenario, is there any benefit to using EPPlus over Interop?
Another great video! Thanks Again!
You are welcome.
Thank you, Tim
Thank you for watching
EPPlus - Life saver working with Excelsheets
Thanks for sharing
Thank you Tim it's really helpful.
Please can you create shay your ideas on how to add Layers into a project? What are the main common Layers ? What other Layers you may add it if needed?
Thank you. And happy new year
I'd love a video on creating PDF/printable reports on .NET 5 Razor/MVC state of the art. Everything I find seems to be old, ugly or generally both. I used Crystal Reports many years ago. That was quite powerful (although, again, ugly and not friendly to use). But I'm not sure what people are using nowadays to create some custom reports from a business web application.
Agreed! Like you, I looked around and was disappointed with the choices. Crystal isn't even an option anymore (except for people sticking to .NET Framework). SAP's (who owns Crystal) forum threads about it show that they have no clue what .NET Core is and say they will never support it. Our company is giving SSRS a try, and it seems decent so far. It lets you use a GUI tool to lay out the reports (taking that load off of the C# programmer), and then your C# code can grab the report via URL (and pass parameters and get back a PDF or whatever).
Topic suggestion noted and have added to my list, thanks.
Hope to see video about SignalR. I am trying to get grasp of it but most of the videos I saw doesn't really explain it that well..
That's high on the priority list.
@@IAmTimCorey cool!! Can't wait to watch and learn! 😊
Beginner here.
We would we need a email library. What' s the benefit compared to something easy and fast like gmail?
An email library is what we use to send email from C# code. It still needs to connect to an email server (like Gmail) to send the actual email. Think of a C# email library as replacing the user typing out the message in an email client. C# does the typing and hits send. It relies on an email server to do the rest.
Very nice video. Interestingly all these problems relate to me and yet I do not have a perfect way to deal with them. Well not anymore...
I am glad it was helpful.
Love Hangfire.
Thanks for sharing
Great heads-up on the EPPlus licensing change. Gotta let my team know.
Glad it helped.
Thanks for the video!
You're welcome!
In regards to your comments about logging, I have a routine that copies data from an Oracle server to an MS SQL Server. It massages some of the data. I like to log what I call exceptions. Data that doesn't fit the norm, but not NECESSARILY incorrect data. If a user calls and indicates that something looks amiss I can pull up that log to see if an exception existed and if so, what didn't it like about it? Do I read the logs? Not normally - only when warranted.
Just be careful there, because that logged data could be sensitive in nature. It is also not connected with the actual data, so you could run into legal issues if a user asks to be forgotten and you leave their information in the log files.
@@IAmTimCorey Thank you for the advice - and it's very solid advice. In this case the exceptions aren't tied to any personal data whatsoever and everything in this data that I'm retrieving is considered public information. I haven't implemented this logging as of yet, just something that I'm looking into. I need for staff to know what data that looked suspicious such as missing a property description. The program makes a safe assumption but it might not be the correct assumption. The owner of the data needs to be aware of the issue and decide whether it is a problem or not.
Any thoughts on Syncfusion products?
Can you please make a video on Mass Transit and Azure Service Bus?
Added to my list, will see if/when I can get to it.
Great Tim 💪
Thanks
I used Hangfire for job scheduling and it is easy to implement it. But only problem is to process parallel jobs we have to purchase the license Hangfire Ace packages
Yep, but that's how they pay for their development costs. The developers have to eat, and that's the way they do it.
I'd love a video or video-series about software-architecture and clean code. I've seen your videos about SOLID and DRY and Refactoring and many more that kinda talk about that topic. But as my applications are growing I still think they become a bit messy. Like where do i put all the Interfaces for dependency Injection. Where do i put all the Repositories for a repository pattern and so on. But also something like, how to manage overloads, or to many parameters for a method. Or I also struggle sometimes to find out which responsibility is something. Let's say for example a chess programm, who stores the position of a chess piece? The piece itself, the board, a tile on the board, or an extra gamestate class,...? And then further who would move those pieces..? I know there a no clear answers to those questions. But any tip or trick on those questions can be really helpfull.
I appreciate the suggestion and added it to my list.
Been using epplus for years. One thing u didn’t mention about it, is that it does not require excel or ms office to be installed on any server. Other libs require that 🙂
Very true. That's a great feature.
Thanks for a very interesting video. It would be great if you would teach more on Hangfire and share a little more details how you used it before. I would also really like a comparison between Hangfire and a Windows Service - when to use which and maybe to mix them. A .Net Core Windows Service is very easy to use as you already demonstrated in one of your videos if you need something to run every 5 minutes (or whatever interval) but what about once a day at a set hour or other variations? That cannot be done without some workarounds but maybe Hangfire is useful there???
Thanks for the suggestion. I have added it to the list of possible future topics.
What are the use cases that required using messages brokers such as RabbitMQ, Azure Bus.. etc?
Any time you have an application that wants to talk to another application in a disconnected manner. Microservices use this technique heavily but it doesn't have to be only them. Having this disconnect means that you can separate out parts of your application and update them without taking down the whole system or even losing anything while they are down.
@@IAmTimCorey Thanks for the very informative explanation, so compared to basic API communication in case using messages brokers we won't need to handle the acknowledgment part, am I right?
Also, one more question related to Hangfire
Can it be used to keep that data sync between applications? if not, what's the process to keep the data sync?
i would be glad if can make a video from a library who is working with the task scheduler system what you can write in your csharp application like the nuget packge task scheduler
Thanks for the suggestion. Please add it to the list on the suggestion site so others can vote on it as well: suggestions.iamtimcorey.com/
Hey Tim, I am in search of a library which can give difference (of values) between two objects. Can you please recommend some?
I'm sorry, I'm not sure what you mean.
That is superb, I'm enraptured by the content. #Fabulous 👌
Great!
The least I can say is THANK YOU
You're welcome
I'm new to C# and I'm enjoying your videos very much. I was reviewing this video on Libraries and I tried downloading one. The big question I have now is, where do you get documentation on what's in the library and how to use it. I did a lot of googling but didn't find any answer. Thanks for any help you can provide. My particular hurdle right now is CSV files.
Hi Tim,
Thanks for sharing such a wonderful post once again. I was wandering whether there are some inbuilt tools to validate Excel data while importing to database. I want to validate my excel file such as columns datatype,sequence,number of columns etc and then store into DB and azure BLOB storage.
Thanks
Uttam tam,
thanks for the information , forgive me i have a very dummy question , which program you use to create the avatar icon face of you in your channel?
Not a program. I have a friend draw them for me: reverentgeek.com/
ya , i see , thanks alot
wishing to you all the best
Hi Tim, which tool do you recommend for logs, Serilog with Seq or Azure application insights?
I know those are different but for register and monitoring errors, which do you recommend?
Both, usually. Applicaiton Insights is good at giving you a big picture on what is going on in your application landscape. Logging is good for digging into specific problems.
Thanks for sharing this, it helps a lot :)
Glad it was helpful!
Do you think that is a good idea to use Hangfire instead to RabbitMQ in microservices, I know that they are different but at the same time very similar, because I think that Hangfire looks cool but at long term maybe is just a toy that is difficult to scale, what do you think?
These are two different technologies that do different things. Hangfire is about scheduling jobs to be run. RabbitMQ is about passing messages between applications. Both are great tools and both have their place. They just aren't interchangeable.
How do you handle PDF Creation? In business software producing PDF Files is as crucial as Excel File manipulation.
Check PDFSharp or iTextSharp
That's pretty much the biggest problem. And especially with these two requirements, unfortunately, it's usually the case that the ones you can use are usually quite expensive.
You can try using inkscape as well for pdf creation it's free
@@SachinDiwate via C# really ????
@@SachinDiwate That's not a solution.
Interesting - will look at EPPlus as it may put a lot of protections against the inconsistency of the Excel reference
And I like the though of better logging
And the email one Papercut makes sense for us.
Excellent! Glad you can use those.
Hi Tim, I would like to know what is best for create and manage jobs?
Azure web jobs vs Azure Functions vs HangFire?
I appreciate it your comment,
Thanks
It depends on the circumstances. You can leave a suggestion for this to be a future video at suggestions.iamtimcorey.com
I am a newby somewhat - I use windows task scheduler for my recurring jobs. Is hangfire basically the same or are there major differences I am not seeing
Hangfire will give you a much better picture of what has been done (great dashboard), it will have better reschedule/retry operations, and you can be more granular in how you schedule your tasks. Basically, you will have a lot more power. If you don't need the additional power, stick with what works.
Thanks for the Excellent video... Please let me know a library to extract text, images, table data, text from OCR scanned images from a PDF.
I don't have one to share. Maybe someone else does.
Thanks for sharing
You are welcome.
Great video thanks.
Glad you liked it!
nice libs. will you make videos later on how to use them and/or integrate them in new projects or existing ones
It depends which ones people want to see more info on.
@@IAmTimCorey I would like a video about the mailing libraries and the difference between the two and how to know which one is better for a specific project and I would like also a video about serialog and the Seq,
and some videos about the steps to deploy an ASP.NET Web App on a physical server (with Docker and Sql Server ) and the best approach to secure it
i know i am demanding a lot from you but you are so good at what you do and you are a gr8 developer
Hi Tim, I didn't really understand the difference between HangFire to a serivce that is automaticly run on schedule...
You might not have access to a service like that in whatever system you're on. And HangFire can do a bit more than run things on schedule. Can't speak for it in depth as I've only used it once a few years ago, but it's a great tool, for sure.
A service typically runs in the background on your computer. It might fire every minute and you can "schedule" it to do things. However, hangfire can do things like weekly, daily, etc. schedules, plus they can do chained tasks and more. You could write enough code to do what hangfire does, but it would take a lot of work.
How to pop up selectable data rows from textbox i.e. a textbox in a form when space key pressed a pop up will appear from db and we can select the name of the firm that we want for transaction, on selection the selected value will go inside the textbox child ti parent .
Hangfire would be awesome to see...
Thanks for the suggestion.
Great tutorial really appreciated, it's good to know what other developers are using so you don't get lost into the myriads of tools while there are better tools out there.
How would you suggest the use of Hangfire for task automation over let say creating your own windows service with another tool like topshelf which make it easier to create windows services, you have also discussed it in one of your videos? Can a windows service do all what can Hangfire do or hangfire is super easy to implement than a windows services?
Email is one of things that are almost needed in business application, if you could discuss in one of your videos how to use these email application tools like MailKit (pop3/imap,smtp) , papercut the better way.
Thanks a lot
Hangfire is about scheduling. Services are about running outside of a user's account. The two can be used together quite successfully. You can create a service that uses hangfire to schedule jobs to be run. By default, a service just runs all of the time. It is not set up to run things on a schedule (with retry, etc.) This is what hangfire adds.
@@IAmTimCorey thanks
hey Tim, thanks for all your works. New to your channel, i will defenetly stick around. Question about all commercial licences like the EPPlus 5 you presented us. If i'm a freelancer making programs for customers. If i (as an external developper) pay for the licence, are my customers in right to use the program even if they are not the licence owners?
Each company will specify what you can and cannot do with their software. In the case of EPPlus specifically, you can probably just purchase a license for yourself. Here is the FAQs that explain a bit better: www.epplussoftware.com/en/LicenseOverview/LicenseFAQ
In asp.net core web api, is it possible to raise an event from an class, and listen to this event from another class and based on the event, do some task. How to achieve this? Also what is event-event handler-event bus? Very confusing. I was trying to decouple events in a standard .net library and was trying to move all events in one library. But got very confused.
You are right about EPP but what I don't like. Is when they start out as "free" libraries then change everything out of the blue. I'd much prefer if they were upfront with their long term plans from get go. Same problem with Identity Server 4 imho. But it is up to them of course. But then. MS makes Excel, they make VStudio. Would it be too much to ask for them to add something like this in the package? It's not like they have travel far to find the specs :).
I agree it would be good to know, but I don't think they always know at the start.
Can I use Hangfire to schedule jobs per users? And is it possible to store the job in a dB jus in case server goes down?
Hangfire does store jobs in a database, along with the outcome of the executions of those jobs. As for per-user hangfire, I'm not sure what you mean. The hangfire service will run as one user. However, you could create jobs for each user.
@@IAmTimCorey ohh okay, so I am building an app where I'll have recurring jobs per user. So for example, a user will input that every Sunday to execute a purchase of X dollar bitcoin using an API.
Would I be able to store the user recurring jobs in the dB and would hangfire be able to handle these types of recurring buys?
Thanks!
Really nice picks of libraries :) When theres so much choice its hard to pick the best ones. It would be cool to find some newly emerged Libraries that are really cool but not a low of people have downloaded them yet
If you find those "emerged Libraries that are really cool", please share them here!
Any thoughts on just using OleDb to read excel files (with MS Access Database Engine)?
That requires Excel to be installed on the server. That's not a great situation (plus OleDb is messy).
I was hoping to find in this video a library to generate PDFs (let's say to create invoices for example), but alas... Tim, do you have any suggestion though?
I don't have a great solution for you, no. Sorry. I'm working to get options to show off.
I love u Tim!
Thanks
I want to see more videos like this.
Noted, thanks!
the only thing i would comment is that these are third party libraries and they wont offer you much benefit behind a firewall. Third party libraries get flagged in things like Veracode, Checkmarx, etc all the time and most companies dont let you use third party libraries in production. Ive written my own email class, csv class, logging class... probably a dozen times and THAT is what makes good class code - writing it yourself so that you understand how and why certain .NET methods are used. If you leave the logic up to a third party library then you cant specify important things like impersonation, smtp, encryption, process flow, business logic, etc. I highly recommend to all new devs, WRITE IT YOURSELF FIRST and if you fail find the third party library and figure out how they wrote it and how it fits their use case, then start from scratch again and figure out how it fits your own use case.
I disagree when it comes to the firewall issue. That would be the case for full applications (like Seq) potentially, but NuGet packages are just C# code. They shouldn't be flagged by a system unless your own code might also get flagged. The only exception to this would be if the system did not properly allow NuGet packages, which would be a problem since even Microsoft is breaking their systems apart into NuGet packages for modularity.
@@IAmTimCorey ok i see a nuget package is indistinguishable from any other C# code in the project. That issue sounds familiar so most likely the case in my situation thanks for that i did not realize these werent binaries
Hi Time. I stopped using hangfire cos I realized when it is used to fire a long running task, it would time out and call the task again causing duplicate calls.. So I fell back to using windows services for running repeated/scheduled task
Interesting. You should be able to tweak your setup to fix that. Are you making the calls async?