Monitoring .Net with OpenTelemetry Prometheus and Grafana

[@Pierre.69]

Used prometheus and grafana for the first time today with your help, useful video, thanks!

[@developingwoot]

Awesome! I'm so glad to hear that. It's a super cool platform.

[@oladejiakomolafe5591]

Good. Clear and succinct explanation. Thank you

[@developingwoot]

I appreciate it, thanks so much!

[@papciuszkin]

Great video! Really clear and to the point

[@developingwoot]

Thanks so much 🙏

[@rupenanjaria]

Nice vide0, however, I am getting "System.NotSupportedException: 'Endpoint URI scheme (otel-collector) is not supported. Currently only "http" and "https" are supported.'" when trying to run. The error seems from program.cs builder configuration line. Any idea?

[@developingwoot]

I did get that error too at one point. It's been a minute and I can't remember what my solution was.. I think it had to do with something misconfigured in my appsettings but I'm not totally sure. If your code is in a public repo I'd be happy to dig through it and see if I can figure it out.

[@rupenanjaria]

@@developingwoot nm, I was able to run it. I was trying to run using visual studio command, instead I should use docker command, that was the issue. Thank you.

[@nadimkhoury8010]

nice, is there a way to then store the data in a postgreSQL data base

[@developingwoot]

Prometheus uses time series data and PostgreSQL isn't to my knowledge optimized for that type of data. There are other databases that are like influxdb and it supports remote read and write. I've never used it myself because we just haven't needed any additional storage solution up to this point

[@catex5452]

I want to track a dateTime value with System.Diagnostics.Metrics, OpenTelemetry, Prometheus and Grafana. Is that possible? Right now I did it with a counter where I add unix seconds but that's probably not optimal... If I could display the unix seconds as a date in grafana that would technically be enough though. Can you help?

[@developingwoot]

What specifically are you trying to track? For example are you trying to track the length of time it takes a request to complete?

[@catex5452]

@@developingwoot I want to track the date + time when something got imported and the date + time of the next import. I just changed my logic to using two ObervableGauge's for it (lastImportTime, nextImportTime). Each returns a list of measurments containing a long value(unix timestamp) + tag. I basically just want to show two dates in my grafana dashboard. Last Import and next import.

[@catex5452]

The tags consist of a key "environment" and a string which represent the type of document that got imported. I'd like to create dashboards for the different tags. for example lastImportedXmlDate, lastImportedJsonDate etc. So I want more than just two dates, sorry for the wrong information. Two dates per environment.

[@developingwoot]

@@catex5452 are you just wanting logs or are you charting this?

[@catex5452]

@@developingwoot I'm not sure if I know what you mean. I think I just want to display stats. (I never worked with Grafana before)
Here you can see my code:
using System;
using System.Diagnostics.Metrics;
namespace Import.FileListener
{
public class MetricsManager
{
private Meter meter;
private Counter importedCounter;
private ObservableGauge lastImportTimeGauge { get; set; }
private ObservableGauge nextImportTimeGauge { get; set; }
private List lastImportTimes = new List();
private List nextImportTimes = new List();
// Singleton instance of MetricsManager
private static readonly MetricsManager _instance = new MetricsManager("MetricsManager", "1.0.0");
public static MetricsManager Instance => _instance;
private MetricsManager(string meterName, string meterVersion)
{
meter = new Meter(meterName, meterVersion);
importedCounter = meter.CreateCounter("imported-files");
lastImportTimeGauge = meter.CreateObservableGauge("last-import-time", () => { return lastImportTimes; });
nextImportTimeGauge = meter.CreateObservableGauge("next-import-time", () => { return nextImportTimes; });
}
public void SetImportTimes(string fileName, DateTime lastImport, int intervalSeconds)
{
long lastTime = new DateTimeOffset(lastImport).ToUnixTimeSeconds();
long nextTime = new DateTimeOffset(lastImport.AddSeconds(intervalSeconds)).ToUnixTimeSeconds();
lastImportTimes.Add(new Measurement(lastTime, new KeyValuePair("environment", fileName)));
nextImportTimes.Add(new Measurement(nextTime, new KeyValuePair("environment", fileName)));
}
public void Increment(string fileName)
{
importedCounter.Add(1, new KeyValuePair("environment", fileName));
}
}
}

[@rajeshk5211]

Can you please extend the video including loki for logging

[@developingwoot]

Oh that's a good idea. I'll see what I can do. I hope you found what's there helpful.

[@rajeshk5211]

​@developingwoot The video is simple and straightforward, and it is indeed very useful. Thanks for your effort.

[@KnowledgePlayTV]

can you please make a video on opentelemetry + .net core without docker? btw nice lecture and useful content.

[@developingwoot]

Yeah I could probably do something like that are you still thinking Prometheus and Grafana? I used Docker because it is really nice in that it just starts those services for you. But I'll see what I can do.

[@KnowledgePlayTV]

@@developingwoot thank you for your reply.

[@developingwoot]

I've posted that video for you 👍

[@KnowledgePlayTV]

@@developingwoot thank you so much for your effort.