Working with filesystem in Time Series database - DevConf.US 2024

Speaker(s): Roman Khavronenko
---
Time Series databases face the significant challenge of processing vast amounts of data. At VictoriaMetrics, we are actively developing an open-source Time Series database entirely from scratch using Go. Our average installation handles between 2 to 4 million samples per second during ingestion, with larger setups managing over 100 million samples per second on a single cluster.
In his presentation, Roman will explore various techniques essential for constructing write-heavy applications such as:
- Understanding and mitigating write amplification.
- Implementing instant database snapshots.
- Safeguarding against data corruption post power outages.
- Evaluating the advantages and disadvantages of utilizing Write Ahead Log.
- Enhancing reliability in Network File System (NFS) environments.
Throughout the talk, Roman will illustrate these concepts with real code examples sourced from open-source projects.
---
Full schedule, including slides and other resources:
pretalx.com/de...