- Видео 74
- Просмотров 8 131
SciGeeks universe
Италия
Добавлен 1 янв 2023
Tune in to talk about everything data analysis in a cloud-native world. I'm dciangot, your host, and I'm a physicist specialized in software architectures for large scale data analysis.
From machine learning to data visualization, I'll take you through step-by-step tutorials and demonstrations that cover best practices for reproducibility and data management with cutting-edge technologies. Join me and together we'll learn how to conduct transparent, accurate and reproducible scientific research.
From machine learning to data visualization, I'll take you through step-by-step tutorials and demonstrations that cover best practices for reproducibility and data management with cutting-edge technologies. Join me and together we'll learn how to conduct transparent, accurate and reproducible scientific research.
Kubernetes: The Secret Weapon for Accelerating Research
Let's see the how Kubernetes Virtual nodes create a unified compute environment across diverse hardware and software platforms and discover the benefits of this approach for accelerating HEP research and unlocking new scientific discoveries!
We put our hands onto the world where interLink born. An high energy physics (#HEP) initiative presented at #CHEP2024.
The adventure to make Kubernetes data science frameworks seamlessly delegating tasks to #SLURM batch systems at #euroHPC centers is just at the beginning! Stay tuned!
intertwin-eu.github.io/interLink/
#scientificcomputing #devops #mlops #kubernetes #virtualkubelet #ml #gpus #cloudcomputing #distributedcomputing
We put our hands onto the world where interLink born. An high energy physics (#HEP) initiative presented at #CHEP2024.
The adventure to make Kubernetes data science frameworks seamlessly delegating tasks to #SLURM batch systems at #euroHPC centers is just at the beginning! Stay tuned!
intertwin-eu.github.io/interLink/
#scientificcomputing #devops #mlops #kubernetes #virtualkubelet #ml #gpus #cloudcomputing #distributedcomputing
Просмотров: 66
Видео
Cut Your GPU Costs with These Strategies
Просмотров 92Месяц назад
Episode Summary In this episode of the SciGeeks podcast Dario Tranchitella, co-founder of Clastix, guide us through innovative solutions in Kubernetes that adopt virtual kubelets for GPU on-demand computing. This the first of two edited parts for an improved watch experience. Fill free to go directly to the live recording if you want: ruclips.net/user/liveIzlbOpRrNx0?si=97yRhxCIjgZdCMUU Key Top...
Revolutionizing Helm Charts with GenAI
Просмотров 722 месяца назад
Revolutionizing Helm Charts with GenAI
Dockerize Your Machine Learning Workflow with MLflow
Просмотров 4282 месяца назад
Dockerize Your Machine Learning Workflow with MLflow
Mastering Kubernetes-based Testing with Dagger & CI/CD: A Step-by-Step Guide
Просмотров 1563 месяца назад
Mastering Kubernetes-based Testing with Dagger & CI/CD: A Step-by-Step Guide
TLS Certificate Creation Made Easy: uncovering mkcert!
Просмотров 6443 месяца назад
TLS Certificate Creation Made Easy: uncovering mkcert!
Keep Your Data Safe while using a Public Cloud (Part 1)
Просмотров 1166 месяцев назад
Keep Your Data Safe while using a Public Cloud (Part 1)
Scripting with AI to analyze CERN open data with GPTScript!
Просмотров 2907 месяцев назад
Scripting with AI to analyze CERN open data with GPTScript!
The Ultimate Data Science Solutions at KubeCon 2024
Просмотров 987 месяцев назад
The Ultimate Data Science Solutions at KubeCon 2024
Data sharing trends transforming scientific research
Просмотров 748 месяцев назад
Data sharing trends transforming scientific research
I broke the Kube - extend your cluster with Civo GPUs in 5 minutes!
Просмотров 2218 месяцев назад
I broke the Kube - extend your cluster with Civo GPUs in 5 minutes!
Data Science everywhere with JupyterLab and Acorn - no kubernetes skills needed | Tutorial
Просмотров 17710 месяцев назад
Data Science everywhere with JupyterLab and Acorn - no kubernetes skills needed | Tutorial
Unleashing the Power of Open Science with Docker!
Просмотров 7811 месяцев назад
Unleashing the Power of Open Science with Docker!
Extend your cloud on any HPC supercomputer!
Просмотров 18511 месяцев назад
Extend your cloud on any HPC supercomputer!
Introducing myself... oh, and the Scigeeks universe!
Просмотров 97Год назад
Introducing myself... oh, and the Scigeeks universe!
Makeover Your JupyterLab Containers Like a Pro!
Просмотров 230Год назад
Makeover Your JupyterLab Containers Like a Pro!
Speed Up Your Coding: Launch JupyterLAB on DOCKER in Minutes!
Просмотров 555Год назад
Speed Up Your Coding: Launch JupyterLAB on DOCKER in Minutes!
Unpacking the Basics of Docker! [Part 1]
Просмотров 95Год назад
Unpacking the Basics of Docker! [Part 1]
A Scientific Look at Digital Twins: What They Are and How They Work
Просмотров 52Год назад
A Scientific Look at Digital Twins: What They Are and How They Work
Science and Cloud Computing: 3 reasons why learning the Technology Can Advance Your Research
Просмотров 37Год назад
Science and Cloud Computing: 3 reasons why learning the Technology Can Advance Your Research
Aaaand, wrong mic activated 😂
Prem's
Thanks for this series. Getting familiar with Slurm and the VirtualKubelet integration. 🎉
@@alejandrobellezaparedes glad to hear that! I'd love to hear about your experience. If you need any help feel free to join the interLink slack channel here (if you have not already): join.slack.com/t/intertwin/shared_invite/zt-2cs67h9wz-2DFQ6EiSQGS1vlbbbJHctA
dagger.io/
is there a repo for this anywhere?
Sure, we created it in the second/follow up demo. If you don't mind spoilers, you can take a look at here github.com/dciangot/kaggle-dagger . We will have a part 3 too this week, where we are going to see how to document the dagger module + more stuff. In one word stay tuned :)
Great insights on Kubecon and top tech! I'm eager to explore KubeFlow and Dagger myself. Looking forward to live sessions!
Awesome, thank you! In fact, in my mind, Dagger was the one to start with
Complimenti per questo progetto Ciango... d'altronde la stoffa era evidente già da tempo! Non capisco un granché di questo mondo ma immagino che le possibilità di applicazione siano enormi e ho la sensazione che l'innovazione che c'è dietro avrà nel prossimo futuro un enorme impatto anche nelle vite delle persone comuni... Non so se mi confondo, ma alcuni dei concetti di cui parli (se capisco bene 🤓) mi sembrano legati ad alcune delle principali narrative di cui sento parlare nel mondo decentralizzato (o che pretende di essere tale) del Web3. Tutto questo "pippone" per dire... le competenze che stai divulgando sono applicabili anche da neofiti e per scopi diversi dalla pura ricerca? Un abbraccio, e complimenti ancora! 😎
Ciao!! Grazie un po' per tutto, anche per la domanda :) si confermo che il punto è proprio quello, ovvero cosa la ricerca può prendere da altri contesti, ma sicuramente anche viceversa!
Ciango, non mi aspettavo un saluto troppo più caloroso ma ho il dubbio che non mi hai riconosciuto. Prova a leggere il nome… complimenti di nuovo. Magari ci sentiamo attraverso canali più privati 👌
Ahahahah, scusa! Ma chi ci pensava! 😅 Certo, cercami dove preferisci!
Pretty cool!