VΞLODB
VΞLODB
  • Видео 49
  • Просмотров 14 790
Real-Time Analytics with Apache Doris: Everything You Need to Know
Colin Wang, an Apache Doris contributor and now a Product Manager at VeloDB, introduces the Apache Doris capabilities in real-time analytics. As a previous Solution Architect, Colin has years of experience in assisting Doris users in production environment and accumulated valuable user-oriented insights.
His talk will cover:
🎙️ Introduction to Apache Doris' capabilities for real-time analytics, from data imports to queries and fast data changes
🎙️ Real-time data ingestion and storage
🎙️ Features to enable lightning response to real-time data services and interactive data analysis
🎙️ Pre-aggregation and real-time joins
🎙️ Features to support high-concurrency queries (10K QPS per node)
🎙️ Functio...
Просмотров: 71

Видео

Real-Time Data Enrichment and Analytics with RisingWave and Apache Doris
Просмотров 9521 день назад
This is the last session of the Apache Doris Meetup @Singapore on October 24. Liu Zhi, Product Manager of RisingWave discussed real-time data enrichment and analytics using RisingWave and Apache Doris: "Streaming process and OLAP are not like a one-to-replace-the-other relationship. It's more like: Each of the processing paradigm tries to solve a different use case. So when people first come up...
Blockchain analytics solution using Apache Doris
Просмотров 142Месяц назад
This is the user story of Footprint Analytics. It is a session of the Apache Doris Meetup @Singapore on October 24. Wade Deng, Co-Founder & CTO at Footprint Analytics and XCelsior AI, talked about their blockchain analytics solution using Apache Doris. He started with the introduction to the data platform and architecture of Footprint Analytics, and explained why they chose Apache Doris among o...
Multi-stream real-time data analysis solution with Apache Doris
Просмотров 96Месяц назад
This is the user story of Douyin Group, a livestream e-commerce giant. It is a session of the Apache Doris Meetup @Singapore on October 24. Boyang Chen, a database development engineer and an Apache Doris Contributor, introduced the usage of Doris in Douyin Group and discussed multi-stream data analysis as a common use case based on Doris: "I would use three keywords to describe the Doris usage...
Apache Doris: A Real Time Data Warehouse
Просмотров 480Месяц назад
This is the keynote speech of the Apache Doris Meetup @Singapore on October 24. Mingyu (Rayner) Chen, the Apache Doris PMC Chair introduces Apache Doris, covering its application scenarios and the technical implementation that powers it, highlighting Doris' fast performance, user friendliness, and capabilities to handle different types of analytics workloads: “Apache Doris is friendly for first...
Apache Doris Meetup @Singapore
Просмотров 89Месяц назад
On October 24 ("1024"), a day that resonates with tech enthusiasts, the Apache Doris community came together for an engaging meetup in Singapore. The meetup kicked off with a presentation by the Apache Doris PMC Chair, who introduced the technical features of Doris, highlighting its fast performance, user friendliness, and capabilities to handle different types of analytics workload. Boyang Che...
Multi-tenant workload isolation in Apache Doris: Workload Manager, CPU soft limit, CPU hard limit
Просмотров 2307 месяцев назад
This is a hands-on guide to using the Workload Manager in Apache Doris to set a CPU soft/hard limit for Workload Groups. Workload Group is a way to isolate resources for various workloads. A CPU soft limit can increase resource utilization rate on the basis of isolated resources, while a CPU hard limit ensures stable performance for high-priority workloads. #database #dataengineering #multitena...
Arrow Flight SQL in Apache Doris for 10X faster data transfer
Просмотров 1,4 тыс.8 месяцев назад
Apache Doris 2.1 supports Arrow Flight SQL protocol for reading data from Doris. It delivers tens-fold speedups compared to using PyMySQL and Pandas, making itself a handy tool for data science usage and data lake analytics. #datascience #dataengineering #ApacheArrow #bigdata #python
Auto-Increment column in Apache Doris
Просмотров 3648 месяцев назад
Auto-increment columns in Apache Doris 2.1 accelerates dictionary encoding and pagination without damaging data writing performance. It is also very useful in primary key generation and detailed data updates. This is an introduction to its usage, applicable scenarios, and implementation details. #dataengineering #analytics #datatable #database
Build a fast data lake analysis solution with Apache Hudi and Apache Doris
Просмотров 3779 месяцев назад
Mingyu Chen, Apache Doris PMC Chair, introduces a Hudi Doris data lake analytic solution a guest speaker at the Hudi community sync. Topics include: 1. What is Apache Doris 2. Apache Doris architecture, community, and user base 3. Apache Doris data lakehousing solution and technologies 4. Benchmark test and show case
Variant: a new data type 8 times faster than JSON for semi-structured data analysis
Просмотров 2529 месяцев назад
Apache Doris 2.1.0 provides a new data type: Variant, for semi-structured data analysis. This video showcases how to use Variant to accommodate data and conduct queries with it. Applicable industry scenarios include e-commerce, telecommunication, mobile applications, IoT, and IoV. #bigdata #database #analytics #dataengineering #opensource
Introduction to Apache Doris: A Next Generation Real-Time Data Warehouse
Просмотров 7 тыс.Год назад
A technical overview of Apache Doris, introducing how it enables fast query performance with its outstanding architectural design, features, and mechanisms. #datascience #database #dataanalytics #dataengineering
Apache Doris v2.0.0-alpha1 Release
Просмотров 292Год назад
ApacheDoris 2.0.0 Alpha 1 is ready for trial and test ! Here is the following upgrades: 1. Semi structured data storage 2. High-concurrency & low-latency point query 3. Vertical compaction 4. Separation of hot/cold data 5. Nereids (A Brand New Planner) Release Note : github.com/apache/doris/issues/19231 Official Download: doris.apache.org/download/ 🌟CONTENT 0:00 Welcome & Introduction 2:10 Rele...
Apache Doris v1.2.1 & v1.2.2 Release Webinar
Просмотров 413Год назад
ApacheDoris 1.2.1 is available now ! Here is the following upgrades: 1. Automatic synchronization of Hive metastore 2. Iceberg Snapshot 3. JDBC Catalog supports PostgreSQL, Clickhouse, Oracle, SQLServe 4. Auto Bucket 5. width_bucket 🌟CONTENT 0:00 Welcome Introduction 1:01 Apache Doris v1.2.1 Overview 10:20 Apache Doris v1.2.2 Release 25:27 Batch Partitioning & Auto Bucket Live Demo 35:34 Q & A ...
"Evolution of Apache Doris in Moka BI"_Apache Doris Summit 2022
Просмотров 67Год назад
"Evolution of Apache Doris in Moka BI"_Apache Doris Summit 2022
"Best Practice: The Application of Baidu Palo in ZHIHU.COM"_Apache Doris Summit 2022
Просмотров 38Год назад
"Best Practice: The Application of Baidu Palo in ZHIHU.COM"_Apache Doris Summit 2022
"Application of Apache Doris in 360 Technology Group"_Apache Doris Summit 2022
Просмотров 61Год назад
"Application of Apache Doris in 360 Technology Group"_Apache Doris Summit 2022
"Application of Apache Doris in Yiguanzhiku Network Technology"_Apache Doris Summit 2022
Просмотров 35Год назад
"Application of Apache Doris in Yiguanzhiku Network Technology"_Apache Doris Summit 2022
"Application of Apache Doris in YundaEX"_Apache Doris Summit 2022
Просмотров 32Год назад
"Application of Apache Doris in YundaEX"_Apache Doris Summit 2022
"Application of Apache Doris in LY Digital"_Apache Doris Summit 2022
Просмотров 130Год назад
"Application of Apache Doris in LY Digital"_Apache Doris Summit 2022
"Application of Apache Doris in JD.COM"_Apache Doris Summit 2022
Просмотров 29Год назад
"Application of Apache Doris in JD.COM"_Apache Doris Summit 2022
"Application of Apache Doris in Douyu"_Apache Doris Summit 2022
Просмотров 62Год назад
"Application of Apache Doris in Douyu"_Apache Doris Summit 2022
"Realtime Data Warehouse in Mashang Consumer Finance Based on Apache Doris"_Apache Doris Summit 2022
Просмотров 120Год назад
"Realtime Data Warehouse in Mashang Consumer Finance Based on Apache Doris"_Apache Doris Summit 2022
"Best Practice: Multidimensional Analysis with Apache Doris in Xiaomi"_Apache Doris Summit
Просмотров 256Год назад
"Best Practice: Multidimensional Analysis with Apache Doris in Xiaomi"_Apache Doris Summit
"Application of Apache Doris in Manufacturing in Data Platform"_Apache Doris Summit 2022
Просмотров 56Год назад
"Application of Apache Doris in Manufacturing in Data Platform"_Apache Doris Summit 2022
"Risk Control Data Mart in Bank of Hangzhou Consumer Finance Company"_Apache Doris Summit 2022
Просмотров 28Год назад
"Risk Control Data Mart in Bank of Hangzhou Consumer Finance Company"_Apache Doris Summit 2022
"Application of Apache Doris in Meituan"_Apache Doris Summit 2022
Просмотров 61Год назад
"Application of Apache Doris in Meituan"_Apache Doris Summit 2022
"Application of Apache Doris in Pocket Xianji Network Technology"_Apache Doris Summit 2022
Просмотров 27Год назад
"Application of Apache Doris in Pocket Xianji Network Technology"_Apache Doris Summit 2022
"Application of Apache Doris in Tencent Music"_Apache Doris Summit 2022
Просмотров 54Год назад
"Application of Apache Doris in Tencent Music"_Apache Doris Summit 2022
"Design of Multi-Table Materialized View"_Apache Doris Summit 2022
Просмотров 63Год назад
"Design of Multi-Table Materialized View"_Apache Doris Summit 2022

Комментарии

  • @VeloDB_IO
    @VeloDB_IO 9 дней назад

    Join the Apache Doris Community to meet the Doris makers and users 🙌 join.slack.com/t/apachedoriscommunity/shared_invite/zt-2gmq5o30h-455W226d79zP3L96ZhXIoQ

  • @VeloDB_IO
    @VeloDB_IO 23 дня назад

    With this, we’ve wrapped up all sessions from the Apache Doris Meetup @Singapore! If you’re still eager to connect with the Apache Doris community, don’t miss the upcoming online webinar. Colin Wang will provide an in-depth introduction to 🌟Real-Time Analytics with Apache Doris: Everything You Need to Know🌟. Stay tuned and join us! www.linkedin.com/events/real-timeanalyticswithapachedor7270048963964080129/theater/

  • @moverecursus1337
    @moverecursus1337 23 дня назад

    Awesome!

  • @ChristopherNelson-k8i
    @ChristopherNelson-k8i 29 дней назад

    Thanks for the analysis! A bit off-topic, but I wanted to ask: I have a SafePal wallet with USDT, and I have the seed phrase. (alarm fetch churn bridge exercise tape speak race clerk couch crater letter). How can I transfer them to Binance?

  • @moverecursus1337
    @moverecursus1337 Месяц назад

    Great! 👏

  • @VeloDB_IO
    @VeloDB_IO Месяц назад

    The slides can be downloaded here: docs.velodb.io/resources/resources/ppt/doris-singapore-meetup#1-keynote-apache-doris Any questions about Apache Doris are welcomed: join.slack.com/t/apachedoriscommunity/shared_invite/zt-2gmq5o30h-455W226d79zP3L96ZhXIoQ

  • @VeloDB_IO
    @VeloDB_IO 7 месяцев назад

    Multi-tenant workload isolation: a better balance between isolation and utilization: doris.apache.org/blog/multi-tenant-workload-isolation-in-apache-doris/

  • @VeloDB_IO
    @VeloDB_IO 7 месяцев назад

    Join Apache Doris community: join.slack.com/t/apachedoriscommunity/shared_invite/zt-2gmq5o30h-455W226d79zP3L96ZhXIoQ

  • @VeloDB_IO
    @VeloDB_IO 8 месяцев назад

    For more details, please check: doris.apache.org/blog/arrow-flight-sql-in-apache-doris-for-10x-faster-data-transfer

  • @VeloDB_IO
    @VeloDB_IO 8 месяцев назад

    Join the Apache Doris Community on Slack: join.slack.com/t/apachedoriscommunity/shared_invite/zt-2gmq5o30h-455W226d79zP3L96ZhXIoQ

  • @VeloDB_IO
    @VeloDB_IO 8 месяцев назад

    Apache Doris blog introducing auto-increment column: doris.apache.org/blog/auto-increment-columns-in-databases

  • @VeloDB_IO
    @VeloDB_IO 8 месяцев назад

    Join Apache Doris Community on Slack: join.slack.com/t/apachedoriscommunity/shared_invite/zt-2gmq5o30h-455W226d79zP3L96ZhXIoQ

  • @nilanjansarkar100
    @nilanjansarkar100 9 месяцев назад

    Great presentation, but it would be great if you guys could release a docker image for devs to try out the product easily

    • @VeloDB_IO
      @VeloDB_IO 9 месяцев назад

      Thanks a lot! The Docker images for Apache Doris can be found on DockerHub: hub.docker.com/r/apache/doris, and this is the guide for compilation with Docker: doris.apache.org/docs/install/source-install/compilation-general/. The Doris community embraces any feedback.

  • @VeloDB_IO
    @VeloDB_IO 9 месяцев назад

    For a technical overview of the data lakehousing capabilities of Apache Doris, please see: doris.apache.org/docs/2.0/lakehouse/lakehouse-overview

  • @VeloDB_IO
    @VeloDB_IO 9 месяцев назад

    We embrace any input in the Apache Doris community on Slack: join.slack.com/t/apachedoriscommunity/shared_invite/zt-2gmq5o30h-455W226d79zP3L96ZhXIoQ

  • @VeloDB_IO
    @VeloDB_IO 9 месяцев назад

    For more information, check out the Apache Doris blog post about Variant: doris.apache.org/blog/variant-in-apache-doris-2.1

  • @BryanChance
    @BryanChance Год назад

    Excellent presentation. Thank you.

  • @VeloDB_IO
    @VeloDB_IO Год назад

    Join the Apache Doris community on Slack: join.slack.com/t/apachedoriscommunity/shared_invite/zt-2gmq5o30h-455W226d79zP3L96ZhXIoQ

  • @VeloDB_IO
    @VeloDB_IO Год назад

    Slides of the talk for your reference: docs.google.com/presentation/d/1ZvAcsO6QJdDYJOctiYZ50Gnm78d9Id1HjRQ0Q8zoj04/edit#slide=id.g2802b045d13_2_94

  • @armastro99
    @armastro99 Год назад

    Could you add english subtitles?