Reinforcement Learning: Bridging The Gap Between Research and Applications

🔊 Recorded at PyCon DE & PyData Berlin 2024, 24.04.2024
2024.pycon.de/...
🎓 Watch how the open-source library Tianshou is bridging the gap between research and applications in reinforcement learning, making it easier for researchers and engineers to accelerate progress and adoption in industry.
Speakers:
Michael Panchenko
Description:
Michael Panchenko, Lead Researcher, emphasized the urgent need to bridge the existing gap between reinforcement learning (RL) research and its practical applications during his recent talk. He discussed the challenges hindering the utilization of RL in real-world settings, pointing out the lack of mature software frameworks tailored to facilitate its implementation. Panchenko introduced the open-source library Tianshou, designed to streamline RL application development for both researchers and engineers. This library offers high-level interfaces for seamless integration of RL algorithms in industrial scenarios, while also providing lower-level APIs to cater to the specific needs of researchers.
Panchenko highlighted the disparity between the vast potential of RL in various decision-making processes and its limited current applications across industries. He noted that crucial advancements in RL research often fail to be incorporated into existing frameworks, and successful industry applications of RL are seldom shared in open-source platforms. The complexity of RL, compared to supervised learning, was identified as a significant barrier to its widespread adoption in software development.
Drawing parallels to the evolution of PyTorch and Keras in deep learning, Panchenko expressed optimism about the future of RL software, envisioning a landscape that would simplify the implementation of RL tasks for both researchers and machine learning engineers. He emphasized the efforts of the appliedAI Institute for Europe and Tianshou developers in enhancing the library to democratize RL applications and expedite reliable research in the field.
Panchenko underscored the significance of Tianshou's high-level interfaces for effortless integration of RL
⭐️ About PyCon DE & PyData Berlin:
The PyCon DE & PyData conference unite the Python, AI, and data science communities, offering a unique platform for collaboration and innovation. The PyCon DE & PyData Berlin 2024 conference, hosted in partnership with the local Berlin PyData chapter, provided an exceptional experience, fostering deeper connections within the Python community while showcasing advancements in AI and data science. Attendees enjoyed a diverse and engaging program, solidifying the event as a highlight for Python and AI enthusiasts nationwide.
Follow us:
• LinkedIn: / 28908640
• X: www.x.com/pyconde
• X: www.x.com/pyda...
Links:
• Conference website: pycon.de
• Related sessions: 2024.pycon.de/p...
The conference is organized by
• Python Softwareverband e.V.: pysv.org
• NumFOCUS Inc.: numfocus.org
• Pioneers Hub gemeinnützige GmbH: pioneershub.org
If you enjoyed this session, please like, comment, and subscribe to our channel for more insightful talks and discussions.
Share this video with your network to spread the knowledge!
Hashtags:
#Python #PyConDE #PyData #OpenSource #AI #DataScience #MachineLearning #SoftwareDevelopment #LLMs #Community
Acknowledgements:
Special thanks to all the volunteers and sponsors who made this event possible.
About:
Python Softwareverband e.V.:
PySV is a non-profit that promotes the use and development of Python in Germany through events, education, and advocacy, fostering an open Python community.
NumFOCUS Inc.
supports open-source scientific computing by providing financial and logistical support to key projects like NumPy and Jupyter, promoting sustainable development and collaboration.
Pioneers Hub gemeinnützige GmbH:
is a non-profit fostering innovation in AI and tech by connecting experts and promoting knowledge exchange through events and collaborative initiatives.
www.pydata.org
PyData is an educational program of NumFOCUS, a 501(c)3 non-profit organization in the United States. PyData provides a forum for the international community of users and developers of data analysis tools to share ideas and learn from each other. The global PyData network promotes discussion of best practices, new approaches, and emerging technologies for data management, processing, analytics, and visualization. PyData communities approach data science using many languages, including (but not limited to) Python, Julia, and R.

[@6Diego1Diego9]

he wont open source this hypothetical new framework? sad

[@MischaPanch]

I might actually do it soon since there'd be at least two users I know of (more than zero), but it will probably be very difficult to grow a community around it