High performance PyTorch with Rust demo

High performance PyTorch with Rust demo

Pragmatic AI Labs

1 год назад

4,319 Просмотров

A non-sequitur I sometimes hear about #rust is that it isn't widely used in production (i.e., it is risky to use). In this video, I talk about one of the most impressive use cases, @amazon #firecracker that powers #aws #lambda. Can you get bigger than this? Then I dive into training models in Rust with #pytorch that target the GPU. Any forward-thinking company in the #mlops space needs SERIOUSLY to consider their #rust for #mlops strategy. If "you are not sure, " your competitors may beat you while you sleep using Python.


I also briefly discuss #sonos #tract and #modelportability via #onnx. Again, a main advantage of #rust #binarydeployment.

Firecracker Architecture Diagram: https://firecracker-microvm.github.io/

Sonos Tract: https://github.com/sonos/tract

Reproducible GPU examples of PyTorch training: https://github.com/nogibjj/rust-pytorch-gpu-template

#firecracker #rust #pytorch #deeplearning #systemsprogramming

If you enjoyed this video, here are additional resources to look at:

Open Source Platforms for MLOps: https://www.coursera.org/learn/open-source-mlops-platforms-duke
Python Essentials for MLOps: https://www.coursera.org/learn/python-essentials-mlops-duke

Coursera + Duke Specialization: Building Cloud Computing Solutions at Scale Specialization: https://www.coursera.org/specializations/building-cloud-computing-solutions-at-scale

Python, Bash, and SQL Essentials for Data Engineering Specialization: https://www.coursera.org/specializations/python-bash-sql-data-engineering-duke

AWS Certified Solutions Architect - Professional (SAP-C01) Cert Prep: 1 Design for Organizational Complexity:
https://www.linkedin.com/learning/aws-certified-solutions-architect-professional-sap-c01-cert-prep-1-design-for-organizational-complexity/design-for-organizational-complexity?autoplay=true

Essentials of MLOps with Azure and Databricks: https://www.linkedin.com/learning/essentials-of-mlops-with-azure-1-introduction/essentials-of-mlops-with-azure

O'Reilly Book: Implementing MLOps in the Enterprise

O'Reilly Book: Practical MLOps: https://www.amazon.com/Practical-MLOps-Operationalizing-Machine-Learning/dp/1098103017

O'Reilly Book: Python for DevOps: https://www.amazon.com/gp/product/B082P97LDW/

O'Reilly Book: Developing on AWS with C#: A Comprehensive Guide on Using C# to Build Solutions on the AWS Platform
https://www.amazon.com/Developing-AWS-Comprehensive-Solutions-Platform/dp/1492095877

Pragmatic AI: An Introduction to Cloud-based Machine Learning: https://www.amazon.com/gp/product/B07FB8F8QP/

Pragmatic AI Labs Book: Python Command-Line Tools: https://www.amazon.com/gp/product/B0855FSFYZ

Pragmatic AI Labs Book: Cloud Computing for Data Analysis: https://www.amazon.com/gp/product/B0992BN7W8

Pragmatic AI Book: Minimal Python: https://www.amazon.com/gp/product/B0855NSRR7

Pragmatic AI Book: Testing in Python: https://www.amazon.com/gp/product/B0855NSRR7

Subscribe to Pragmatic AI Labs YouTube Channel: https://www.youtube.com/channel/UCNDfiL0D1LUeKWAkRE1xO5Q

Subscribe to 52 Weeks of AWS Podcast: https://52-weeks-of-cloud.simplecast.com

View content on noahgift.com: https://noahgift.com/

View content on Pragmatic AI Labs Website: https://paiml.com/
Ссылки и html тэги не поддерживаются


Комментарии: