Optimize TensorFlow Models For Deployment with TensorRT

External: Coursera Courses ↗ · Coursera

Open Course on External: Coursera

Free to audit · Opens on External: Coursera

Optimize TensorFlow Models For Deployment with TensorRT

Coursera · Beginner ·🧬 Deep Learning ·5mo ago

Key Takeaways

Optimizes TensorFlow models for deployment with TensorRT

Original Description

This is a hands-on, guided project on optimizing your TensorFlow models for inference with NVIDIA's TensorRT. By the end of this 1.5 hour long project, you will be able to optimize Tensorflow models using the TensorFlow integration of NVIDIA's TensorRT (TF-TRT), use TF-TRT to optimize several deep learning models at FP32, FP16, and INT8 precision, and observe how tuning TF-TRT parameters affects performance and inference throughput. Prerequisites: In order to successfully complete this project, you should be competent in Python programming, understand deep learning and what inference is, and have experience building deep learning models in TensorFlow and its Keras API. Note: This course works best for learners who are based in the North America region. We’re currently working on providing the same experience in other regions.
AI explanation not available for this lesson yet
This lesson is still being prepared for the AI tutor. In the meantime, explore lessons that are ready.
Browse explainer-ready lessons →

Related Reads

📰
Trained a neural net to reconstruct Bad Apple in real-time.
Reconstruct Bad Apple in real-time using a trained neural network and learn how to apply deep learning to video processing
Reddit r/deeplearning
📰
AI/ML Under the Hood — Part 29: CNN Breaking News: Proximity Matters
Learn how proximity affects CNNs with kernels, feature maps, padding, and strides
Medium · Deep Learning
📰
Deep Learning Scientists — Claude Cowork: The Deep Learning Scientist’s New Lab Partner
Meet Claude Cowork, a new tool for deep learning scientists to optimize their workflow and reduce the scarcity of compute and attention resources
Medium · Data Science
📰
Why Qwen3.8 27B Looked Brilliant in Testing but Failed to Ship My AI Newspaper
Learn why a high-performing AI model like Qwen3.8 27B failed to deliver in real-world application and how to avoid similar pitfalls
Medium · Deep Learning
Up next
Machine Learning Rust Candle Hugging Face Part 4
Stephen Blum
Watch →