Tutorials

Here’s a list of tutorials we’ve created spanning the topics of Deep Learning, Unity, Computer Vision, Blender, and more!

Unity ML-Agents Tutorial List

A list of tutorials for Unity ML-Agents

3D, Deep Learning, UnityAdam KellyMarch 10, 2020Unity ML AgentsComment

ClosestPoint and ContactPoint Collision in Unity

ClosestPoint and ContactPoint Collision in Unity

Learn how to use GetClosestPoint() for colliders and ContactPoints for collisions to respond to collisions to specific points on your GameObject in Unity.

Unity, 3DAdam KellyJanuary 29, 2020UnityComment

YOLACT with Google Colab

YOLACT with Google Colab

Learn to use YOLACT++ for object segmentation in Google Colab

Deep LearningAdam KellyJanuary 9, 2020computer vision

Ray Perception Sensor Component Tutorial

Ray Perception Sensor Component Tutorial

How to add a RayPerceptionSensorComponent3D to a Unity ML-Agents project.

Adam KellyDecember 18, 2019 Comments

Unity ML Agents | Penguins

Unity ML Agents | Penguins

In this Unity ML Agents tutorial you’ll learn how to use machine learning, specifically reinforcement learning in Unity to train penguins to find fish and feed their babies.

Unity, 3D, Deep LearningAdam KellyJuly 30, 2019Machine Learning, Unity ML Agents Comments

Blender 2.8 to Unity - Armature, Weight Painting, Animation, & Blend Trees

Blender 2.8 to Unity - Armature, Weight Painting, Animation, & Blend Trees

A fun, simple tutorial series that will teach you how to set up an armature in Blender 2.8, then weight paint it, animate it, and hook it up with a blend tree in Unity.

3D, Blender, UnityAdam KellyJuly 6, 2019unity, blender, penguin, armature

Unity Image Segmentation

Unity Image Segmentation

Learn to create a object segmentation images in Unity. This tutorial explains how to use custom shaders to create and save color coded segmentation mask images in the Unity3d game engine.

Deep Learning, 3D, UnityAdam KellyJuly 6, 2019computer vision, segmentation

Unity Depth Camera Simulation

Unity Depth Camera Simulation

Learn to create a depth camera in Unity. This tutorial explains how to use custom shaders to create and save RGBD images in the Unity3d game engine.

Deep Learning, Unity, 3DAdam KellyJuly 3, 2019depth, rgbd, computer vision, simulation

Blender to Unity Export - Correct Scale/Rotation

Blender to Unity Export - Correct Scale/Rotation

By default, Blender exports .fbx files to Unity with an adjusted rotation of -89.98 and scale of 100. Let’s fix that.

3D, Unity, BlenderAdam KellyJune 13, 2019export, import, fbx

Unity ML Agents | Visual Chameleons

Unity ML Agents | Visual Chameleons

Unity ML-Agents Tutorial: Learn to create chameleons that change color using visual observations (aka cameras).

Deep Learning, UnityAdam KellyFebruary 6, 2019Unity ML Agents, AIComment

Create COCO Annotations From Scratch

Create COCO Annotations From Scratch

This tutorial will teach you how to create a simple COCO-like dataset from scratch. It gives example code and example JSON annotations.

Deep LearningAdam KellyJanuary 10, 2019AI, Synthetic Datasets, COCO Dataset

Unity ML-Agents Tutorial | AI Truffle Pigs! 🐷

Unity ML-Agents Tutorial | AI Truffle Pigs! 🐷

Learn how to use Unity ML-Agents to create Truffle-seeking Pigs!

Unity, Deep LearningAdam KellyDecember 23, 2018Reinforcement Learning, Machine Learning, Artificial Intelligence, Unity ML Agents

Rendering Height in Substance Designer

Rendering Height in Substance Designer

Learn how to enable height and tessellation in Substance Designer.

Substance Designer, 3DAdam KellyOctober 10, 2018Substance Comments

Blend Nodes in Substance Designer

Blend Nodes in Substance Designer

Substance DesignerAdam KellyOctober 6, 20183D Art, SubstanceComment

Using Mask R-CNN with a Custom COCO-like Dataset

Using Mask R-CNN with a Custom COCO-like Dataset

A tutorial about how to use Mask R-CNN and train it on a free dataset of cigarette butt images.

Deep LearningAdam KellyJuly 30, 2018Synthetic Datasets, synthetic image datasets, Mask R-CNN, Cigarette Butts Comments

Composing Images with Python for Synthetic Datasets

Composing Images with Python for Synthetic Datasets

Learn how to compose images with Python for synthetic datasets. Full code on GitHub.

Deep LearningAdam KellyJune 11, 2018python, Synthetic DatasetsComment

Cutting Out Image Foregrounds with GIMP

Cutting Out Image Foregrounds with GIMP

Learn how to cut out image foregrounds with GIMP to use in synthetic image datasets.

Deep LearningAdam KellyJune 10, 2018GIMP, Synthetic DatasetsComment

Simple Gaze Cursor in Unity

Simple Gaze Cursor in Unity

This tutorial will teach you how to create a simple cursor that lands on whichever object you're looking at. Simple cursor asset included.

Virtual RealityAdam KellyNovember 10, 2015Unity, Gaze, Gaze Cursor, Gaze Pointer