Generating Synthetic Datasets using Isaac Sim

Mon, 05 Jan 2026 10:58:31 +0900

Intro

For vision tasks in ML, we naturally need images and corresponding labels to train a model. Normally, we consider two options. searching and finding datasets we can leverage or creating datasets by taking a photos, labeling manually. The latter is rarely feasible, especially for a student or a small team, given the immense amount of time required for labeling.

Figure 1. Isaac Sim GUI

Here’s a third option, which is to utilize Isaac Sim(simulation program from NVIDIA) to generate synthetic datasets. Initially, I was kind of skeptical about whether a vision model trained on simulated images would actually perform well in real environments. However, This post changed my mind. I recommend you to read it.

Isaac Sim on Yeongseung's Blog

Generating Synthetic Datasets using Isaac Sim

Intro