By Saif Jouda | April. 5 2024
Unity Sentis is a ground breaking neural network interface library for unity. It allows pre-trained AI models, in the form of ONNX files, to execute during runtime. As of today, Unity Sentis is still an experimental package.
There are numerous use cases for Unity Sentis, and we anticipate more emerging in the future. Here are a few examples:
Detect, classify, and segment objects with an in-game or on-device camera.
Power a board game opponent with specific rules and custom difficulty curves. Run a neural network trained on the game rules and determine game win probabilities after each move.
Identify handwritten numbers, letters, and symbols for unique gameplay interactions.
Estimate the depth of real-world objects in an augmented reality view to occlude objects in a game scene.
Convert live speech to in-game text using a machine learning language model for natural language interactions between players.
Automate dialogue and create meaningful interactions between players and NPCs without the limitations of manual scripting.
A quick program which guesses the number the user draws. You can download the project if you follow the link below.