Week 17: Behavior Graph

Media pipe

This week I was trying to use MediaPipe as gesture recognition tool to control a WebGL Unity game. I found the plugin, but it doesn’t support WebGL. I only want a prototype, so I tried to make a simple socket server from unity, and use MediaPipe from web to send the camera data. In the future, I will try to bridge the JS to C#, then the socket server will be only for the editor.

During prototyping, I found this openUPM which is an open source Unity asset store. I use this one to install the NuGet plugin for unity. And use NuGet to install WebSocketSharp.

And, I found that Visual Studio Code can not support C# definition better than Visual Studio. Same thing happened in C++.

Behavior Graph

Another thing in this week, I tried to use Behavior Graph in Unity. It was mentioned in the FSM class. It is in between of a finite state machine and visual coding. I learnt many from Sunny Valley Studio. Unity is combing this with its Muse AI, so that a line of description will be transformed into nodes and work as game AI logic.