You can hook a sensor up directly to an actuator. Back in 1953 this was shown to be an effective form of control by hooking up a light sensor to a differentially wheeled robot, which actuated the robot to go towards the light robot. With very similar logic you can achieve object avoidance with a simple proximity sensor. However these get stuck in U-shaped obstacles.
Although, this is fixed with some Finite State Machines…