Okay, I think I figured it out. In https://configtool.reprapfirmware.org/Endstops it doesn't automatically select Z-probe in the endstop type for the Z axis when you select BLTouch. When I did so, it seems to have solved my issue.