Under GDPR rules you do have a right to privacy in/on your property, our initial recommendation would be to speak to the neighbour and ask if they can show you the live feed of the camera.
Although it might look like it is pointed at your property, it might actually have a narrow FoV that doesn't cover your property. If it is covering your property you can ask them to adjust the camera's position to reduce/remove that coverage.