Sorry, I was looking at the 24LC515 datasheet instead of the 512.

You should be ok wired that way.
<br>