Some of the blocks will have buttons in them by default.
If you don’t need to display the button, you can hide it by going to the content tab on the left side and switching the “show button” setting off.
If the button is in a block all on it’s own, you can delete the whole block by clicking the red trash can icon next to it when you have it selected.