You have the option to delete the chapter here. In the Course Builder landing page, click on the action icon of the chapter heading uploaded.
This option shows you three icons - Move up, Move down and Delete.
Clicking on the Delete icon will display a pop up and ask for the confirmation.
Now finally click on the “Yes” button. The chapter gets deleted.