Open the menu on an existing section in the sidebar (usually a "..." icon or right-click) and choose Add subsection. Give it a title. It appears indented beneath its parent section.