To create a workbook just click on the + icon in the navigation bar.
After clicking on the + icon a you will see this blank page.
On this page, you will have to click on the link Create.
They can be created based on either projects, already existing JIRA filters or you can create a new project.
After you choose how you want to create your workbook, you will have to give a name for it then click on Create.