The category pages, search pages and archive pages are all controlled by a single location.
You can navigate to Settings > Reading > Blog Pages > Show at Most to control the number of posts that show up on your archive pages.
Make sure to fill out your category pages with content!