By clicking the icon at the bottom of each book window, you can read the book:

This style of book does not count towards a house's item count.

Older books, which do count as house items, have a different icon and look.