The door ahead can be broken. There's a monster behind it; defeat it and collect the materials.
Just head straight ahead for now. There's nothing upstairs, but two enemies will jump down to continue attacking us. Walk a few steps, and you can pick up the book [Villager's Relic Investigation #7: The Lady's Plea for Protection] from the carriage on the right.
