Size your shunt for the house loads, probably a 500A shunt would be best choice.
There are many posts where people have used the SmartShunt on a starter battery without any issue, but it may not register the short surge current if it is over the shunts rating.
See answers on old community, starter current sjould not be an issue.
The outboard manual should give the cranking amps of the starter motor, for a 175Hp, I would expect this to be about 250A. Size you shunt for at least this, plus what your house load might be at cranking time. As suggested, 500A would most likely cope.