count someone out

count someone out  informal

(exclude someone from an activity or plan)

• I don’t like to stay out late at night, so you can count me out.
• Alex wants to come with us, and you shouldn’t count him out.

envocabulary.com