The speed would depend on how fast the server is, but I have no reference to go by, so I can't say for sure.
A static rule takes up just over 6Kb, so 10,000 rules would be around 60Mb.
Maybe you could add unique domains rather than the whole address; that would probably be faster, assuming you have multiple email addresses from the same domains.
Rgds,
Tom