It's not going to bother the pavers but it will eventually bother those who use the pavers :-) It will take a while, but the tree will get wider than a planting site 2-3' away from the pavers will comfortably accommodate.

Thank you gardengal48 for your reply. I hope to contain the tree size by trimming every couple of years. Thanks again.

It is always a better idea to select a plant that is appropriate to the planting site with regards to size, rather than attempt to keep it smaller with frequent pruning, especially with Japanese maples. Right plant, right place.