Is it possible to restrict actor to specific Inv/ PO company so they wont allow to view and perform transactions.
Yes, is possible.
Check the AMS functionality