Optimize Agent initialization time

[TheVinhLuong102]

As of now, Agent instantiation seems to be a bit slow, perhaps because of some unnecessary context or API setups.

Please investigate and optimize.