Can I buy property in the name of a foreign company?

Yes. A foreign company can own property in Georgia without creating a local entity, simply by presenting an apostilled and translated certificate of incorporation. The applicable tax regime then depends on the agreement between Georgia and the country of the company's headquarters.