Using neutral only of control transformer

We want single phase supply at site but we have only 3 phase supply not neutral at site. So what we are doing we just put a control transformer of 3 KVA 415v to 230v and now we are taking only neutral from this and rest 3 phase separately to make it 230v as the load is much higher.

so now i want to know that it will work or not.
what is the effect of load

The load distribution is as follows

R- N 32A
R- N 32A
Y- N 32A
Y- N 32A
B- N 32A