Is it a conflict of interest to start a non-profit while employed at another one?

I am starting a non-profit, and beginning the process of fundraising and raising awareness, but I currently work at a different non-profit. Our programs and causes are different, and therefore not competing, but we are competing for the same donors and money in the same community. Is it a conflict of interest to stay until mine gets off the ground? Do you think donors will see it as one?