Best fermentation container?

[dixiegurl]

I have run about six batches of sugar wash. They have been fine, but just have a slight harsh taste to them...all the same. They don't taste like store bought vodka. I have been using a new Home Depot 5 gal bucket and lid for my fermentation pot. Is it that critical that it's not considered food grade? Will the fermented alcohol absorb some of that plastic to my taste? It seems the distallation would get rid of that, unlike say, in a wine. Should I, after a day or so, transfer my fermentation to a glass carbouy? I have one for wine. I assumed back in the day, they used about anything. Thanks guys.