Is it okay to burn the wood of a cottonwood tree, in your home fireplace?

Sure. You can burn any wood (except for preservative treated and stuff like poison ivy). Just make sure it is dry (and not green). I don't think cottonwood has much BTU value per pound (15 million BTUs/Cord) but it does give off some heat and if that's all you've got; go for it.