Do I have to married to provide foster care?

No. you can be single, or in a committed relationship to foster children.

Can I be a foster parent if I have bills?

Yes. As long as your bills are managed and you can provide for yourself and your family without the foster care stipend.