I was planning to buy a Kayak when I saw the price it was not well on my budget. Any feedback guys on Inflatable Kayak or Canoe? Which brand?

Any used ones around? Given the other choices you listed, I'd say a canoe would be more durable than dragging a PVC inflatable device over rocks and stones. I'm assuming you're thinking of using it for fishing since you posed this question on a fishing site.
If it were me, I think I'd be looking for a used kayak that was in my budget for starters. Probably more stable than a canoe, and definately more durable than an inflatable. Keep checking the Buy/Sell/Trade forums in all the sites as well as the Want Advertiser. I see used ones for sale every so often.
Good luck in your search.

Make sure you have a compass and hand held GPS. Two young girls were lost Kayaking in the fog last year and did not survive.