Actually we do, generally speaking. Cancer is caused by alterations in genes involved in cellular growth regulation. We even know specifically which genes are changed in some kinds of cancer, and this knowledge doesn't stop increasing.
Genes changing is a normal and expected thing in nature, it happens in every cell cycle (though most of the times without a measurable effect) and it's on the basis of evolution as well. Cancer at it's basis is as natural as it gets. Something we have to accept as part of life.
Beyond these natural changes in genes, damage to DNA can happen at an increased rate in the presence of certain factors. Be they radiation, viruses or chemical compounds (both natural and artificial), etc... Also, some of us inherit already defective genes.
And yes, it's a freaking death lottery in many ways. A lottery for which we are all born with different odds, but odds which we can modify. You can play optimally and still lose, or play terribly and still get lucky, but that's valid for nearly every aspect of life. Being careful with our exposition to risk factors for cancer isn't much different than being a careful driver or buying a safe to protect your kids from your gun. We're essentially manipulating odds. Few things, both good or bad, are ever guaranteed.
Some things increase the odds of cancer so much that we can simplify it and say they cause them. Technically you're correct, tobacco doesn't cause cancer, it increases its risk. But saying tobacco causes cancer isn't different than saying drunk driving or excessive speeding causes deaths on the road.