Your not casting from your iPad to the Chromecast, your iPad is nothing more than a remote control for it. When you selected a video, the Chromecast connected to YouTube and began streaming, to stop you would need to either press stop in the YouTube app on the iPad, or simply turn the TV off (assuming your Chromecast is powered by the TV USB Port).
Hope that made a bit of sense, it's getting late lol