We have tons of rocks and have lived in places with a gravel yard. It all depends on what plants you want to grow. Some will do very fine in fact better in rocky hard ground. Some will die. Some plants will work almost like a tiller with strong roots. But they will never be able to pick up the rocks and move them.
I would not be afraid to till the heck out of it. Till and till and till! Then maybe double dig with a crow bar? Depends on what you want to grow. I know a lot of people say the no till method is best and I understand that. However to break up the hard crusty ground with a machine is not going to destroy anything. I feel it can only help the situation. Plant roots will not grow into the rock. You can till in peat or grass clippings maybe some sand what ever you think it needs. You may even till next year too. After you get the soil in the direction you want it to go then stop tilling. When you see worms or weeds life signs stop.
Word of caution know what you are getting for sure if you purchase top soil
compost manure what ever. I didn't make double sure and lost 2 years of garden time and am having to start over in a new location. Purchased contaminated stuff.