I was involved in the "survivalism" scene for a lot of years before getting disgusted with the commercialism and fear mongering that it seems to have become. Odd, since what would be "survivalism" today would have been "permaculture" several hundred years ago. The object of survival doesn't change, only the terms and mindset behind it.
What helped to clarify things was marking a difference between "Survivalism" and "prepping". Survivalism implies a skills based approach, learning as much as possible to be self-sufficient in many different situations and environments. A major factor in this approach is community and social capital on various levels. Prepping implies a reliance on material goods: stockpiling, caching, "preps", etc. Which can see a person through lean times, but it runs out, breaks, gets lost, etc. So it has it's place too, but is more limited them most would think.
If we look at "survivalism" as a spectrum of proactive responses, all these things have a place, including permaculture. Now the discussion becomes a question of timeline (long vs short term preperations) and stratagy. Because at the end of the day, we come back to our main goal: the purpose of survival is to survive.
For anyone just getting into it, I recommend Selco Begovnic for a survival perspective and Dasiy Luther for a preppers perspective. Have learned a lot from both of them.