Vinyl liner is pretty weak in general and it holds up better in a round pool, I have seen people keeping fish with huge sharp spines in round above ground pool with vinyl liner, such as TSN, RTC, bass, pbass, etc, so at least temporarily it can be done, or with some patch work as needed. I've no experience with vinyl liners. I think it can be tried but I'd have rubber liner on hand in case I needed to throw it in the pool.
The best pools are hard wall PE, like water storage tanks etc. Can score them on Craigslist etc. second hand for cheap.