The show would have probably been kinda dull. Sure, there are other good and interesting characters, and there is a lot of growth in them too, like Willow and Anya, but Anya barely even interacted with Buffy and the big turning point for Willow was magic and Tara's death.
Can't say for sure. I really can't imagine the show without Spike