Defenders are usually taller but that doesn't mean you can't be effective. Some of the best players I have played with have not been the biggest. I remember when I played on the Provincal team there was a sweeper who was the smallest player on the field. He was really quick and could jump very high. But most importantly he was very brave and effective.
you can make up for size with work ethic and attitude. Hope that helps.
I was just wondering because I was looking up online that most centre backs/ sweepers are 6'0+ . I play high school soccer and I'm pretty average height but is it adequate to play this position