We used to go regularly to Cabanas and Tavira, both very lovely but laid-back places and no child-friendly activities nearby.
I think you would be looking for something like Albufeira which has more of what you are looking for
I think you'll totally enjoy the Algarve as the Portuguese people, culture and cuisine is superb