As you are reading, you will meet many female characters in both epics; here is a list of some of the more notable characters linked to their Wikipedia articles:
Ramayana characters: Sita, Manthara / Kooni, Kaikeyi, Kausalya, Ahalya, Tara, Mandodari, and Anasuya.
Mahabharata characters: Satyavati, Amba, Kunti, Madri, Gandhari, Draupadi, Subhadra, Sudeshna, Uttara, Damayanti, and Savitri.
Also, be sure to check out the page about goddesses and the page about rakshasas, where you will find some non-human female characters who might interest you too!
Of course there are also a lot of past Storybooks about women which you can browse through, exploring the different themes and storytelling styles that past students have used for this topic.
You might also be interested in reading about the Panchakanya, the five maidens of the Hindu tradition:
Panchakanya - Five Maidens)