Underneath windows you can use a special (bull nose) made of clay, maybe even glazed.
A20 Window special
A19 Window special - header
A19 Window special - stretcher
Find all specials here...