Work has begun on the downtown Albany building that the Albany Museum of Art will call home.