For the icing and glue? The organic powdered peanut butter, after being mixed with water, turns to concrete after sitting out, so that would work. Maple syrup can be found evaporated into pure organic maple sugar. That could be dissolved with other ingredients to make the glue. There is even an organic "powdered" maple sugar. Almond paste (marzipan) can be found pure and sugar free, which is used to make decorations and little shaped candies, and would easily work as the caulk, and being closer to pure white in color, would work for the curlicue decorations on the cookies, but in a cursory search I didn't find any organic marzipan. You could make your own though, from organic almonds.
If you're like me, you might not ever make and assemble the little houses, but I might consider the eggless spicy dough and just make flat cookies as treats when friends or family are coming for a holiday. Maybe... My sweets approach, as you have seen, is using the box mix plus can of fruit, just mix the two together and bake. I take pride in my kitchen creativity, but baking is just a fantasy for me. I like looking at the pics and getting ideas.
View attachment 201033
I would credit the above pic to the vegan blogspot I screenshot it from a few years ago, but I don't remember which blog it was.