Lay sweet potato cubes onto a parchment lined tray. Drizzle olive oil and all of the seasonings over the potatoes. Mix with your hands to evenly coat every cube. Roast for 25-30 minutes, turning halfway through.
Let the sweet potato bites cool slightly and then top each bite with a small dollop of goat cheese. Drizzle balsamic vinegar over the top of the platter right before you serve.