Cost Orbits of Microsoft GenAI, Azure OpenAI

As shown in figure 1, the jump required from one orbit (LLM) to another (cloud services) is directly proportional to extra dollars for robust budgeting and successful delivery, not that LLM (pre-trained transformer, highly available managed service) by itself is expensive.

It’s 1:25 as shown in the chart.

Proven/modelled directly by me for my teams, clients and stakeholders. Since I was receiving several queries on the cost equation of Microsoft GenAI (Azure OpenAI) on Azure cloud while I also came across some half baked point of view — It was time.

So, I coined the Cost Orbits for not only a better understanding of the cost construct but also based on the real experiment. I am sure, it will now help many in the field.

Figure 1.

Thank you.

Vishal Anand.