Differences Between Managed Services and On-Premise Software

[seanmcilroy29]

Differences Between Managed Services and On-Premise Software

• Managed services (like cloud-based Oracle database) provide limited visibility into infrastructure and energy consumption
• On-premise software allows more direct measurement and understanding of resource utilization
• Lack of transparency in managed services makes carbon footprint calculation challenging
• Highlighted the complexity of understanding energy use in multi-tenant cloud environments

[GadhuNTTDATA]

We will always have the issue of not having granular detail of the infrastructure, location, overhead etc of managed services. We will have to rely on the providers of the managed service who will be making the decision on the level of detail that they want the end customer to see. So I suggest the following:

• Let us create the standard metric/ metrics (assuming we create more than one to cater to different personas) and the methodology to measure the metrics with the detailed/ ideal inputs required.
• Let us create reference case studies using open source models
• Based on the case studies and the data we gather, let us attempt to find some patterns and create heuristic 'Models' based on some inputs that are available to the user (e.g. number of tokens, number of parameters of the model etc)
• Let us encourage providers of the managed service to use the above standards and methodology and either provide the inputs required or publish the metrics they have calculated using the methodology
• While we keep pushing the providers, let us publish the heuristic 'Models' for engineers to use.