# AI cost inefficiencies | Cloud Efficiency Hub Canonical: https://www.pointfive.co/efficiency-hub/service-category/ai 43 documented AI cost inefficiencies across AWS, GCP, Azure and more, each with detection steps and remediation. ## All inefficiencies Each entry explains the waste, the billing model behind it, how to detect it and how to fix it. / 43 inefficiencies - AWS SageMaker CER-0333 ### [Idle SageMaker Notebook Instances Left Running Continuously](https://www.pointfive.co/efficiency-hub/inefficiencies/idle-sagemaker-notebook-instances-left-running-continuously) SageMaker notebook instances are billed continuously while in an active state - and critically, they do not automatically shut down when idle. Closing a browser tab, shutting down a Jupyter kernel, or simply walking away does not stop the... AI - AWS S3 CER-0330 ### [Orphaned MLflow Training Artifacts and Model Checkpoints in Object Storage](https://www.pointfive.co/efficiency-hub/inefficiencies/orphaned-mlflow-training-artifacts-and-model-checkpoints-in-object-storage) Machine learning experimentation workflows - particularly those managed through experiment tracking platforms - generate large volumes of artifacts in object storage. Every training run produces model checkpoints, evaluation outputs,... AI - GCP Vertex AI CER-0267 ### [Using High-Cost Models for Low-Complexity Tasks in Vertex AI](https://www.pointfive.co/efficiency-hub/inefficiencies/using-high-cost-models-for-low-complexity-tasks-bec92) Vertex AI workloads often include low-complexity tasks such as classification, routing, keyword extraction, metadata parsing, document triage, or summarization of short and simple text. These operations do not require the advanced... AI - AWS Bedrock CER-0276 ### [Using High-Cost Bedrock Models for Low-Complexity Tasks](https://www.pointfive.co/efficiency-hub/inefficiencies/using-high-cost-bedrock-models-for-low-complexity-tasks-734ca) Many Bedrock workloads involve low-complexity tasks such as tagging, classification, routing, entity extraction, keyword detection, document triage, or lightweight summarization. These tasks do not require the advanced reasoning or... AI - Azure Cognitive Services CER-0238 ### [Always-On PTUs for Seasonal or Cyclical Azure OpenAI Workloads](https://www.pointfive.co/efficiency-hub/inefficiencies/always-on-ptus-for-seasonal-or-cyclical-azure-openai-workloads-ccb97) Many Azure OpenAI workloads - such as reporting pipelines, marketing workflows, batch inference jobs, or time-bound customer interactions-only run during specific periods. When PTUs remain fully provisioned 24/7, organizations incur... AI - Azure Cognitive Services CER-0248 ### [Non-Production Azure OpenAI Deployments Using PTUs Instead of PAYG](https://www.pointfive.co/efficiency-hub/inefficiencies/non-production-azure-openai-deployments-using-ptus-instead-of-payg-9fe81) Development, testing, QA, and sandbox environments rarely have the steady, predictable traffic patterns needed to justify PTU deployments. These workloads often run intermittently, with lower throughput and shorter usage windows. When PTUs... AI - Azure Cognitive Services CER-0266 ### [Underutilized PTU Quota for Azure OpenAI Deployments](https://www.pointfive.co/efficiency-hub/inefficiencies/underutilized-ptu-quota-for-azure-openai-deployments-da831) When organizations size PTU capacity based on peak expectations or early traffic projections, they often end up with more throughput than regularly required. If real-world usage plateaus below provisioned levels, a portion of the PTU... AI - AWS Bedrock CER-0256 ### [Suboptimal Bedrock Inference Profile Model](https://www.pointfive.co/efficiency-hub/inefficiencies/suboptimal-bedrock-inference-profile-model-08c00) AWS frequently updates Bedrock with improved foundation models, offering higher quality and better cost efficiency. When workloads remain tied to older model versions, token consumption may increase, latency may be higher, and output... AI - Azure Cognitive Services CER-0246 ### [Missing Reserved PTUs for Steady-State Azure OpenAI Workloads](https://www.pointfive.co/efficiency-hub/inefficiencies/missing-reserved-ptus-for-steady-state-azure-openai-workloads-f78d4) Many production Azure OpenAI workloads - such as chatbots, inference services, and retrieval-augmented generation (RAG) pipelines-use PTUs consistently throughout the day. When usage stabilizes after initial experimentation, continuing to... AI - Azure Cognitive Services CER-0254 ### [Suboptimal Azure OpenAI Model Type](https://www.pointfive.co/efficiency-hub/inefficiencies/suboptimal-azure-openai-model-type-c8913) Azure releases newer OpenAI models that provide better performance and cost characteristics compared to older generations. When workloads remain on outdated model versions, they may consume more tokens to produce equivalent output, run... AI - Azure Cognitive Services CER-0277 ### [Using High-Cost Models for Low-Complexity Tasks in Azure OpenAI](https://www.pointfive.co/efficiency-hub/inefficiencies/using-high-cost-models-for-low-complexity-tasks-cc721) Some workloads - such as text classification, keyword extraction, intent detection, routing, or lightweight summarization - do not require the capabilities of the most advanced model families. When high-cost models are used for these... AI - AWS SageMaker CER-0383 ### [SageMaker Studio Applications Without Idle Shutdown](https://www.pointfive.co/efficiency-hub/inefficiencies/sagemaker-studio-applications-without-idle-shutdown) In SageMaker Studio, each running JupyterLab or Code Editor application runs on an instance that is billed for as long as the application is running, whether or not the user is doing anything. Data scientists routinely leave spaces running... AI Showing 12 of 43 --- Source: the public page above. Product screenshots and illustrative interfaces are examples, not live customer data.