ai platform selectionFor organizations, selecting an AI platform is not as simple as it may first appear.

Each platform is built around a different combination of applications, data, and business processes. Guru’s overview of business AI platforms includes a wide array of solutions that can appear daunting at first glance:

  • General purpose assistants such as ChatGPT,
  • Cloud development environments such as Microsoft Azure,
  • Knowledge management products such as Guru,
  • Machine learning platforms such as Vertex AI, and
  • Open-source frameworks such as TensorFlow.

To set themselves apart, organizations need to know how to apply specific AI platforms to specific use cases. Therefore, the first step is not to simply ask, “Which AI platform is best?” Leadership should instead consider, “What do our departments need AI to accomplish, where does the relevant data reside, and how can we avoid paying for several tools that perform the same work?”

In other words, will your organization build a scalable foundation, or create a costly platform maze?

ai organizational structureCreate an Organizational Structure Before Scaling

Leadership should create a simple AI organizational chart before departments accumulate disconnected pilots.

At the top, an executive AI steering committee should set investment priorities, risk tolerance, and approval thresholds. A central AI enablement office should manage shared standards and the platform portfolio, representing the following:

  • Architecture
  • SAP and integration
  • Security
  • Privacy
  • Legal
  • Finance
  • Procurement
  • Change management
  • Data governance

Each department should appoint an AI lead and process owners to identify use cases, coordinate users, measure results, and raise risks. The central office does not need to own every experiment, but it should maintain visibility.

A reasonable portfolio might include one default productivity assistant, one SAP-centered operational AI layer, and one approved development or API environment. Specialized products should be added only when they provide a measurable capability the existing portfolio cannot.

This structure keeps decisions close to the work while allowing the organization to review licenses, APIs, cloud costs, integrations, and hardware centrally. For many knowledge-work pilots, a managed platform may be easier to govern than dedicated AI infrastructure. Local hardware becomes more compelling when privacy, latency, predictable volume, offline operation, or specialized models justify its costs.

Below is an example of how an organization could structure its portfolio:

Department or function

Likely primary platform

Possible secondary platform

Reason

General administration Copilot or Gemini ChatGPT Primary tool should follow the existing productivity suite
Marketing and communications ChatGPT, Gemini, or Claude Approved image or media tools Drafting, research, content variation, and document analysis
IT and software development ChatGPT/Codex, Claude, Azure AI, or Vertex AI SAP tools where applicable Coding, documentation, troubleshooting, and custom applications
Finance and procurement SAP Business AI/Joule Copilot or ChatGPT for non-transactional work SAP context is important for operational and financial workflows
Human resources SAP SuccessFactors AI/Joule or productivity-suite assistant General-purpose assistant for approved low-risk content HR data and employment decisions require stricter access and oversight
Supply chain and operations SAP Business AI/Joule Azure, Vertex AI, or specialized analytics platforms Strong dependence on ERP data, events, and process context
Knowledge management Guru or an existing enterprise search layer ChatGPT, Copilot, Gemini, or Claude as the interface Provides a verified knowledge layer across assistants
Data science Azure AI, Vertex AI, SageMaker, Dataiku, H2O.ai, or open-source frameworks General assistant for development support Requires model development, data pipelines, deployment, and monitoring

coordinate ai pilotCoordinate Every Pilot Through the Same Process

Every proposal should answer the same questions:

  • What process problem are we trying to solve?
  • Who owns the process?
  • Who will use the solution?
  • What data will it access?
  • What decisions or actions could it influence?
  • What is the current performance baseline?
  • What measurable improvement is expected?
  • Why is AI necessary?
  • What happens if the output is wrong?
  • Can the pilot be stopped or reversed easily?

Leadership should then classify the risk. Brainstorming, formatting, and reviewed first drafts may be low risk. Customer-facing analysis, code, or operational recommendations may be moderate risk. Employment, legal, financial, safety, security, regulated, or autonomous transactional decisions should receive the highest level of review.

Before introducing the tool, the team should document a baseline such as cycle time, labor hours, errors, rework, cost per transaction, backlog, satisfaction, or compliance exceptions. Competing platforms should receive comparable tasks, materials, and scoring criteria. Accuracy, traceability, integration effort, cost per successful task, and time saved after human review matter more than an impressive first response.

The NIST Generative AI Profile offers a vendor-neutral reference for governing, mapping, measuring, and managing risks throughout the AI lifecycle.

Make the Selections

With a structure in mind, organizations can then compare various general purpose assistants, and then assess whether other types of platforms are needed on a case-by-case basis.

To ensure an easy read, we have compiled some of the most popular platforms, those being Microsoft 365 Copilot, Gemini, ChatGPT, and Claude:

Microsoft 365 Copilot

Best use cases include:

  • Executive preparation: Summarize relevant emails, documents, presentations, and meeting records before a leadership discussion.
  • Meeting management: Produce agendas, notes, decisions, action items, and follow-up messages.
  • Project coordination: Compile status information from Teams, Outlook, SharePoint, and project documents.
  • Financial and operational reporting: Help interpret spreadsheets, identify patterns, and develop narrative summaries.
  • Document development: Turn outlines, notes, or previous materials into reports, procedures, and proposals.
  • Knowledge retrieval: Find information stored across Microsoft 365 without requiring employees to search each application independently.
  • Employee onboarding: Surface policies, procedures, training materials, and common questions from SharePoint.
  • Presentation development: Convert a report or planning document into an initial slide deck.

Primary advantage: Copilot can support work without requiring employees to leave the Microsoft applications they already use.

Important consideration: Copilot may surface information according to existing Microsoft 365 permissions. Because of this, organizations should review SharePoint, Teams, and file permissions before broad deployment. You can visit Microsoft’s website for more information on Copilot privacy. 

Gemini

Best use cases include:

  • Email assistance: Summarize long Gmail threads, draft responses, and identify unresolved questions.
  • Collaborative writing: Develop and revise materials directly in Google Docs.
  • Meeting support: Prepare agendas, capture notes, and summarize decisions associated with Google Meet.
  • Spreadsheet analysis: Interpret data in Sheets, explain trends, and help construct formulas or summaries.
  • Shared research: Compare information across documents stored in Drive.
  • Knowledge work: Use NotebookLM or related Google tools to explore approved source collections.
  • Customer and market research: Organize information from approved web and company sources.
  • Cloud data applications: Support analysis and custom AI applications within a Google Cloud environment.
  • Departmental agents: Create agents that help employees complete recurring tasks across Workspace applications.

Primary advantage: Gemini is particularly useful when collaboration, documents, email, storage, and cloud data already reside in the Google ecosystem.

Important consideration: Capabilities, usage limits, and administrative controls may differ among Workspace and Google Cloud editions. Additionally, Google states that Gemini’s access to Workspace data is controlled by administrators, content owners, and the user’s existing permissions. For more information, visit Google’s Workspace access guidance.

ChatGPT

Best use cases include:

  • Cross-functional research: Combine company information with approved public research to produce an organized analysis.
  • Business planning: Explore strategies, scenarios, risks, requirements, and implementation options.
  • Document production: Create and revise reports, procedures, proposals, presentations, spreadsheets, and other business materials.
  • Process improvement: Analyze an existing workflow, identify bottlenecks, and propose a future-state process.
  • Requirements analysis: Organize stakeholder notes, detect conflicting requirements, and prepare documentation.
  • Data analysis: Examine uploaded datasets, generate calculations, visualize findings, and explain business implications.
  • Custom workflows: Build reusable assistants or agents for specific departments and processes.
  • Technical support: Draft code, troubleshoot issues, document systems, and review software.
  • Training and onboarding: Create role-specific learning resources, scenarios, exercises, and knowledge tools.
  • Vendor evaluation: Compare products, proposals, contracts, or implementation approaches using consistent criteria.

Primary advantage: ChatGPT is a broad workspace that can support many kinds of knowledge work and produce several types of deliverables.

Important consideration: The organization should distinguish approved business offerings from employees’ personal accounts and control which internal sources, plugins, and actions are permitted. OpenAI states that business data from ChatGPT Business, Enterprise, and its API platform is not used to train its models by default. Still, organizations should not assume that personal accounts offer equivalent protections. For more information, visit OpenAI’s business data commitments.

Claude

Best use cases include:

  • Long-document review: Analyze substantial reports, policies, technical documentation, or collections of written material.
  • Research synthesis: Identify major themes, disagreements, assumptions, and evidence across multiple sources.
  • Policy and procedure analysis: Compare versions, identify gaps, and suggest clearer language.
  • Requirements evaluation: Determine whether proposed designs or testing plans address documented business needs.
  • Complex writing: Develop structured reports, executive briefings, white papers, and technical explanations.
  • Critical review: Challenge assumptions, identify missing considerations, and examine alternative interpretations.
  • Software development: Write, explain, review, and restructure code.
  • Knowledge extraction: Turn large amounts of unstructured material into tables, summaries, taxonomies, or action lists.
  • Regulated document preparation: Assist specialists with organizing complex information before required human review.

Primary advantage: Claude is well suited to detailed language, document, reasoning, and software-development work.

Important consideration: Even strong document analysis should not replace qualified legal, regulatory, scientific, engineering, or clinical review. Like the other platforms discussed, we recommend that users review Anthropic’s latest updates to their privacy policy before use.

sap ai platform roleGive SAP Platforms a Distinct Role

For an SAP-centered organization, SAP Business AI and Joule should be evaluated differently from a general-purpose assistant. A standalone assistant may help an employee draft a report or analyze a document. On the other hand, SAP’s platform is designed to ground AI in business data, process relationships, policies, and operational context.

SAP describes Business AI Platform as a foundation for building and governing AI agents, applications, and workflows across SAP and non-SAP systems. Its components include Joule Studio, SAP Business Data Cloud, SAP Knowledge Graph, Integration Suite, and AI Agent Hub.  Finance, HR, procurement, and supply-chain employees may still use a productivity assistant for writing or research. However, AI that reviews an invoice exception or initiates an SAP workflow requires stronger process context, permissions, testing, and human oversight.

SAP Integration Suite can also support a mixed platform strategy. Its AI receiver adapter provides connectivity to SAP’s generative AI hub as well as external OpenAI and Anthropic services. SAP specifically warns organizations to ensure that exchanges with remote components comply with company policies. 

Integration does not eliminate governance. Rather, it makes governance more important because information may cross multiple systems and providers.

SAP Business AI and Joule

Best use cases include:

  • Finance: Explain financial variances, support reporting, assist with collections, and help users navigate finance processes.
  • Procurement: Summarize supplier information, support sourcing activities, identify purchasing exceptions, and assist with purchase-related workflows.
  • Supply chain: Interpret planning information, identify disruptions or exceptions, support inventory analysis, and help employees respond to operational changes.
  • Manufacturing: Assist with operational questions, maintenance information, quality issues, and production-related exceptions when connected to appropriate SAP processes.
  • Human resources: Help employees find policies, navigate HR services, prepare job-related content, or complete approved SuccessFactors activities.
  • Customer service: Summarize account or case information, support responses, and coordinate work across relevant business records.
  • Process analysis: Use SAP business context to identify bottlenecks, recurring exceptions, or improvement opportunities.
  • Agent development: Build agents through Joule Studio that can retrieve information, follow workflows, and interact with approved systems.
  • Cross-system orchestration: Connect SAP and non-SAP applications through governed integrations.
  • Employee assistance: Let users request information or initiate approved work through a conversational interface rather than navigating several screens.

Primary advantage: SAP Business AI and Joule can ground AI in operational data, processes, business relationships, and permissions rather than treating AI as a separate productivity tool.

Important consideration: High-impact financial, employment, safety, quality, or supply-chain actions should retain meaningful human review. Access should follow established SAP roles and authorization controls. You can view Joule’s privacy policy here.

Build a Portfolio That Can Mature

When streamlining business AI use, the goal is not to force every department into one tool. Rather, a successful organization will strike a balance — enough variety to meet real business needs without allowing unnecessary duplication.

An organization may ultimately use Copilot for Microsoft-based productivity, Gemini for a Google-centered team, ChatGPT or Claude for approved cross-functional work, and SAP Business AI for operational processes. However, each platform should have a defined role, owner, data boundary, cost model, and retirement path.

When leadership starts with business outcomes, coordinates pilots through a shared structure, and treats SAP integration as part of a larger governance strategy, the organization can experiment without losing control. With the right structure, isolated AI pilots begin to develop into a dependable business capability.

 

This article is part of an ongoing series. Stay tuned! For now, feel free to take a look at our other articles:

How to Build an AI Foundation That Can Scale – Innovate. Integrate. Transform. Run. R3Now dba IITRun

 

What Will AI Adoption Ask of Your Workforce? – Innovate. Integrate. Transform. Run. R3Now dba IITRun

Why Original Thought Will Determine Organizational Success – Innovate. Integrate. Transform. Run. R3Now dba IITRun