M

Microsoft Phi-3 Medium 128K Instruct

Microsoft
128K
Context
$1.00
Input /1M
$1.00
Output /1M
N/A
Max Output
Run API Call Open in Chat

Microsoft Phi-3 Medium 128K Instruct

Overview

  • Model Name: Microsoft Phi-3 Medium 128K Instruct
  • Provider: Azure
  • Model ID: microsoft/phi-3-medium-128k-instruct
  • Release Date: May 24, 2024
  • Parameter Count: 14 billion
  • Context Window: 128,000 tokens

Description

Phi-3 128K Medium is a powerful 14-billion parameter model designed for advanced language understanding, reasoning, and instruction following. The model excels in common sense reasoning, mathematics, logical reasoning, and code processing through supervised fine-tuning and preference optimization. At release, it demonstrated competitive performance among lightweight models, approaching Llama3 70B-level results on MMLU-Pro evaluations.

Pricing

Metric Price
Input Tokens $1/M tokens
Output Tokens $1/M output tokens
Request Cost $0

Performance

  • Competitive performance among lightweight models
  • Approaches Llama3 70B-level results on MMLU-Pro evaluations
  • Strong capabilities in common sense reasoning, mathematics, and logical reasoning
  • Optimized for code processing and instruction following
  • Phi-3 Medium 4K Instruct - Shorter context variant for reduced token requirements
    • Model ID: /models/microsoft/phi-3-medium-4k-instruct

Providers

  • Primary Provider: Azure
  • Data Policy: No training usage; no prompt retention; cannot publish outputs
  • Status Page: https://status.azure.com/
  • Terms: Microsoft Terms of Use; Privacy Statement available

Parameters

Supported Parameters

  • max_tokens
  • temperature
  • top_p
  • tools
  • tool_choice

Technical Specifications

  • Input Modality: Text only
  • Output Modality: Text only
  • Default Stop Sequences: <|end|>, <|endoftext|>
  • Instruction Format: Phi3 format
  • Tool Support: Yes (supports tool parameters and function calling)
  • Reasoning Features: Not supported
  • Multipart Compatible: No
  • Fine-tuning: Available (text input)