Dashboard Overview
The Perf Dashboard provides real-time visibility into your LLM usage, costs, and performance. Access it at withperf.pro/dashboard.Dashboard Homepage
Key Performance Indicators (KPIs)
The homepage displays four critical metrics at a glance:1. Total Calls
- Description: Total number of API requests in the selected time period
- Use Case: Monitor application usage and growth trends
- Drill-down: Click to see daily breakdown
2. Average Latency
- Description: Mean response time across all requests
- Use Case: Identify performance degradation or improvements
- Benchmark:
- Excellent: < 1000ms
- Good: 1000-2000ms
- Needs attention: > 2000ms
3. Total Cost
- Description: Cumulative spend in USD for the period
- Use Case: Track budget and ROI
- Features:
- Projected month-end cost
- Comparison to previous period
- Savings vs GPT-4o baseline
4. Fallback Rate
- Description: Percentage of requests that required fallback to alternative model
- Use Case: Measure routing accuracy and reliability
- Benchmark:
- Excellent: < 5%
- Good: 5-10%
- Needs attention: > 10%
Model Distribution Chart
Visualizes which models are handling your requests:- Pie chart: Shows percentage split by model
- Bar chart: Shows absolute request count
- Interactive: Click on a model to filter the view
Time Period Selector
Filter all dashboard data by time range:- Last 24 hours: Real-time monitoring
- Last 7 days: Weekly review (default)
- Last 30 days: Monthly reporting
- Last 90 days: Quarterly analysis
- Custom range: Pick specific dates
Navigation
Main Menu
Located in the left sidebar:- Overview - Homepage with KPIs
- Analytics - Detailed performance metrics
- Logs - Call-by-call inspection
- Insights - AI-powered recommendations
- Settings - Configuration and API keys
- Team - User and access management
- Billing - Invoices and payment methods
Overview Page Details
Request Volume Chart
Line chart showing request volume over time:- X-axis: Time (hourly/daily based on range)
- Y-axis: Number of requests
- Features:
- Hover for exact counts
- Identify peak usage times
- Spot anomalies
Cost Breakdown
Stacked bar chart showing daily costs by model:- X-axis: Date
- Y-axis: Cost in USD
- Colors: Different color per model
- Use Cases:
- Identify cost spikes
- Compare model costs
- Track optimization impact
Success Rate Over Time
Line chart tracking reliability:- X-axis: Time
- Y-axis: Success rate (0-100%)
- Threshold line: 95% target
- Alert: Highlights periods below 95%
Task Type Distribution
Shows breakdown of detected task types:- Understand workload composition
- Optimize routing rules per task type
- Plan capacity
Quick Actions
Accessible from the homepage:Generate API Key
- Click to create new test/production keys
- Automatically copied to clipboard
- Set optional expiration dates
View Documentation
- Quick links to:
- Quickstart Guide
- API Reference
- Integration Examples
Download Report
Export current view as:- PDF: Executive summary with charts
- CSV: Raw data for analysis
- JSON: Programmatic access
Alerts & Notifications
Displayed in the top-right notification bell:Alert Types
Cost Alerts
- Budget threshold: 80% of monthly budget reached
- Spike detection: 50% daily increase vs. average
- Projected overage: Month-end projection exceeds budget
Performance Alerts
- Latency spike: > 50% increase in avg latency
- Error rate: Success rate drops below 95%
- Provider issues: Upstream provider degradation
Optimization Opportunities
- Model suggestion: Better model available for task type
- Cost savings: Potential to reduce spend by X%
- Quality improvement: Upgrade opportunity identified
Notification Settings
Configure in Settings → Notifications:- Email: Receive alerts via email
- Slack: Post to Slack channel
- Webhook: POST to custom endpoint
- In-app: Dashboard notifications only
Customization
Dashboard Widgets
Customize your homepage layout:- Click Customize Dashboard
- Drag and drop widgets
- Resize chart areas
- Hide/show specific metrics
- Save layout
- KPI cards
- Request volume chart
- Cost breakdown
- Model distribution
- Task type breakdown
- Latency trends
- Success rate trends
- Recent logs table
Saved Views
Create custom dashboard views:- Configure filters (time range, model, task type)
- Click “Save View”
- Name your view (e.g., “Production Monitoring”, “Weekly Review”)
- Access from dropdown in top navigation
- Cost Control: Focus on cost metrics and optimization
- Performance: Latency, success rate, provider health
- Quality: Validation rates, retry rates, fallback usage
Mobile Experience
The dashboard is fully responsive:- Mobile app: iOS and Android apps available
- Responsive web: Works on tablets and phones
- Touch-optimized: Tap to drill down into charts
- Push notifications: Get alerts on mobile
Keyboard Shortcuts
Quickly navigate the dashboard:| Shortcut | Action |
|---|---|
G then O | Go to Overview |
G then A | Go to Analytics |
G then L | Go to Logs |
G then S | Go to Settings |
? | Show keyboard shortcuts help |
/ | Focus search bar |
R | Refresh current view |
D | Download current view |
1-7 | Select time range (24h to custom) |
Embedded Dashboard
Embed dashboard charts in your own apps:iframe Embedding
JavaScript SDK
Data Refresh
- Real-time: KPIs update every 30 seconds
- Charts: Refresh every 2 minutes
- Manual: Click refresh button anytime
- Auto-refresh: Toggle in settings
Comparison Mode
Compare two time periods side-by-side:- Enable Comparison Mode
- Select Base Period (e.g., last 7 days)
- Select Comparison Period (e.g., previous 7 days)
- View delta metrics:
- Calls: ↑ 12.3%
- Cost: ↓ 5.7%
- Latency: ↓ 8.2%
- Success Rate: ↑ 1.2%
Export Options
PDF Report
Contents:- Executive summary
- All KPIs with period-over-period comparison
- Key charts (model distribution, cost breakdown)
- Top insights and recommendations
- Customizable branding (Enterprise)
- Stakeholder presentations
- Monthly reviews
- Compliance documentation
CSV Export
Includes:- All raw data points
- Timestamp, model, cost, latency per call
- Filterable by current dashboard view
- Maximum 100,000 rows per export
- Custom analysis in Excel/Sheets
- Feed into BI tools (Tableau, Looker)
- Audit trails
API Access
Programmatically access dashboard data via Metrics API.Collaboration Features
Shared Dashboards
Create shareable dashboard links:- Configure view with desired filters
- Click “Share”
- Set permissions:
- View-only
- Time-limited access
- Password-protected
- Copy link to share with team
Comments & Annotations
Add notes to specific time periods:- Click on chart at relevant time
- Add annotation: “Deployed new feature”
- Team members can see context
- Useful for: Correlating events with metric changes
Best Practices
Daily Monitoring
- Check Overview dashboard each morning
- Review alerts and notifications
- Verify success rate > 95%
- Scan for cost anomalies
Weekly Review
- Analyze 7-day trends
- Review optimization opportunities
- Check model distribution efficiency
- Validate budget tracking
Monthly Planning
- Export 30-day report
- Analyze task type evolution
- Plan capacity for next month
- Review and adjust budgets
Troubleshooting
Dashboard Not Loading
- Check internet connection
- Clear browser cache
- Try incognito/private mode
- Check status.withperf.pro
Data Seems Incorrect
- Verify time range selection
- Check for active filters
- Confirm API key has access to data
- Contact support if persistent
Charts Not Updating
- Click manual refresh button
- Disable browser extensions (ad blockers)
- Check auto-refresh is enabled
- Try different browser
Next Steps
Support
- Email: [email protected]
- Live Chat: Available in dashboard (bottom right)
- Documentation: docs.withperf.pro
- Video Tutorials: youtube.com/@perfai