How to Run a Data-Driven Carrier Performance Review

The Cost of Reviewing Carriers on Gut Feel

Most logistics companies conduct carrier performance reviews informally — a quarterly meeting where the ops team shares general impressions about service quality and the procurement team discusses rate competitiveness. These reviews produce vague outcomes: "Carrier X has been pretty good lately" or "we should look at alternatives for the Southeast Asia lanes." Without data, there is no accountability, no benchmarking, and no structured path to improvement.

A data-driven carrier review swaps opinions for metrics and anecdotes for measured trends. The result is carrier relationships that improve continuously, procurement decisions grounded in performance rather than relationships alone, and a carrier portfolio optimized for the specific balance of cost, service, and reliability that your business requires.

Step 1: Define Your Carrier Scorecard

Build a carrier scorecard with 6-8 metrics across three dimensions:

Service Quality Metrics

• On-time pickup rate: Percentage of shipments picked up within the confirmed window. Target: 95%+ for standard, 98%+ for premium lanes
• On-time delivery rate: Percentage of shipments delivered within the committed transit time. Track against both carrier-quoted transit time and your customer's delivery window
• Claims rate: Cargo damage and loss claims as a percentage of shipments handled. Include both the claim frequency and the average claim value to distinguish between frequent minor issues and rare major losses

Operational Metrics

• Documentation accuracy: Percentage of shipments with correct, complete documentation on first submission — BOLs, PODs, customs docs
• Responsiveness: Average time to confirm bookings, respond to status inquiries, and resolve issues. Track in business hours, not calendar time
• Capacity reliability: Percentage of confirmed bookings actually honored versus rolled, cancelled, or no-showed. This is critical for ocean carriers where blank sailings and equipment shortages directly impact your service commitments

Commercial Metrics

• Rate competitiveness: How carrier rates compare to market benchmarks and alternative carriers on the same lanes
• Invoice accuracy: Percentage of invoices matching contracted rates without adjustment. Carriers with high error rates generate hidden costs in audit and dispute resolution

Step 2: Collect and Normalize the Data

Data collection is the hardest step. Carrier performance data lives in multiple systems — your TMS, carrier portals, email confirmations, and manual tracking spreadsheets. The first step is consolidating this data into a single source of truth. Syntask automates this by pulling shipment events from carrier APIs, matching them against booking records, and calculating scorecard metrics automatically.

Data normalization is equally important. A carrier handling 500 shipments per month should not be compared on equal footing with one handling 20. Weight metrics by volume, and apply statistical significance thresholds — a 100% on-time rate on 5 shipments is meaningless, while 92% on 500 shipments is a reliable indicator.

Step 3: Benchmark and Rank

Once scorecards are populated, rank carriers by a composite score that weights each metric according to your business priorities. A company competing on service quality might weight on-time delivery at 30% and rate competitiveness at 15%. A cost-focused operation might reverse those weights. The composite score provides a single ranking that answers: if I could only use three carriers on this lane, which three should they be?

Benchmark each carrier against the lane average and against the top performer. Showing Carrier B that its 89% on-time delivery compares to Carrier A's 96% on the same lane creates a specific, data-backed improvement conversation that vague feedback cannot achieve.

Step 4: Conduct the Review Meeting

Share the scorecard with the carrier before the meeting so they can prepare. The review should follow a structured agenda:

1. Performance summary: 5 minutes reviewing the scorecard, highlighting strengths and areas below target
2. Root cause discussion: 15 minutes discussing the drivers behind underperformance — is it capacity issues, driver availability, routing decisions, or equipment problems?
3. Improvement commitments: 10 minutes agreeing on specific, measurable improvement targets for the next review period
4. Volume and rate discussion: 10 minutes discussing forward volume projections and rate adjustments tied to performance levels

Step 5: Close the Loop with Performance-Based Volume Allocation

The review only drives improvement if it affects outcomes. Implement performance-based volume allocation where top-performing carriers receive volume increases and underperformers lose share. This creates a direct link between service quality and revenue for the carrier — the most powerful incentive you can offer. Syntask's carrier management module automates this by adjusting routing rules based on current scorecard rankings, ensuring that volume flows to the carriers earning it through consistent performance.