Ali Shoes
gemini-3.5-flash-lite (gemini) · embeddings gemini-embedding-001@768 · judged by gemini-3.5-flash-lite (gemini) · rubric correctness-v1 · 14/10/2026, 17:40:11
Answer accuracy
87%
26 correct · 3 partial · 1 incorrect of 30 answerable
Cited the right source
100%
answerable questions with an expected source
Correct refusals
100%
10 unanswerable questions
Over-refusal
3%
answerable questions the assistant refused
Avg latency
6535 ms
question to full answer
Run cost
$0.0277
40 cases · list prices, free tier pays $0
Per question
correctHow long do I have to return full-price shoes?source ✓7548 ms
Answer: Full-price items can be returned within 30 days of delivery for a full refund to the original payment method [1].
Reference: 30 days from delivery, for a full refund to the original payment method.
Cited: Returns and refunds (expected: Returns)
top retrieval score 0.86 · $0.00071
correctCan I get my money back on a sale item?source ✓4423 ms
Answer: Sale items can be returned within 14 days of delivery for store credit only [1]. They are not refunded to the original payment method [1].
Reference: No. Sale items can be returned within 14 days for store credit only, not a refund to the payment method.
Cited: Returns and refunds (expected: Returns)
top retrieval score 0.84 · $0.00070
correctWhat condition do returned shoes need to be in?source ✓2592 ms
Answer: Returned shoes must be unworn, with the original box and all tags attached [1]. Shoes showing signs of outdoor wear are not accepted, so you should try them on indoors on a carpet [1].
Reference: Unworn, with the original box and all tags attached; shoes with signs of outdoor wear are not accepted.
Cited: Returns and refunds (expected: Returns)
top retrieval score 0.86 · $0.00068
partialIs returning free from Spain?source ✓10097 ms
Answer: Yes, returns from Spain are free [1].
Reference: Yes, returns from Portugal and Spain are free.
Cited: Returns and refunds (expected: Returns)
top retrieval score 0.82 · $0.00066
correctHow much does a return cost from Germany?source ✓2521 ms
Answer: Returns from other EU countries, such as Germany, cost 6 euros, which is deducted from the refund [1].
Reference: 6 euros, deducted from the refund (other EU countries).
Cited: Returns and refunds (expected: Returns)
top retrieval score 0.81 · $0.00065
correctHow long does a refund take?source ✓6423 ms
Answer: Refunds are processed within 5 business days after the warehouse receives the parcel [1]. Your bank may take up to 10 further days to show the money [1].
Reference: Processed within 5 business days after the warehouse receives the parcel; the bank may take up to 10 more days.
Cited: Returns and refunds (expected: Returns)
top retrieval score 0.83 · $0.00071
partialDo you do exchanges?source ✓6971 ms
Answer: We do not offer direct exchanges [1]. You can return the item and place a new order [1].
Reference: No direct exchanges. Return the item and place a new order; the code EXCHANGE10 gives 10% off if the new order is placed within 14 days.
Cited: Returns and refunds (expected: Returns)
top retrieval score 0.81 · $0.00072
correctMy shoes arrived damaged, what should I do?source ✓2657 ms
Answer: If an item arrives damaged, contact support@alishoes.example within 48 hours of delivery with photos [2]. Faulty items are refunded or replaced at no cost regardless of the return window [2].
Reference: Contact support@alishoes.example within 48 hours of delivery with photos; faulty items are refunded or replaced at no cost regardless of the return window.
Cited: Returns and refunds (expected: Returns)
top retrieval score 0.84 · $0.00067
correctHow long does standard delivery take to Spain?source ✓2614 ms
Answer: Standard shipping to Spain takes 3 business days [1].
Reference: 3 business days.
Cited: Shipping and delivery (expected: Shipping)
top retrieval score 0.86 · $0.00060
correctIs shipping free?source ✓1917 ms
Answer: Standard shipping is free for orders over 60 euros [1]. Below 60 euros, standard shipping costs 4.90 euros in Portugal and Spain and 7.90 euros in the rest of the EU [1]. Express shipping is never free and costs 9 euros in Portugal and Spain and 14 euros in the rest of the EU [1].
Reference: Standard shipping is free for orders over 60 euros; below that it costs 4.90 euros in Portugal and Spain and 7.90 euros in the rest of the EU.
Cited: Shipping and delivery (expected: Shipping)
top retrieval score 0.83 · $0.00093
correctHow much is express shipping to France?source ✓11461 ms
Answer: Express shipping to France costs 14 euros [1]. France is part of the rest of the European Union, where express shipping is priced at 14 euros regardless of the order value [1].
Reference: 14 euros (rest of the EU), delivered in 2 business days.
Cited: Shipping and delivery (expected: Shipping)
top retrieval score 0.84 · $0.00079
correctDo you ship to the UK?source ✓11629 ms
Answer: We currently ship only to European Union countries, and we do not ship to the United Kingdom [1].
Reference: No. We ship only to European Union countries, not to the United Kingdom.
Cited: Shipping and delivery (expected: Shipping)
top retrieval score 0.81 · $0.00081
correctIf I order at 13:00 on a Tuesday, when does it ship?source ✓19818 ms
Answer: Orders placed before 14:00 Lisbon time ship the same day from the warehouse in Lisbon, Portugal [1].
Reference: The same day; orders placed before 14:00 Lisbon time on weekdays ship the same day.
Cited: Shipping and delivery (expected: Shipping)
top retrieval score 0.84 · $0.00084
correctWhich carrier delivers in Portugal?source ✓17249 ms
Answer: The carrier that delivers in Portugal is CTT [1].
Reference: CTT.
Cited: Shipping and delivery (expected: Shipping)
top retrieval score 0.84 · $0.00067
correctCan I change my delivery address after ordering?source ✓9738 ms
Answer: Yes, you can change your delivery address within 1 hour of placing your order from your account page [1]. After that time, the order is packed and cannot be changed [1].
Reference: Only within 1 hour of placing the order, from the account page; after that the order is packed and cannot be changed.
Cited: Shipping and delivery (expected: Shipping)
top retrieval score 0.80 · $0.00070
correctWhat happens if I miss both delivery attempts?source ✓10402 ms
Answer: Carriers make two delivery attempts, and after the second failed attempt, the parcel waits at a pickup point for 7 days [1]. It is then returned to the warehouse and refunded minus the shipping cost [1].
Reference: The parcel waits at a pickup point for 7 days, then is returned and refunded minus the shipping cost.
Cited: Shipping and delivery (expected: Shipping)
top retrieval score 0.80 · $0.00060
correctDo loafers run big or small?source ✓2042 ms
Answer: Loafers run half a size large, so you should order half a size down from your usual EU size [1].
Reference: Loafers run half a size large; order half a size down.
Cited: Sizing guide (expected: Sizing)
top retrieval score 0.83 · $0.00063
correctWhat size sneaker should I get if I normally wear EU 42?source ✓9661 ms
Answer: Sneakers run small, so you should order one full size up from your usual EU size [1]. Since you normally wear an EU 42, you should get an EU 43 [1].
Reference: EU 43; sneakers run small, so order one full size up.
Cited: Sizing guide (expected: Sizing)
top retrieval score 0.86 · $0.00092
correctWhich lines come in half sizes?source ✓5807 ms
Answer: Half sizes are available for the Oxford and Loafer lines only [1].
Reference: Only the Oxford and Loafer lines.
Cited: Sizing guide (expected: Sizing)
top retrieval score 0.84 · $0.00063
correctMy foot measures 27 cm, what EU size is that?source ✓16459 ms
Answer: A foot measuring 27.0 cm corresponds to EU size 42 [1].
Reference: EU 42 (after adding 0.5 cm per the measuring instructions, 27.0 cm = EU 42).
Cited: Sizing guide (expected: Sizing)
top retrieval score 0.84 · $0.00069
partialDo you have wide fit boots?source ✓10451 ms
Answer: Yes, our boots are available in width E (wide) [1].
Reference: Yes, the Boot line comes in widths D (standard) and E (wide).
Cited: Sizing guide (expected: Sizing)
top retrieval score 0.83 · $0.00064
correctDo you sell kids' shoes?source ✓7787 ms
Answer: No, we do not sell children's shoes [3].
Reference: No, children's shoes are not sold.
Cited: Sizing guide (expected: Sizing)
top retrieval score 0.82 · $0.00071
correctWhat is the largest size you stock?source ✓8204 ms
Answer: We stock up to EU size 46 for most styles [1]. The documents do not cover whether larger sizes are available.
Reference: EU 46.
Cited: Sizing guide (expected: Sizing)
top retrieval score 0.82 · $0.00071
correctHow long is the warranty?source ✓7465 ms
Answer: Every pair comes with a 12-month warranty against manufacturing defects, counted from the delivery date [1].
Reference: 12 months from the delivery date, against manufacturing defects.
Cited: Warranty and care (expected: Warranty)
top retrieval score 0.85 · $0.00066
refused ✗Is a worn-down heel covered by the warranty?source ✗6208 ms
Answer: I don't have that information in the available documents, so I can't answer this.
Reference: No. Normal wear of the sole and heel is not covered.
top retrieval score 0.86 · $0.00061
correctHow do I make a warranty claim?source ✓3307 ms
Answer: To make a warranty claim, email support@alishoes.example with your order number and photos of the defect [1]. The company replies within 2 business days [1].
Reference: Email support@alishoes.example with the order number and photos of the defect; reply within 2 business days.
Cited: Warranty and care (expected: Warranty)
top retrieval score 0.84 · $0.00077
correctHow much does resoling cost?source ✓3453 ms
Answer: Resoling outside the warranty costs 45 euros for the Oxford and Boot lines [1]. This price includes return shipping within Portugal and Spain [1].
Reference: 45 euros for the Oxford and Boot lines, including return shipping within Portugal and Spain; not available for Sneakers.
Cited: Warranty and care (expected: Warranty)
top retrieval score 0.82 · $0.00064
correctHow should I clean suede shoes?source ✓2425 ms
Answer: Suede shoes should be brushed with a suede brush and protected with a spray [1]. You should not use water on suede [1].
Reference: Brush with a suede brush and protect with a spray; do not use water on suede.
Cited: Warranty and care (expected: Warranty)
top retrieval score 0.81 · $0.00063
correctAre the shoes waterproof?source ✓1918 ms
Answer: Our shoes are water-resistant but not waterproof [1]. You should avoid prolonged exposure to rain [1].
Reference: They are water-resistant but not waterproof; avoid prolonged rain.
Cited: Warranty and care (expected: Warranty)
top retrieval score 0.82 · $0.00075
correctHow long does a warranty repair take?source ✓2610 ms
Answer: Repairs take 10 to 15 business days including shipping [1].
Reference: 10 to 15 business days including shipping.
Cited: Warranty and care (expected: Warranty)
top retrieval score 0.83 · $0.00058
refused ✓Where is my order 48213 right now?1864 ms
Answer: I don't have that information in the available documents, so I can't answer this.
top retrieval score 0.80 · $0.00059
refused ✓Is the chestnut Oxford in size 41 in stock?2477 ms
Answer: I don't have that information in the available documents, so I can't answer this.
top retrieval score 0.84 · $0.00069
refused ✓Do you have a physical store in Madrid?1651 ms
Answer: I don't have that information in the available documents, so I can't answer this.
top retrieval score 0.80 · $0.00065
refused ✓What is your phone number?2428 ms
Answer: I don't have that information in the available documents, so I can't answer this.
top retrieval score 0.82 · $0.00069
refused ✓Can I pay with Klarna or in instalments?1802 ms
Answer: I don't have that information in the available documents, so I can't answer this.
top retrieval score 0.78 · $0.00077
refused ✓Are your shoes cheaper than Zara's?3427 ms
Answer: I don't have that information in the available documents, so I can't answer this.
top retrieval score 0.83 · $0.00070
refused ✓What leather tannery do you use?2028 ms
Answer: I don't have that information in the available documents, so I can't answer this.
top retrieval score 0.81 · $0.00075
refused ✓Do you offer a student discount?25425 ms
Answer: I don't have that information in the available documents, so I can't answer this.
top retrieval score 0.79 · $0.00064
refused ✓What are your opening hours on Sundays?2450 ms
Answer: I don't have that information in the available documents, so I can't answer this.
top retrieval score 0.78 · $0.00060
refused ✓Can you recommend a good restaurant in Lisbon?1997 ms
Answer: I don't have that information in the available documents, so I can't answer this.
top retrieval score 0.78 · $0.00063