2/23/25, 10:45 AM Guidelines for Search - App Store Training — BaseLine

Search - App Store Training

Guidelines for Search - App Store Training

https://baseline.apple.com/training/evaluations/3/guidelines 1/29
2/23/25, 10:45 AM Guidelines for Search - App Store Training — BaseLine

SS1.png •628 KB

Updated 7/18/2024
Added more examples for Complex queries covering

-Location specific complex queries

-Complex queries asking for additional knowledge

Updated 6/24/2024
Added more examples for Complex queries covering

- Complex queries asking for tv or movie content

Updated 6/20/2024
Added more examples for Complex queries covering

-Complex queries with app release date

-Complex queries with developer intent (under Other Complex Query Examples section)

Updated 6/6
Added more examples for Similar App queries under Complex Queries section

Updated 5/16/2024
Added section on Complex Queries
https://baseline.apple.com/training/evaluations/3/guidelines 2/29
2/23/25, 10:45 AM Guidelines for Search - App Store Training — BaseLine

Updated 2/12/2024
Added Section on Vision App Store Tasks

Updated 8/2023
Added Very Ambiguous Queries section under Common Points of Confusion for queries like [..], or [,].

Updated 7/18/2023
Added additional examples of story results for App Navigational queries: [angry birds], [warzone]

Added further clarification to Developer Card results for Functional queries:

Developer Card → Acceptable, if the developer contains apps that satisfy the query intent or if the developer name matches with
the query. (Example: [free games without wifi] → Ketchapp, [playg] → Playgendary Limited)

Updated 6/26/2023
Added examples under App Navigational for [netflix] query.

Introduction
In this document, we explain relevance rating guidelines for App Store content. You will use the BaseLine tool to make these
ratings.

iPhone Screenshots available in BaseLine since 9/23/19

Up to six iPhone Screenshots are now available in BaseLine. These images will help you glean more information about the quality,
content and functionality of the app in question. Since we're able to see what the app looks like, we should rate all app results
based on relevance and quality, even if the link to the App Store preview page happens to be unavailable at the time of rating.
Clicking on a screenshot will cause it to grow or shrink. Clicking on a screenshot while holding CMD/CNTRL(Windows) will cause it
to open the image in a new tab. For international scrapes, the app screenshots will either be localized or will show US screenshots
as a backup.

Mandatory Comment
Each rating must be explained in the comment box [even if “optional” is indicated - rating comments are always mandatory].
The comment should be concise and must only explain why the rating chosen is the correct one in application of the guidelines.
See example below:

SS2.png •65.8 KB

Table of Contents
Introduction
Query Intent: App Navigational
Query Intent: Functional
Query Intent: Dev Navigational
Common Points of Confusion

Query Type: App Navigational

Definition: A query that refers to a specific app.

https://baseline.apple.com/training/evaluations/3/guidelines 3/29
2/23/25, 10:45 AM Guidelines for Search - App Store Training — BaseLine

Examples: [facebook], [twitter], [instagram], [pinterest], [chalk draw free!], [audible], [gmail], [angry birds] Note: this query currently
points to the Angry Birds 2 game, since AB Classic was removed from the store, [candy crush], [minecraft free], [imovie free].

SS3.png •637 KB

A query with both app and developer intent is classified as App Navigational when that developer has one canonical app associated
with them, i.e.Facebook, Amazon, Bank of America.

Note: The following examples are also App Navigational queries:

Android apps [chromer], [adv screen recorder], [slidejoy];

Apps not available in the store [command and conquer (Mac only), cod black ops 4 (console)];
Invalid queries [temple run 3], [clash of clans 2];
Queries requesting a specific app in any language (a translation is available in BaseLine for non-English queries)

App Navigational → Perfect

Developer Card → Excellent (Developer cards are eligible for the rating of Perfect, if the query matches the developer name, for
example [mobileiron])
Editorial Item (Story/Collection) → App/Game of the Day Stories, as well as other stories about the intended app can be rated
Excellent. Stories with a specific theme, containing a collection of apps that includes the intended app can be rated Good. Stories
not containing the intended app, but satisfying the intent can get Good, or Acceptable.
Examples:
[tiktok] → App of the Day TikTok → Excellent (The story contains the intended app, and is specifically about the intended app.)
→ 5 Fun TikTok Effects → Excellent (The story contains the intended app, and is about certain functions of the intended app.)
→ Shoot it short and funky → Good (The story itself is too specific. This is a collection of apps that share a common theme and
does include the intended app.)
[angry birds] → Which Angry Bird Are You? → Excellent (This is a story about Angry Birds 2, as well as other games in the

https://baseline.apple.com/training/evaluations/3/guidelines 4/29
2/23/25, 10:45 AM Guidelines for Search - App Store Training — BaseLine
franchise.)
[gwent] → Card Battle Games → Good (The story doesn't have the intended game but has many high quality card battle games
similar to the intent.)
[brawl stars] → What we’re playing now → Acceptable (The intended app itself is not included in the story. However, The story
contains some games that are partially similar.)
[warzone] → Get Ready for Call of Duty: Warzone Mobile → Excellent (Although the app is in pre-order, the story still contains the
intended app, and is specifically about the intended app.)
Add Ons → Excellent if the add-on is for the intended app, Good if it's for another similar functionality app that is good quality.
Acceptable if the add-on is for an app that is low to poor quality, or if the add-on belongs to an app that satisfies a secondary intent
like a complimentary app or an app with limited functionality.
Bundles → A bundle can get Perfect. Example: [cut the rope] → Cut the Rope for iPhone - Value Pack -- Perfect; contains the
intended original app along with others apps in the series. If the bundle contains the Navigational result, along with other unrelated
apps created by the same developer, it should be rated Excellent. If the bundle contains only apps with similar functionalities that
might satisfy the intent it shall be rated according its relevancy as Good or Acceptable.
Other apps by the same developer → Excellent to Acceptable (Example: for the query [gmail] → Google Translate is Acceptable,
since Google is considered a canonical developer (canonical here defined as widely recognized and authoritative.) App by the
same developer and in the same realm -> Excellent; App by the same developer but in different realm from the intended app ->
Good or Acceptable; App by the same developer but hasn’t been updated for over 3 years and has poor or no reviews ->
Acceptable.
Apps by other developer(s) with similar functionalities that are good quality → Eligible for Excellent
Apps by other developer(s) with similar functionalities that are good quality but have no reviews and ratings → Eligible for
Excellent.
Apps by other developer(s) with similar functionalities but are of lower quality → These apps can be rated Good or
Acceptable. You can determine quality by looking at the developer screenshots within the App Store Preview.
Apps by other developer(s) but have not been updated for 3 or more years and have poor or no reviews → Acceptable. For
App Navigational queries, this rule does not apply to the following scenarios:

1. The result is the intended app. The intended app should receive a rating of Perfect regardless of updates.
2. The result is a Story/Collection. Stories should not be demoted to Acceptable if the app or apps within it have had no updates for
3 or more years and have poor or no reviews.

You can check the last update date by looking at 'Version History' on the App Store Preview Page.

If the app has had no updates for 3 or more years and has positive reviews, do not consider the lack of updates when rating. Rate
based on the relevance and quality of the app.

Apps by other developer(s) but not all the functionalities, and/or lower quality → Good or Acceptable
Apps that keyword match the query, but may not satisfy the user intent → Acceptable
Unacceptable: Off Topic: A piece of content that is unrelated to the query, and does not satisfy a primary nor a secondary intent of
the query.
Unacceptable: Spam: A piece of content that contains obvious keyword spam and/or misleading description or screenshots.
Unacceptable: Other: Any other unacceptable content that is not included above.

Example ratings:
Query: [gmail]
Gmail - Email by Google (App Navigational) → Perfect
App of the day story - featuring Gmail → Excellent
Google LLC (Developer Card) → Excellent
“Clean Out Your Inbox (for Real This Time)" (Story/Collection) → Good. Contains the navigational app Gmail along with other
relevant email apps.
myMail box: email client app (App by another developer, with partially similar functionality) → Good. This is email client app that
enables users to work with different mail accounts. This app satisfies a secondary intent.
Yahoo Mail - Stay Organized (Email app by another developer with similar functionalities) → Excellent
Google Translate (another unrelated app by Google) → Acceptable

Query: [flashlight - night light clock]

Flashlight - Night Light Clock → Perfect
Flashlight Ⓞ → Good. This app has a similar flashlight function, but does not have a clock option. Partially satisfies the intent.

https://baseline.apple.com/training/evaluations/3/guidelines 5/29
2/23/25, 10:45 AM Guidelines for Search - App Store Training — BaseLine
Flashlight ϟ → Acceptable. This app has had no updates for more than 3 years has mostly poor reviews.

Query: [google calendar]

Google Calendar: Get Organized → Perfect
Simple Calendar - SimpleCal → Excellent
Calendar · → Excellent. Although this app has not been updated for over 3 years, it has mostly positive reviews. This app is good
quality and is similar to the intended app.

Query: [netflix]
Netflix → Perfect
Hulu: Watch TV shows & movies → Excellent
Krispee Street → Good. This is a game by the same developer but would satisfy a secondary intent. This game and the intended
app are not similar.

Query: [whatsapp]
WhatsApp Messenger (App Navigational) → Perfect
Keep in Touch (Story/Collection) → Good. Contains the navigational app WhatsApp along with other relevant messaging apps.
Lock WhatsApp web dual chat (add-on) → Acceptable. This is an add-on, but for an app that is complimentary to the intended app
(parent app Messenger Duo for WhatsApp satisfies a secondary intent).

Query: [candy crush]

Candy Crush Saga (App Navigational)→ Perfect
King (Developer Card) → Excellent
"Why Is Candy Crush's Level 65 So Hard?" (Story/Collection) → Excellent. Contains the navigational game and a behind the
scenes look at the level 65.
Candy Crush Soda Saga (another match 3 game by King)→ Excellent
“65 Winning Candy Crush Combos” (Story/Collection) → Excellent
Cookie Jam Matching Game→ Excellent. A popular match 3 game by Jam City, Inc.
"Extra Moves" for Candy Crush Saga (add-on) → Excellent. This is an in-app-purchase for the intended game.
"Order of 25 coins" for Cookie Jam (add-on) → Good. This is an in-app-purchase for another similar game.
Fruit Ninja→ Unacceptable: Off Topic.
Panda Candy - Pop & Crush toy Toon Blast bubble shooter → Unacceptable: Spam.Contains keyword spam.

Query: [amazon]
Amazon - Shopping made easy (App Navigational) → Perfect.This is the canonical app associated with Amazon.
AMZN Mobile LLC (developer card) → Excellent
Amazon Music→ Excellent. The query [amazon] is considered an App Navigational query, but it also has strong developer intent.
This is another app by the intended developer and eligible for Excellent.
Amazon Prime Now→ Excellent. Another app by the intended developer and eligible for Excellent.
Kindle→ Excellent. Another app by the intended developer and eligible for Excellent.
"TRY SOMETHING NEW - 3 Must-Try Tips for Amazon Prime Video" (Story/Collection) → Good. This is a Story about Amazon
Prime Video, providing users with tips and tricks on how to best use the app.
eBay→ Good. Satisfies a secondary intent of the query.
"Amazon FreeTime Unlimited Subscription" (Free trial offer, add-on) → Good. This is a subscription for another Amazon app.
NOOK - Read Books, Magazines, Newspapers & Comics→ Unacceptable: Off Topic.

Query: [draw a stickman epic free]

When a user requests the free version of an app, the free version is rated Perfect, and the paid version of that same app should be
Good.
Draw a Stickman: EPIC Free → Perfect.
Draw a Stickman: AR → Excellent. This is a free app with similar functionalities and by the same developer.
Draw a Stickman: EPIC → Good. This is the paid version of the intended app. Only partially satisfies the intent, since this app is
Introduction
not free.
Table of Contents

Query Type:
Query: [drawApp Navigationalepic]
a stickman
If Query
the user does
Type: not specifically ask for a free or paid version of an app, both should be rated Perfect.
Functional

Query Type: Dev Navigational

https://baseline.apple.com/training/evaluations/3/guidelines 6/29
2/23/25, 10:45 AM Guidelines for Search - App Store Training — BaseLine
Query Type: Dev Navigational
Draw a Stickman: EPIC Free → Perfect.
Complex
Draw Queries EPIC → Perfect.
a Stickman:
Vision App Store Tasks

Apple Arcade

Query Type:
Common Points Functional
of Confusion

Very Ambiguous Queries

Definition: Queries
Disagreement in this
with the category
Query Type express intent for apps with a particular function or theme.
Examples: [free apps], [top free games], [girls games], [rpg], [action games], [news], [cloud storage], [wallet], [fitness], [batman],
Researching Query Intent:
[spongebob games], [scanner], [harry potter], [libros] (query in Spanish, translates to "books") etc.
Primary and
Functional Secondary
queries can intent
also be incomplete queries that do not have a clear intent: [my], [the], [in], [zo] etc.
ThisSpell
alsoCorrection
includes:
-Native Apple apps and functions that cannot be removed and re-downloaded from the App Store such as: [app store], [airplay],
Queries with multiple likely intents
[apple pay], [carplay], [siri], [game center], [icloud] etc.
Adult Content
-Queries expressing intent for apple devices such as: [homepod mini], [iphone], [appletv remote] etc.
Problem: Other

Foreign Language

Unacceptable: Spam

Common Misunderstandings

SS4.png •727 KB

Popular and well-known apps that clearly satisfy the primary intent of the query → Perfect
Editorial Item (Story/Collection) →A story containing multiple apps, and all of those apps satisfy the intent can get Perfect.
App/Game of the Day Stories, as well as other stories about a single app that satisfies the intent can be rated Excellent. Stories
containing apps that satisfy a secondary intent or partially satisfy the intent can be rated Good. Stories containing apps that poorly
satisfy the intent or only slightly satisfy the intent can get Acceptable.
Apps that are less popular/known but still clearly satisfy the intent of the query *→ Excellent
*Bundles→ Rate the same as the most relevant app in the bundle
Apps that satisfy the intent but have no reviews and ratings → Eligible for Excellent. These apps can be rated Good or
Acceptable if the app appears to be lower quality. You can determine quality by looking at the developer screenshots within the App
Store Preview.
Apps that satisfy the intent but are of low or poor quality → These can be rated Good or Acceptable. You can determine quality
by looking at the developer screenshots within the App Store Preview.
Apps that satisfy a primary or secondary intent but have not been updated for 3 or more years and have poor or no
reviews → Acceptable. For Functional queries, this rule does not apply to the following scenario:

https://baseline.apple.com/training/evaluations/3/guidelines 7/29
2/23/25, 10:45 AM Guidelines for Search - App Store Training — BaseLine

-The result is a Story/Collection. Stories should not be demoted to Acceptable if the app or apps within it have had no updates for
3 or more years and have poor or no reviews.

You can check the last update date by looking at 'Version History' on the App Store Preview Page.

If the app has had no updates for 3 or more years and has positive reviews, do not consider the lack of updates when rating. Rate
based on the relevance and quality of the app.
Apps that partially satisfy the intent, or lower quality → Good, or Acceptable
Add Ons → Excellent if the add on is for an app that satisfies the functional intent and is of high quality. Good if the add on is for an
app that is less popular. Acceptable if the add on is for an app that is poor quality, or satisfies a secondary intent.
Developer Card → Acceptable, if the developer contains apps that satisfy the query intent or if the developer name matches with
the query. (Example: [free games without wifi] → Ketchapp, [playg] → Playgendary Limited)
Unacceptable: Off Topic: A piece of content that is unrelated to the query, and does not satisfy a primary nor a secondary intent of
the query.
Unacceptable: Spam: A piece of content that contains obvious keyword spam and/or misleading description or screenshots.
Unacceptable: Other: Any other unacceptable content that is not included above.

Example ratings:
Query: [podcast]
iCatcher! Podcast Player→ Perfect
Podcast Paradise, The Daily List (Editorial Item) → Perfect. This is a curated collection of several popular, high quality podcast
apps.
Podcast Player → Excellent, not that well-known or popular.
TuneIn Radio→ Good. Contains podcasts, but doesn't seem to have the all the functionalities of an app dedicated to podcasts only;
partially satisfies the intent.
Soundcloud→ Good. Contains podcasts, but doesn't seem to have the all the functionalities of an app dedicated to podcasts only;
partially satisfies the intent.
NPR News→ Acceptable Limited to NPR podcasts only, poorly satisfies a secondary intent of the query.
The Podcast App Premium Subscription (remove all adverts from the app add-on) → Excellent. This is an add on for an app that is
popular and clearly satisfies the intent of the query.
Cloud Music Player for Clouds → Unacceptable: Off Topic. No podcast functionality.

Query: [radio]
RadioApp - A Simple Radio → Perfect
Satellite Radio Channel Guide for Sirius XM → Acceptable. App has not been updated for over 3 years and has mostly poor
reviews.

Query: [siri] - The intent for this query is not for a single app, but for apps that support Siri.
Things 3 → Perfect
Just Ask Siri (Editorial Item) → Perfect. This is a story containing several apps that are supported by Siri.

Query: [top 10 games]

Asphalt 8: Airborne→ Perfect
Candy Crush Saga→ Perfect
2048→ Perfect
Boom Slingers → Excellent, not that well-known or popular.
3D Shark Feed and Growing Fish → Good. This game appears to be lower quality given screenshots and ratings.
Heroes of Rome II → Acceptable. A low quality game with negative reviews.
Standard Car Pack, an in-app purchase (add-on) for Asphalt 8: Airborne → Excellent. This is an add on for an app that is popular
and clearly satisfies the intent of the query.
GarageBand→ Unacceptable: Off Topic.
Crazy Circle Jump -more mode,1,dot pop up 2,ball bounce 3,mr ninja ride dash→ Unacceptable (Spam)

Query: [free games for kids]

Drawing for kids: doodle games -> Perfect
Pizza maker cooking games -> Perfect
Subway Surfers -> Good. Game is geared toward older age kids and adults. Satisfy a secondary intent.

https://baseline.apple.com/training/evaluations/3/guidelines 8/29
2/23/25, 10:45 AM Guidelines for Search - App Store Training — BaseLine
Minion Rush -> Good. Game is for older kids (9+) and adults.
PUBG MOBILE -> Unacceptable: Off Topic. This game is for 12+ age group.

Query: [my]
MyFitnessPal: Calorie Counter -> Perfect. Intent is unclear. This app is well-known, good quality, and matches with the query in the
first word of the app title. It could be a possible primary intent.
My Talking Angela -> Perfect. Intent is unclear. This app is well-known, good quality, and matches with the query in the first word of
the app title. It could be a possible primary intent.
My Singing Monsters -> Perfect. Intent is unclear. This app is well-known, good quality, and matches with the query in the first
word of the app title. It could be a possible primary intent.
My Town: Sticker Book -> Excellent. Intent is unclear. This app is less popular but is good quality, and matches with the query in
the first word of the app title. It could be a possible primary intent.

Query: [game]
Pokemon Go -> Perfect. Popular app that satisfies broad range of users.
Shoe Race → Good. App targets a specific group of users
Game of the Day - Candy Crush -> Excellent. This is a story about a single game that satisfies the intent of the query.
The Wheels Man On Happy Bike → Acceptable. This game has not been updated for over 3 years and has mostly poor reviews.

Query Type: Dev Navigational

Definition: A query that refers to a specific developer which the user queries for by name.
Examples: [rovio], [dumadu], [disney], [apple], [google], [lightricks], [gameloft], [ketchapp], etc.

ss5.png •660 KB

Note: [top free games] does not qualify as a developer query even though there exists a developer named top free games. The
reason is that the vast majority of users entering this query on the App Store are looking for popular free games, not for a developer
called Top Free Games. Similarly, queries like [photo and video editor], [emoji icons free] are functional, not developer queries,
despite the fact that there are developers called Photo & Video Editor and Emoji Icons Free, and Emoji Icons Free and Color
Texting Messages Pro Studio.

https://baseline.apple.com/training/evaluations/3/guidelines 9/29
2/23/25, 10:45 AM Guidelines for Search - App Store Training — BaseLine

Developer Card → Perfect

Apps by the developer → Perfect
Apps by the developer that have not been updated for three years or more and have poor or no reviews → Excellent.
Editorial Item (Story/Collection) → Stories about the Developer (such as "Meet the Developer"/"Behind the Scenes") are eligible
for Perfect. A story containing an app or apps by the intended developer can get Excellent (App/Game of the Day). Stories that are
not about the intended Developer or about an app by the intended Developer, but are about a developer or apps similar to the
intended Developer can get a rating of Good.
Add Ons→ Excellent, if the add-ons are for an app by the intended developer. Good if they're for an app with similar functionality.
Acceptable if the add ons are for an app that is poor quality, or satisfy a secondary intent.
App Bundles by the dev→ Perfect. Excellent if apps are abandoned
Apps by other developer(s) with similar functionalities, are of good quality → Eligible for Excellent
Apps by other developer(s) with similar functionality but have no reviews and ratings → Eligible for Excellent. These apps
can be rated Good or Acceptable if the app appears to be lower quality. You can determine quality by looking at the developer
screenshots within the App Store Preview.
Apps by other developer(s) but not all the functionalities, and/or lower quality → Good or Acceptable
Unacceptable: Off Topic: A piece of content that is unrelated to the query, and does not satisfy a primary nor a secondary intent of
the query.
Unacceptable: Spam: A piece of content that contains obvious keyword spam and/or misleading description or screenshots.
Unacceptable: Other: Any other unacceptable content that is not included above.

*Note:
Relevant apps that have had no updates for 3 or more years (36 months or more) and have poor or no reviews should receive a
rating of Acceptable. For Developer Navigational queries, this rule does not apply to the following scenarios:
1. The result is an app by the intended developer. Apps by the intended developer that have had no updates for 3 or more years
can get a rating of Excellent.
2. The result is a Story/Collection. Stories should not be demoted to Acceptable if the app or apps within it have had no updates for
3 or more years and have poor or no reviews.

You can check the last update date by looking at 'Version History' on the App Store Preview Page.

If the app has had no updates for 3 or more years and has positive reviews, do not consider the lack of updates when rating. Rate
based on the relevance and quality of the app.

Example ratings:
Query: [savage interactive]
Savage Interactive Pty Ltd (Developer Card) → Perfect
Procreate Pocket (app by the developer) → Perfect
Meet The Developer - A Creation Story → Perfect.This is a story about Savage Interactive Pty Ltd, and the road to developing the
Procreate app.
Drawing Desk: Draw & Paint Art→ Excellent. An app by another developer, offering similar functionality as the intended
developer's app.

Query: [sega]
Sega (Developer Card) → Perfect
Made by SEGA → Excellent. Contains a couple of popular games by Sega.
Retro Revival: Sonic Dash 2 → Excellent. Contains the game ‘Sonic Dash 2: Sonic Boom’.
“GAME OF THE DAY - Mascot Mashup" → Excellent. Contains the "SEGA Heroes: Match-3 RPG Quest" game.
Sonic Dash→ Perfect
Super Mario Run→ Good. A popular side-scrolling, auto-runner game slightly different from Sonic the Hedgehog games, satisfies a
secondary intent.
Taster Bundle (Add-on) for Sonic Dash 2 → Excellent. This is an in-app purchase option for a game by the intended developer.

Complex Queries

https://baseline.apple.com/training/evaluations/3/guidelines 10/29
2/23/25, 10:45 AM Guidelines for Search - App Store Training — BaseLine

When working on App Store Search eval, you may encounter complex queries that are longer than the standard search and
structured like a sentence. Because of their structure, understanding what is being asked for will be key in judging results for these
queries.

Complex queries that have multiple intents

Complex queries could ask for multiple functions or features. If a result only partially satisfies what is being asked for, then it should
not be given a rating that is higher than Good.

Example:

Query: [abc tracing alphabet learning writing letters]

Result: LogicLike: Kids Learning Games

This query is asking for abc alphabet learning apps with tracing and writing letter function. A game like LogicLike: Kids Learning
Games does have a ABC learning function, but does not include a function for writing or tracing letters. Although this result is good
quality, it only partially satisfies what is being asked for. Therefore, a rating of Good is adequate. ABC Kids - Tracing & Phonics
however, has all that is being asked for. It is an alphabet learning app with a letter tracing function that teaches kids how to write
letters. This is also a popular app and can receive a rating of Perfect.

Complex queries asking for tv or movie content

Some complex queries will ask for apps containing specific tv or movie content, like the query [apps to stream series mr. bean]. The
easiest way to check the availability of the video content on a given platform is to search for the result on a reliable search engine
like Google to verify. For example, if Hulu: Stream TV shows & movies was the result for the mentioned query, you can do a search
on Google for 'where to watch mr bean series' or 'mr bean series hulu' to confirm if the intended tv or movie content is available on
Hulu. Streaming guides like justwatch.com can also confirm where you can watch the intended content.

Examples:

Query: [apps to stream series mr. bean]

Results:
Hulu: Stream TV shows & movies → Perfect (Hulu has the Mr. Bean tv series. Perfectly satisfies the user intent.)
Xfinity Stream → Perfect (This platform has the TV series Mr. Bean. Satisfies the primary intent.)
Max: Stream HBO, TV, & Movies → Good (This platform has only Mr. Bean: The Animated Series, but the animated series is not as
popular as the TV series and would partially satisfy the user intent.)
Peacock TV: Stream TV & Movies → Off-Topic (Peacock TV does not have the intended content.)

Query: [need to watch dragon ball]

Results:
Crunchyroll → Perfect (This platform is for streaming anime shows and movies. Has the intended content and fully satisfies the
intended Dragon Ball anime.)
Tubi: Movies & Live TV → Good (This video platform has a live action movie called Dragon Ball: Comienza La Magia that is not
well known but may satisfy a secondary intent.)
Peacock TV: Stream TV & Movies → Off-Topic (Peacock TV does not have the intended content.)
DRAGON BALL LEGENDS → Off-Topic (This is a Dragon Ball game but is not releated to watching Dragon Ball series.)

Complex queries with app release date

Some complex queries will ask for apps or games released on a specific year. You can search on a reliable search engine like
Google to verify if an app result was released on the mentioned year. For example, if Pico Tanks was the result for the query [battle
games launched in 2020], you can do a search on Google for 'pico tanks release date' to confirm if the game was launched in 2020
as specified in the query.

Query: [battle games launched in 2020]

https://baseline.apple.com/training/evaluations/3/guidelines 11/29
2/23/25, 10:45 AM Guidelines for Search - App Store Training — BaseLine

Results:
Pico Tanks → Perfect (This is a popular and good quality battle arena game, launched in 2020.)
Towers Defense 3D Battle Games → Excellent (This is a good quality battle game launched in 2020, but is less popular.)
Clash Royale → Good (This is a battle game, but was launched in 2016. Partially satisfies the intent.)
Game of War - Fire Age → Acceptable (This is a battle game launched in 2020, but has poor reviews.)
Play Golf 2020 → Off-Topic (This is a game launched in 2020, but is not a battle game and would not satisfy the main genre of
game that is being queried for.)

Similar App Queries

Queries for similar apps are complex queries asking for apps that are like or similar to another app. For example, the query [apps
that are similar to doordash] is asking for apps similar to DoorDash - Food Delivery, like Uber Eats: Food Delivery or Grubhub:
Food Delivery.

Please Note: If the result for a Similar App query is the mentioned app (If DoorDash - Food Delivery was the result for [apps that
are similar to doordash]), the mentioned app should receive a rating of Acceptable.

Examples:

Query: [apps for signing documents like docusign]

Results:
Adobe Fill & Sign－Form Filler → Perfect (Adobe Fill & Sign is a high quality and well-known app that shares the same core
functionality as Docusign.)
eSign App - Sign PDF Documents → Excellent (eSign App shares the same core functionality as Docusign, but is less popular.)
CamScanner - PDF Scanner App → Good (CamScanner does have a document signing function, but is missing some capabilities
that Docusign has like allowing others to sign the documents, sending reminders to sign, and getting notifications on who and when
the documents are signed)
Docusign - Upload & Sign Docs → Acceptable (Although Docusign is the app mentioned in the query, the user is asking for a
similar app, not the app itself. For this query, Docusign is only eligible for a rating of Acceptable.)

Query: [music apps similar to spotify]

Results:
Apple Music → Perfect (Apple Music is a high quality and well-known app that shares the same core functionality as Spotify.)
Youtify - Music & Playlists → Excellent (Youtify is a high quality and well-known app that shares the same core functionality as
Spotify, but is less popular.)
SoundCloud: Discover New Music → Good (SoundCloud is also a music streaming app, but primarily used for discovering new
music and artists and is more limited in its catalog. This app would satisfy a secondary intent.)
Essential Music Apps (Story) → Good (Although this story contains some apps that are similar to Spotify, many of the other apps
are for music creation and learning which are not similar. If the story had apps that were all similar, it would be eligible for Perfect.)
Cloud Music Player - Listener → Acceptable (Cloud Music Plater is an offline music player and downloader. Although you can play
music offline which is a similar function included in Spotify, it is barely similar as it lacks other important functionalities.)

Location specific complex queries

Some queries will ask for the top, popular, or best apps in a particular country or region. For a query like [multiplayer games popular
in pakistan], what you can do is click on the result and go to the App Store Preview. In the App Store Preview, go to the link above
and change the country 2-letter code in the link to the mentioned country’s code. 2-letter country codes (US for United States, JP
for Japan, etc.) can be found by searching on a reliable browser like Google. In this example, you would switch ‘us’ for ‘pk’ in the
link:

App Store Preview Link with country code

Once you refresh the link, the App Store Preview will show you the ratings, reviews, and ranking of that app in the specific market:
https://baseline.apple.com/training/evaluations/3/guidelines 12/29
2/23/25, 10:45 AM Guidelines for Search - App Store Training — BaseLine

App Store Preview

Query: [multiplayer games popular in pakistan]

Results:
Roblox → Perfect (This is highly popular multiplayer game, available in Pakistan.)
Brawl Stars → Perfect (This is highly popular multiplayer game, available in Pakistan.)
AFK Football: RPG Soccer Games → Good (This is a multiplayer game available in Pakistan but is not popular. Only 2 reviews in
Pakistan market.)
Minion Rush: Running game → Off-Topic (This is a runner game that is not multiplayer.)

Please note that certain apps may not be available in the country specified in the query. If the App Store Preview does not load
once you change the 2-letter country code to the specified country or region and refresh the link, it likely means the app is not
available in that country. In the screenshot below, the country code for Hulu: Stream TV shows & movies was changed from US
to GB (GB being the country code for the United Kingdom). The App Store Preview did not load, and screen remained in the
'Connecting...' screen:

App Store Preview not loading for GB market

https://baseline.apple.com/training/evaluations/3/guidelines 13/29
2/23/25, 10:45 AM Guidelines for Search - App Store Training — BaseLine
You can search on a reliable web browser and verify whether the app is available in the specified country, such as 'is Hulu available
in the UK' on Google. If the app is not available in the specified country, then the rating should be Unacceptable: Off Topic. For
example, for the query [best tv streaming apps in uk], the app Hulu: Stream TV shows & movies would receive a rating of
Unacceptable: Off Topic as the app is not available in the UK.

Query: [best tv and movie streaming apps in uk]

Results:
Netflix → Perfect (This is a popular and High quality tv and movie streaming app in the UK, and is available in the market.)
YuppTV - Live TV & Movies → Good (This is a tv and movie streaming app available in the market, but is less popular and lower
quality according to the ratings. There are better options for tv and movie streaming in the market that can be considered 'best'.
YuppTV can satisfy a secondary intent.)
Hulu: Stream TV shows & movies → Off-Topic (This app is not available in the UK market.)

Cost Specific Complex Queries

Some complex queries will ask for apps with a specific cost, like [photo app below $5] or [video editing apps under $10]. For these
cases, If the app result is within the price range that the user is asking for (clearly marked under the stars in the App Store
Preview), and does not require purchasing a membership or a ‘PRO' version to actually use the app, it can be eligible for a rating of
Perfect. The app would also have to satisfy the functional intent that the query is asking for (‘photo app’ or 'video editing apps' in
the mentioned queries).

If the app does fulfill the functional intent, but is above the price range, then the app can be given a rating of Acceptable.

Query: [sketching apps under $5]

Results:
Sketchbook® → Perfect (This is a popular sketching app that is free and satisfies the functional intent.)
Procreate Pocket → Acceptable (This is a sketching app, but is $5.99 according to the App Store Preview.)

Other Location specific complex queries

Query: [apps for local travel in england]

**(This is another location specific complex query but is not asking for top apps. Please note that this is query is only asking for
apps for local travel in England, so it does not require a change in the country code like the example above.)

Results:
Booking.com: Hotels & Travel → Excellent (This is not an app specifically for England, but is useful for local travel in the country.
Popular and high quality.)
British Airways → Excellent (This is not an app specifically for England, but is useful for local travel in the country. Popular and
high quality.)
TrainPal: UK& EU train tickets → Excellent (This is an app for purchasing railway tickets in UK and EU. Relevant and high quality
but less popular.)
London Travel Guide → Good (This is a travel guide but only for London and thus can only partially satisfy the intent. Good quality.)
Business Traveller (UK) → Acceptable (This is a magazine for the corporate traveller in UK. Very specific and can only satisfy a
secondary intent.)
French Travel Phrases & Words → Off-Topic (This is an app relevant for travel to France not UK.)

Complex queries asking for additional knowledge

Some complex queries will require you to check specific sources on the web to figure out what is intended. For example, the query
[apps that won apple design award for innovation in 2024] will require you to search for the app that won the Apple Design Award
for Innovation in 2024. By searching 'apple design awards 2024' on a reliable search engine like Google, you can find the winners
of those awards for that particular year. Procreate Dreams was the Innovation winner for 2024 and would be the correct result.

Query: [apps that won apple design award for innovation in 2024]

Results:

https://baseline.apple.com/training/evaluations/3/guidelines 14/29
2/23/25, 10:45 AM Guidelines for Search - App Store Training — BaseLine
Procreate Dreams → Perfect (This is the app that won the Apple Design Award for Innovation in 2024 and would be the intended
app.)
Lost in Play → Good (This app did not win the mentioned award, but was a finalist for that award in the same year. Satisfies a
secondary intent.)
ToonSquid → Off-Topic (This app did not win the mentioned award. Would not satisfy the intent.)
Canva: Design, Art & AI Editor → Off-Topic (This app did not win the mentioned award. Would not satisfy the query intent.)

Complex queries asking for 'highest rated', 'most reviewed,' 'most', etc.

Some complex queries will ask for superlative results and will contain words like 'highest rated', 'most reviewed,' 'most positive
reviews', 'most', 'best', etc.

The query [highest-rated free music streaming app] for example is asking for a free music streaming app with the highest rating. In
this case, you can refer to the ranking on the App Store Preview page of a result to know if it is a highly rated app, and in this case,
the highest rated free music streaming app. Spotify - Music and Podcasts is currently the highest-rated free music streaming app in
the App Store:

Spotify

Query: [highest-rated free music streaming app]

Results:
Spotify - Music and Podcasts → Perfect (This is a free music streaming app that is rated #1 in Music.)
Musi - Simple Music Streaming → Excellent (Although this is a highly popular music streaming app with a free service, it is rated
#5 in Music.)
Amazon Music: Songs & Podcasts → Excellent (Although this is a highly popular music streaming app with a free service, it is
rated #4 in Music.)
YouTube Music → Excellent (Although this is a highly popular music streaming app with a free service, it is rated #2 in Music.)
YouTube: Watch, Listen, Stream → Acceptable (This app can be used to stream music, but is is primarily used for streaming
videos.)
Groovepad - Music & Beat Maker → Off-Topic (This is a music maker app. Not relevant to the query.)

Query: [coffee brew guide app with greatest number of methods]

**(‘greatest’ would be considered superlative. In this example, it is unclear as to what app has the greatest number of brewing
methods.)

Results:
The Great Coffee App → Excellent (Result is an app with coffee brewing guide, but may not have the greatest number of brewing
methods.)
The App Barista → Excellent (Result is an app with coffee brewing guide, but may not have the greatest number of brewing
methods.)
Acaia Coffee → Good (Result is an app with coffee brewing guide, but can only be used with the Acaia coffee scale machine.)
Nespresso → Acceptable (This app does not have a brewing guide, but does have a recipes function that may satisfy a secondary
intent.)
ChatGPT → Off-Topic (Not relevant to the query.)

Complex queries asking for apps without ads

https://baseline.apple.com/training/evaluations/3/guidelines 15/29
2/23/25, 10:45 AM Guidelines for Search - App Store Training — BaseLine
Some queries may ask for apps without ads. For queries like [hidden object games with no ads], only popular and high quality
games with no ads can get a rating or Perfect. Please note that the app must specifically say in the title or description that it is ads
free in order to be considered for a rating of Perfect.

On the other hand, a popular and high quality hidden object game result that does have ads but offers an in-app purchase to
remove the ads, can satisfy a secondary intent and get Good.

You can check if the app has an in-app purchase by going to the result's App Store Preview. In the Information section at the
bottom, there will be an In-App Purchases section listing the in-app purchases for that app. In the screenshot below, you can see
the in-app purchases for the app Hidden Objects - Find It Out:

image-7.png •190 KB
Query: [hidden object games with no ads]

Results:
Sherlock・Hidden Object・Match 3 → Good (The app is popular and of high quality and has hidden object aspects, but it is also a
match 3 game so it only partially fulfils the user's intent.)
Hidden Objects - Find It Out → Good (The app a popular and high quality hidden object game, but according to the reviews it does
have ads. There is an add-on to remove ads however, so it can satisfy a secondar intent.)
Hidden my game by mom → Off-Topic (The app is an escape room game, not a hidden object game.)

Complex queries asking for specific stars or ratings

Some queries may ask for apps with a specific number of stars or ratings. For example, for the query [calculators with 4 stars or
more], only high quality and popular calculator apps with 4 or more stars can get a rating of Perfect. Any high quality calculator
apps that have less than 4 stars can receive a rating of Good, as these would only partially satisfy the query intent.

Query: [calculators with 4 stars or more]

Result:
Calculator₊ → Perfect (This is a popular calculator with 4.7 ratings which satisfies the intent.)
Calculator → Good (A good quality calculator app but with below 4 stars (3.1 stars). Only partially satisfying the intent.)
Gauth: AI Study Companion → Off-Topic (This not a calculator app. Does not satisfy the intent.)

Complex queries for apps by specific developers

https://baseline.apple.com/training/evaluations/3/guidelines 16/29
2/23/25, 10:45 AM Guidelines for Search - App Store Training — BaseLine
Query: [books apps developed by kobo]
Results:
Kobo Books → Perfect (This is a book app by the intended developer Rakuten Kobo Inc.)
Barnes & Noble NOOK → Good (This is a popular book app, but not by the intended developer. Partially satisfies the intent.)
Rakuten Kobo Inc. (Developer Card) → Good (User's primary intent is for apps by the developer. Developer card would satisfy a
secondary intent.)
Books Reading & Library BookVa → Acceptable (This is a less popular book app, but not by the intended developer.)

Query: [entertainment apps from amazon]

Results:
Amazon Fire TV → Perfect (This is an entertainment app by the intended Amazon developer AMZN Mobile LLC.)
Amazon Prime Video → Perfect (This is an entertainment app by the intended Amazon developer AMZN Mobile LLC.)
Paramount+ → Good (This is a popular entertainment app by another developer. Partially satisfies the intent.)
AMZN Mobile LLC → Good (User's primary intent is for apps by the developer. Developer card would satisfy a secondary intent.)
Amazon Shopping → Acceptable (This is not an entertainment app, but it is an app by the intended developer.)

Other complex query examples

Query: [top podcasting apps this year]

Results:
Spotify for Podcasters → Perfect (This is currently popular and good quality podcasting app. Satisfies the query intent.)
Podcastle: Podcast Recordings → Excellent (This is currently a good quality podcasting app, but is less popular.)
Spotify - Music and Podcasts → Good (This is a podcast player app, but does not have podcasting (podcast creation) functions.
This app would satisfy a secondary intent.)

Query: [best christmas countdown apps]

Results:
Christmas Countdown! → Perfect (This is a popular and good quality Christmas countdown app, satisfying primary intent.)
Christmas Countdown - 2020 → Excellent (This is a good quality Christmas countdown app, but is less popular.)
Countdown → Good (This is a countdown app but it is very generic and not specific to Christmas, satisfying secondary intent.)

Query: [apps for you can edit free]

Results:
InShot - Video Editor → Perfect (The app is a popular, high quality video editing app that is free to download.)
Bot3D Editor - 3D Anime Editor → Good (The app is popular and of high quality, but it is too specific as it is for 3D anime editing.)
Pixelmator → Acceptable (The app is a popular, high quality image editing app but it is not free. The user is clearly looking for a
free app, so this only partially fulfils the user's intent.)

Query: [games for kids that are 6 years old]

Results:
Pocket Champs PVP Racing Games → Perfect (This game is for ages 4+. Does satisfy the 'games for kids who are 6 years old'
intent.)
Baby games for 2,3,4 year olds → Acceptable (This game is for kids but made for Ages 0–5.)
Sonic Mania Plus - NETFLIX → Off-Topic (The age rating is for 9+ on this game.)

Query: [dating apps for adults over 60]

Results:
SilverSingles: Mature Dating → Perfect (This is a high quality dating app for adults over 60.)
Bumble Dating App: Meet & Date → Excellent (This is a high quality and popular dating app which adults over 60 can use too, but
does require to set an age filter.)
Holy — Christian Dating App → Good (Dating app which adults over 60 can use but it is specificly for Christian dating.)

Query: [best calendar apps for working professionals]

Results:
Google Calendar: Get Organized → Perfect (This app has features such as video conferencing and is part of Google Workspace.
This app is popular and of good quality.)
Simple Calendar - SimpleCal → Good (This app is a simple calendar app and lacks features for working professionals. It could be
used by working professionals but would satisfy a secondary intent.)
WorkTime: Shift Work Calendar → Good (This app is a shift work calendar app. It would slightly specific since it is only for a subset

https://baseline.apple.com/training/evaluations/3/guidelines 17/29
2/23/25, 10:45 AM Guidelines for Search - App Store Training — BaseLine
of working professionals who do shift work, so it should be rated as Good.)
My Study Life - School Planner → Acceptable (The app is a calendar and planner app but for students, so it poorly fulfills the
user's intent.)
MinimaList: To Do List &Widget → Off-Topic (The app is a to do list with no calendar functionality, so it should be rated as off-
topic.)

Query: [game to help you fall asleep]

Results:
Pokémon Sleep → Perfect (This app is a high quality and popular game that encourages users to sleep and allows users to
monitor their sleep.)
Sleepagotchi - Sleep Game → Perfect (This app is a high quality game that encourages users to sleep and allows users to monitor
their sleep.)
Relaxing Games by StressBall+ → Good (This app is to relieve stress and anxiety and contains relaxing games which could be
beneficial for sleeping as well. This game could satisfy a secondary intent.)
Shleepy Story: Nighty Night! → Good (This app is a popular and high quality game that helps children go to bed. Since it's for kids,
it is slightly specific and should be rated as Good.)
Coming to Bed → Off-Topic (This app is a runner game where the aim is to help the character get to bed. It is not relevant in
helping the user fall asleep, so it should be rated as Off-topic.)

Query: [3d rpg action games]

Results:
Dragon Champions: War RPG Game → Perfect (This app is a 3-D, RPG, action game that is popular and high quality.)
Otherworld Legends → Good (Although this is an RPG action game, it is 2D.)
Levelup RPG 2D → Acceptable (Although this is an RPG game, it is 2D and not considered and action game.)
Fun Race 3D — Run & Parkour → Off-Topic (This is a 3D game, but is not an RPG game or an Action game which are the 2
genres specifically queried for.)

Vision App Store Tasks

Apple Vision Pro

Vision App Store eval will include apps that are Native to Vision Pro (apps made for Vision Pro). These apps will be clear to identify
by the developer screenshots on the BaseLine task page:

Vision Pro Native apps will have screenshots showing the Vision Pro UI

Because of Vision Pro's recent release (February 2nd, 2024), many Vision Pro Native apps will have little to no ratings or reviews.
In order to rate these apps more fairly, we do not want to rate these apps based on popularity. For App Navigational, Developer
Navigational, and Functional queries, We want to judge Vision Pro Native app results strictly on the relevance the query has to the
app.

Rating Vision Pro Apps for Functional Queries

When rating Functional query results, Vision Pro Native apps that satisfy the query intent will be eligible for a rating of Perfect
https://baseline.apple.com/training/evaluations/3/guidelines 18/29
2/23/25, 10:45 AM Guidelines for Search - App Store Training — BaseLine
regardless of popularity. For example, if the query is [weather], the app CARROT Weather: Alerts & Radar would satisfy the query
intent and could receive a rating of Perfect. The BaseLine screenshots confirm that this result is a Vision Pro Native weather app:

BaseLine UI Vision App Store task example

Functional Query example ratings:

Query: [games]
Super Fruit Ninja → Perfect. This is a Native Vision Pro game in Apple Arcade. For Vision Pro native apps, we are only rating
based on relevance to the query. This app satisfies a primary intent.
What The Golf? → Perfect. This is another Native Vision Pro game. This app satisfies a primary intent.

All other apps that are not Native to Vision Pro can be rated using the guidance under the Query Type sections above. The only
change is the addition of Vision Pro Native apps and how we rate them, detailed in this section.

Apple Arcade

Apple Arcade is a game subscription service launched in September 2019, featuring carefully curated games with no ads and no in-
app purchases.
If the query intent is for one of these Apple Arcade games, all returned Arcade games are at least of Acceptable relevance.

Rating example:

Query: [speed demons]

Speed Demons (App Navigational) → Perfect - Speed Demons by Radiangames is a Highway Racing & Crashing game available
on Apple Arcade.
Radiangames (Developer Card) → Excellent
[Super Impossible Road] by Rogue Games, a futuristic, high-speed racing game where players master hairpin turns on courses
that twist and coil over beautiful galactic backdrops. This is another Apple Arcade game, somewhat similar to the intended game. →
Good
Hot Lava (an Apple Arcade game, but different from the intended game Speed Demons) → Acceptable

Apple Arcade games have a banner at the top of the App Store Preview page like seen in the screenshot below:

https://baseline.apple.com/training/evaluations/3/guidelines 19/29
2/23/25, 10:45 AM Guidelines for Search - App Store Training — BaseLine

SS6.png •453 KB

Common Points of Confusion

Note:
Queries in all languages are valid, and results should be rated based on relevance. Please refer to query examples [ATH Móvil],
[ücretsiz oyunlar], and [libros] later in this document.

Very Ambiguous Queries

You might run into situations where the query may simply be a punctuation mark or a symbol , like [..] or [,]. The intent for these
queries is very unclear and not likely to match a result. In the screenshot below, [..] is returning the app Roblox. There is no
keyword match in the app title, developer name, app description, etc.:

https://baseline.apple.com/training/evaluations/3/guidelines 20/29
2/23/25, 10:45 AM Guidelines for Search - App Store Training — BaseLine

Screenshot 2023-08-08 at 10.27.14 AM.png •236 KB

There is no clear connection between the query and the app. There could be a partial match somewhere, but not readily apparent.
If you run into cases like this, please make sure to rate the result as Unacceptable: Off Topic.

Disagreement with the Query Type

In situations where you disagree with the query's classification (query type) and believe it better aligns with another classification,
you should rate the content relevancy based on the proper classification. Explain your disagreement and provide additional context
in the comment section.

Researching Query Intent:

We expect you to use search engines such as Bing, Google, etc. to help you understand the intent of each query. When forming a
web search query it helps to narrow down intent by adding terms like "iphone" or "app store" to the query you're researching, e.g.
['query' iphone] or ['query' app store].

Primary and Secondary intent

The primary intent of a query is the most likely intent, i.e. the intent of most users who enter that query on the App Store.
A secondary intent, on the other hand, is less likely, or would be a less popular intent compared to a primary one. A secondary
intent could be:

The less likely intent of a query such as [amazon]: the primary intent here is the Amazon marketplace app, along with other apps
by AMZN Mobile LLC, and a secondary intent would be apps about the Amazon rainforest.
An app with a more restricted functionality than the primary intent. For example, for queries like [news] and [weather], the primary
intent is apps with nationwide news and weather content, while regional news and weather apps would be considered secondary
intent.
Intents that are complimentary to the primary intent. For queries requesting a specific app such as [razzle], [minecraft],
[facebook], etc., a common secondary intent are apps for cheats, wallpaper, emoticons, etc.

Spell Correction
Some queries are misspelled by our users. When this is the case, assume the query intent is for the correctly spelled query. If the
query is [mincraft], the user likely means [minecraft]. Use your best judgement.

https://baseline.apple.com/training/evaluations/3/guidelines 21/29
2/23/25, 10:45 AM Guidelines for Search - App Store Training — BaseLine

SS7.png •557 KB

Queries with multiple likely intents

Some queries will have more than one likely primary intent, eg. the query [budget] on the App Store is equally likely to mean the
app for the car rental company, or budgeting apps. Similarly, a query can have multiple secondary intents.

SS8.png •267 KB

https://baseline.apple.com/training/evaluations/3/guidelines 22/29
2/23/25, 10:45 AM Guidelines for Search - App Store Training — BaseLine
Adult Content
All adult or pornographic content is Unacceptable: Off-Topic for non-adult and non-porn queries. For example, any adult or porn
content is Unacceptable: Off-Topic for the query [free], or [games] because the user has not expressly indicated that they want
content of this type. On the other hand, if the query is [erotica] or [porn], any adult or porn content is relevant.

Problem: Other
A problem or technical issue with the task in BaseLine that makes it impossible to judge relevance. Please notify your Support team
immediately of such cases.

ss9.png •20.8 KB

Problem: Other rating should not be used if the content is unavailable in App Store but it is still possible to determine relevance
between input and output based on the information provided in BaseLine, and by completing a side search on Google and/or on
other platforms such as App Annie.

Foreign Language
If the query is in foreign language for the market the results recalled shall be in the language of the query, language of the market,
or in English. If the app recalled is an exact it shall be rated regardless of its language.

Functional queries

Query: [libros]
Consider the above query example in the US App Store. According to Google Translate the query is in Spanish and the intent is for
"books". This is another functional query for which we should be returning apps related to books in either the language of the query
(Spanish), or the market (English). Any other book app that is not in Spanish or English should be rated Unacceptable: Off Topic.
Please reference the functional query type section above for further relevance rating guidance.
Example Results:
Amazon Kindle → Perfect. This app is in the language of the market. It is popular and clearly satisfies the intent.
El Libro Total → Excellent. This app is in the language of the query and satisfies the intent but is less popular.
Gleeph - gestion bibliothèque → Unacceptable: Off Topic. This app is in French.

Query: [ücretsiz oyunlar]

The above query is a German App Store example. According to Google Translate the query is in Turkish and the intent is for "free
games". This is a functional query for which we should be returning free games in either the language of the query (Turkish), market
(German), or in English (OK for all markets). Any other game app that is not in Turkish, German, or English should be rated
Unacceptable: Off Topic. Please reference the functional query type section above for further relevance rating guidance.
Example Results:
Candy Jelibon Şeker Bahçesi → Excellent. This app is in the language of the query. Satisfies the intent but is less popular.
Dumb Ways to Die → Perfect. This app is in English. It satisfies the query intent and is popular.
Brain Test: Knifflige Rätsel → Perfect. This app is in the language of the market (German). It satisfies the query intent and is
popular

App Navigational queries

Query: [ATH Móvil]

According to Google the above query is in Spanish and the intent is for "ATH mobile", which allows the user to transfer money to
another person, even if they do not belong to the same bank. This is an App Navigational query, and the requested app ATH Móvil
should be rated Perfect. Other finance/money transferring apps should be rated based on relevancy, quality, and recency.
ATH Móvil→ Perfect.

Query: [beauty plus]

https://baseline.apple.com/training/evaluations/3/guidelines 23/29
2/23/25, 10:45 AM Guidelines for Search - App Store Training — BaseLine
The query is in English, and the intended app BeautyPlus by Meitu Technology, Inc. will be rated Perfect.
An app titled Beauty Plus + Beauty Plus (not available any more) by WORKING EVOLUTION SRL would receive Acceptable for
keyword matching the query, even if the app itself is in Hebrew Italian. This app is unlikely to satisfy user intent, but it is a slightly
relevant keyword match.

Unacceptable: Spam
Unacceptable: Spam: A piece of content that contains obvious keyword spam and/or misleading description or screenshots. This
also includes a huge chunk of keywords in the Developer Name (Example below) and where the screenshot and description do not
match the app’s title.
Please see below example of obvious keyword spamming in the app title.

https://baseline.apple.com/training/evaluations/3/guidelines 24/29
2/23/25, 10:45 AM Guidelines for Search - App Store Training — BaseLine

ss10.png •989 KB
Example 2: a long list of keyword in the developer’s name

https://baseline.apple.com/training/evaluations/3/guidelines 25/29
2/23/25, 10:45 AM Guidelines for Search - App Store Training — BaseLine

ss11.png •1.31 MB

Example 3: The screenshot and description do not match the app’s title

https://baseline.apple.com/training/evaluations/3/guidelines 26/29
2/23/25, 10:45 AM Guidelines for Search - App Store Training — BaseLine

ss12.png •1.17 MB
Example 4:

Common Misunderstandings
If a result contains a keyword matching to the query, it does not always mean it is Unacceptable: Spam. Please see below
example of common misunderstanding. For this case, the result contain keyword matching in the description but the screenshots
and description are relevant to the app’s title. The app’s quality is also valid and may satisfy secondary intent of the user. Therefore,
these are not considered as spam.

https://baseline.apple.com/training/evaluations/3/guidelines 27/29
2/23/25, 10:45 AM Guidelines for Search - App Store Training — BaseLine

ss13.png •1.67 MB

https://baseline.apple.com/training/evaluations/3/guidelines 28/29
2/23/25, 10:45 AM Guidelines for Search - App Store Training — BaseLine

ss14.png •947 KB

Copyright © 2025 Apple Inc. All rights reserved. Apple Confidential.

https://baseline.apple.com/training/evaluations/3/guidelines 29/29