How a DesignRush Ranking Is Put Together, and How to Read One

A directory gives you an order, and the order is built from five factors an agency mostly supplies itself. What DesignRush ranks on, why its star ratings are smoothed, what Verified covers, and the five checks to run before a shortlist.

Muhammad Shehryar2026-09-236 min read
Example screens on a tablet and a phone: a made-up brand's dashboard and store, of the kind this work is about

A shortlist usually begins on a directory, and a directory hands you something a review page does not: an order. Ten agencies, numbered, most of them saying the same six adjectives. DesignRush describes itself as "the premier agency directory, awards platform, and media hub", and the ordered list is the thing people act on, usually without asking what put it in that order.

It is worth asking, because the answer is published. What follows is from DesignRush's own category and methodology pages, read on 22 September 2026, and it changes how the list should be used.

The Short Answer

A DesignRush list is two things on one page. Sponsored placements sit at the top and are paid for; DesignRush states that sponsorship buys the position and does not touch star ratings or reviews. Below them is the organic order, built on what DesignRush calls a Base Score, of which it names five parts as the most important: reviews, portfolio, awards and press, team bios, and top services. Four of the five are supplied by the agency on its own profile, so a high organic position reflects a complete, evidenced profile as much as a strong agency.
The star rating beside each name is deliberately smoothed with a Bayesian method, which is why so few agencies show a perfect five, and the category a list belongs to decides who an agency is being compared with. The sections below take each part, then five checks for reading a list before shortlisting from it.
For a buyer, the practical rule is to skip past the sponsored slots, read the organic order as a measure of how complete each profile is, and judge the agencies on their reviews and portfolios rather than their place.

What the Order on a List Actually Is

DesignRush says the ranking is "established on a Base Score consisting of many factors", and names five as the most important: reviews, portfolio, awards and press, team bios, and top services. Four of those five are things an agency puts on its own profile.

That is not a criticism, it is the thing to understand. A high position rewards a complete profile as much as a good one: an agency with its portfolio linked to real work, its team named, its services declared and its reviews collected will sit above an agency that has done the same work and filled in half a page. Read a top position as "this agency has shown its working", not as "this agency is better than the one below it".

There is also a second kind of placement. The category page states that "Sponsored listings pay for a placement that appears above organic positions" and, in the same breath, that "Sponsorship does not affect star ratings or review content". Both halves matter. A paid slot buys the top of the page and nothing else, so the first row on a list may be an advertisement and the rating beside it is still the rating everybody else gets.

Questions to Ask an Agency About Its Profile

Because most of what puts an agency high on a list is what the agency itself supplied, the most useful thing a buyer can do with a profile is ask the agency about it. A good agency answers these easily.
How were the reviews collected? Whether every client was invited to review, or only the ones the agency expected to be happy. Both are common; the answer tells a buyer how representative the reviews are.
Are the reviewers still clients? A glowing review from a client who left a month later says something different from one written after two years together.
Whose work is in the portfolio? Whether the work shown was done by the people who would work on the buyer's account, or by a team that has since moved on.
What was each award for? Some awards judge results, some judge entries the agency paid to submit, some judge the agency's own marketing. The citation says which.
Who are the people named in the team bios, and which of them would I work with? A named team is one of the factors the ranking rewards. It is only useful to a buyer if those people are the ones on the account.
Which declared service is the main business? An agency may list many services. Asking which one makes up most of its work, and how many clients it runs it for, shows whether the buyer's need is the agency's core or a sideline.
Answers that are specific and quick are a good sign. Answers that retreat to the profile's own wording usually mean the profile is doing more work than the agency behind it.

The Star Rating Is Smoothed, on Purpose

The most useful thing on the methodology page is the rating calculation, because it explains a number that otherwise looks wrong. DesignRush says it considers "the overall distribution of ratings for each agency using the Bayesian Statistical Method", which "will prevent skewed or inflated agency scores by adding a 3.5-star rating to all profile reviews as a smoothing baseline factor".

In plain terms: every agency starts with an invisible 3.5 star review attached, and real reviews pull the average away from it. Three perfect reviews cannot produce a 5.0, because the baseline is still in the average. Forty perfect reviews nearly can, because forty outweigh one.

So a 4.7 from a long list of reviews is a stronger signal than a 5.0 from three, and on this platform the 5.0 from three will not even be displayed as a 5.0. If you have been mentally ranking directories by who has the most perfect scores, this is the platform where that habit misleads you least.

What Verified Means Here

DesignRush publishes more of its verification than most directories do. It says reviewers are authorised "through their LinkedIn profile, which ensures authenticity and reliability", that it may "verify reviewers via email or call to complete our legitimacy check", and that reviews "undergo a stringent verification process: evaluating the reviewer and fact-checking any claims made".

A Verified badge on an agency is a separate thing from a verified review. The badge says the DesignRush team has checked the company is what it says it is. It says nothing about whether the company has done your particular job, and no directory badge ever does.

Reading the Reviews Themselves

The rating summarises the reviews. The reviews themselves hold the information a buyer actually needs, and reading a handful properly is worth more than comparing a dozen ratings.
Look for specifics. A useful review names the channel, the size of the business, the length of the engagement and what changed. A review that says only that the team was great and responsive could describe any agency.
Look for a problem and how it was handled. Every long engagement hits something: a suspension, a missed launch, a campaign that did not work. A review describing how the agency dealt with it says more about the relationship than one describing a smooth ride.
Read the critical ones. A lower rated review, and the agency's reply to it if there is one, shows how the agency behaves when a client is unhappy. A calm, specific reply is a good sign; a defensive one is not.
Check the dates. Reviews from several years ago describe the agency as it was. Recent reviews, spread across months rather than bunched into one, describe it as it is.
Notice clusters. Many reviews arriving in a short window usually means the agency ran a drive to collect them. That is legitimate, and it means those reviews come from the clients the agency chose to ask.
Match the reviewer to the buyer. A review from a business like the buyer's, in the same channel and at a similar size, is the one that predicts the buyer's experience. The rest is background.

Category Is the Whole Context, and It Is Easy to Miss

A DesignRush list is always a list of something: a service, and usually a country with it. Our own entry is in the digital marketing category, and that is a broad room. It contains brand agencies, performance agencies, content shops and marketplace operators, ranked against each other as though they competed for the same brief.

They do not. An agency that runs paid social for consumer brands and an agency that runs an Amazon and Walmart operation are both digital marketing agencies and are not substitutes. Before comparing positions on a list, compare the services declared on the profiles: DesignRush's own ranking uses "top services" as a factor, which means an agency has told you, on the record, what it wants to be judged on.

The Five Checks, in Order

One: ignore the first row until you have checked whether it is sponsored, then judge it on the same terms as the rest. Two: open the portfolio links rather than counting them, and look for work in your channel, on your marketplace, at your size. Three: read the review count before the star rating, because the rating is smoothed and the count is what moves it. Four: read the team bios, since the ranking rewards naming people and naming people is what lets you ask who will run your account. Five: leave the directory and ask the agency for something no profile contains, which is what happened on an account that went wrong.

That last one is the whole exercise compressed, and it is the same on every directory. A profile is what an agency chose to publish. The interesting question is what happened afterwards.

From Shortlist to Decision

A directory is a good way to find three or four agencies worth talking to. What turns that shortlist into a decision happens off the directory, and it follows the same steps whichever list the names came from.
One brief, sent to each. Describe the business, the channels, the current numbers and what needs to change, and send the same brief to every agency on the shortlist. Comparable answers need a common question.
Ask how they would start. A good answer describes the first month: what they would look at, what access they need, what they would fix first, and what they would report. A vague answer about strategy and synergy is a warning.
Speak to a current client. Ask each agency for a client in a similar position to talk to, and ask that client what the agency does well and what it does less well.
Meet the people. Speak to the person who would run the account day to day, not only the person selling the service.
Read the contract before choosing. The notice period, who owns the accounts, the data and the creative, what happens to access when the engagement ends, and how fees are calculated. These terms matter most on the day something goes wrong.
Agree how success is judged. The numbers that will be reported, how often, and what result after three or six months would mean the arrangement is working.
The agency that answers all of this plainly is usually the right one, whatever its position was on the list where the search began.

Where We Sit on It

Our own profile is at designrush.com/agency/profile/xcelerate-brands, and everything above applies to reading it: check the services declared, open the work, read the review count, then ask the question the profile cannot answer. We are listed on four other platforms as well, and each rewards a different kind of reading. Clutch is built around project details, Trustpilot around a single score with a distribution under it, GoodFirms around a research methodology, and a Google Business Profile around proximity.

If what you are weighing up is marketplace management across Amazon, Walmart, eBay, TikTok Shop and Shopify, the list is a way to build a shortlist and a poor way to finish one. The full guide to choosing an agency covers the rest of it: the contract, the reporting, the access, and the questions that separate an agency that manages an account from one that reports on it.

Frequently Asked Questions

The questions that come up most often on this subject.

Want This Applied to Your Account?

Tell us the category and the numbers you have. We will review the account and tell you where the opportunity is and what we would change first.