You are currently viewing How to be a Search Engine Evaluator in 2020

How to be a Search Engine Evaluator in 2020

This post may contain affiliate links, which means we may receive a commission, at no extra cost to you, if you make a purchase through a link. Please see our full affiliate disclosure for further information.


Updated 19th Jan 2020

In the previous post I discussed how you can be a Search Engine Evaluator making over $13 per hour if you’re based in US or other European countries. 

And if you’re based in India or other developing countries, you could still make $7 an hour, which is much better than working night shifts in an MNC in Gurgaon or Bangalore.

If you had already sign up with Leapforce, you are already half way through. If you haven’t yet, sign up below –


If you click on the link above, you will be taken to the website of  Appen Connect  and there would be an option to select your country and language. It should look like this –

Appen Search Engine/ Social Media Evaluator

Select your country and language.  And proceed accordingly.

You will be required to submit a professional CV and once selected, an ID card of your country of residence has to be submitted as well. If you’re an Indian, you’ll have to submit a copy of your PAN Card.

Once you have applied for any available position in Leapforce, they will send you a study material. Now since there are various projects available for different countries, the study material may vary depending on the project available and what you’ve applied for.

I’m going to discuss about the position of Search Engine Evaluator here as it is the most available project across various countries, and the best project of Leapforce.


Before you apply for a position to be a Search Engine Evaluator, make sure that you satisfy the following conditions –

  • Be a highly active user of Google’s Search Engine and other products.
  • Have a Gmail account with web history turned on.
  • Use Google Play at least once per week.
  • Use Google+ more than once a month.
  • Have a Payoneer account to get paid by them. Earlier they used to pay via Western Union, now they pay via Payoneer. Sign up here and get $25 bonus as soon as you are paid $1000 by Appen.


N.B. Search Engine Evaluation position is no longer available in Leapforce for US citizens. It has moved to a completely new platform called Raterlabs which is managed by current employees of Appen. Social media evaluation for Americans is still there in Leapforce though. And as of December 2017, Leapforce has itself being acquired by Appen.


Once you have applied for a position to be a Search Engine Evaluator, you will be provided with a study material. The study material is a 179 page PDF file which is all that you need to crack this exam. The concepts discussed here may be a bit intimidating to people who aren’t so familiar with Google Searches and doesn’t have a little bit of knowledge of internet, but other than that it is nothing technical that requires mathematical or programming skills.

Once you receive the study material, you will have seven days to study it, and your exam will take place after a week over the next seven days. Hence the qualification process can take about fourteen days. The best part is that results are instantaneously known except for the last part of the exam.

Remember, exams are scheduled according to Pacific Standard Time (PST). So those of you who aren’t US citizens, be careful to plan according to PST.

Search Engine Evaluator Exam Duration

You have seven days to finish the exam. You don’t have to sit down and finish the exam at one go though. Moreover, there are three components of exam which we will discuss in depth later.


There are three components of it –

  • A theoretical component.
  • Practical component taken in desktop or laptop.
  • Practical component that requires a smartphone.

The theoretical component of the exam consists of questions which are based on the study material provided by Leapforce. Many people find it easy to pass the first part while some can’t even go through the first part. For some, it is the easiest part of the exam, while others find it extremely hard to understand the concepts discussed in the guidelines, let alone appear for the exams.

Once you have cracked the first part of the exam, you will have to pass the practical component of the exam. The first part of the practical component of the exam is the application of the concepts and theories discussed in the first part of the study material.

The third part of the exam is a practical component that requires one to have a smartphone with Android or iOS. Windows phones aren’t supported. Now this may sound a bit intimidating to you, but trust me it is not. The instructions that you will receive are awesome and makes appearing for exam a breeze. But make no mistake in assuming that the exam itself is easy. It ain’t!


Simple ! Work your butt off  for a week ! That’s it.

Some people complain that Leapforce doesn’t pay one during study or exam preparation. Are you serious bro? Hell, what about the three years that you spent in a college that did’t or couldn’t guarantee a job after you’re done with it? What about the loan that you took to get a degree that has no relevance to the reality of life?

You don’t need student loan to get study materials here. It’s for free unlike your college degree.

You might wanna study each day for at least two hours so that you can refresh your concepts right before your exam. Once your exam starts, you can always refer back to the PDF material that you get from them.

Even during the first part of the exam, you can refer back to the PDF guidelines. The best part is, it is an open book exam.

Here is an ultimate guide on how to crack this exam.


Absolutely ! Hey I failed on my first attempt. The last part of the exam got me. I thought I had it, but turned out I couldn’t make it on my first attempt.

If you don’t study the study material i.e. the 160 page PDF guidelines, you are sure to fail. 100% guaranteed. That’s the reason why Leapforce says at the very beginning that this is a tough exam. It ain’t easy. And trust me it isn’t.

However, if you study it thoroughly and religiously for at least a week, nothing can stop you from cracking this exam.

But the reality is, some people are’t cut for this job. No matter how many times they try, they can’t just make it. And that’s the reality of this exam.


You may be given a one time chance to retake the exam.

Good Luck with your exam. I am excited to hear back from you. If you have any questions, please comment below.

P.S. Don’t ask me answers for questions of any part of the exam. I won’t give that out. That’s called cheating and cheating only cheats you.

Go be a Search Engine Evaluator today. Sign up below and start earning

Appen Connect


Anywhere from $300 – $3800+ per month.

I made over $2007 in Oct 2018 although, we Indians are just paid $7 per hour. If I were an American or European, I would have made over $3800 as they are paid $13 per hour approximately.

Here is how I made $2007 ($3800) in a single month. Read it here

Update 3rd Dec 2018 – The current pay rate after Leapforce’s acquisition by Appen has been reduced for all countries. For Indians, they pay $3/hr now and for Americans they pay like $9 – 13/hr, depending on where you live.


Search Engine Evaluator Course qualification is a tough tough one. Hardly 1 out of every 100 applicants gets through it. The minimum passing score required is 87%.

Since I have been working as a Search Engine Evaluator since June December 2016 ( you can read my earliest blog posts from December 2016 right here, if you don’t believe me. Check out the date the post was published), I have an authority and expertise at this field.

I have been working on a course for almost 2 months now. Its finally complete and I can guarantee that it is the best search engine evaluator training  course our there.

I didn’t start a course, out of the blue claiming, that I have been working as an evaluator for over 2 years now. Everyone knows that I have been working as one since June 2016. As soon as you check the archives of my website, you would know what I mean.

You will be tremendously benefited by my experience. You would greatly benefit by getting a direct access to me.

So check out the course below and sign up today.

Appen/Leapforce, Lionbridge and Raterlabs are hiring now! Don’t miss this opportunity.

Check this out


After making almost $3000 online, I started this blog to document my own journey as a search engine evaluator aka Google rater, bug hunter, website usability tester, and blogger. Now I teach others how to make money online through genuine work from home opportunities. I've been featured in Huffington Post among others. You can read more about my personal struggles and successes in making money online here.

This Post Has 160 Comments

  1. Sandeep Rawat

    Hi Sam,
    Sam I’ve just got a confirmation for my exam in appen but before that they asked me some details and filled it now they sent some documents to sign it and term and condition. Should It be safe to sign term and condition ?

    1. Sam Narzary

      As long as it is coming from official email/website, it is safe. They are legit companies. Just don’t fall for scams that some Indians are running. They asked for credit card details, bank details and other personal details. Hum Indians ka badnaam kar diya inlog no.

  2. Rashid

    I can work full time job at lionbridge. approimately 7 or 8 hours. this is possible.
    you send me reply on my email id.

    1. Sam Narzary

      No. Limited to 20 hours a week. You may get some bonus hours sometimes though.

  3. Akhil

    I’m at undergraduate level.Can I apply for it ?
    Can u explain about working hours?

    1. Sam Narzary

      You may apply.

      First month, limited to 2 hours. If you meet their quality, you get unrestricted – meaning you can work as long as you want. Maintaining quality is the key.

  4. Lennox

    Hello Sam,
    Can I do this from Ghana and how much will I be paid per hour? Please advice and recommend any other job I can do because I’m planning to quit my job as telecom field technician as it’s becoming too stressful.
    Thank you.

    1. Sam Narzary

      Keep checking out the companies that hires search engine evaluators. –

      I am not too sure about pay rates there because these companies don’t mention pay rates in their websites. It’s only when we work that we know, and I don’t know any one from Ghana. About quitting your job, I wouldn’t recommend it unless you are absolutely confident that you can work as an independent contractor.

  5. Anonyno

    do you offer arrow project qualification course?

  6. abzzy

    Hi sam, do you have any idea about “Crescent” project from Appen, on my qualifications panel I saw this new project but didn’t apply as the description is inadequate and given rate is low or something like that and it is for Microsoft I think, as it asks for’ live-Id’ to qualify. Also did you qualify for “Inari” project.

    1. Sam Narzary

      I feel like crescent project is not worth it. I have no idea what that is. Seems like it is a Microsoft project.

      I am also seeing these projects in my all projects tab. I have Crescent, Inari-C, Inari-UC.
      I haven’t applied to any one of these.
      I am only with Yukon – search engine evaluator, and I like it that way.

  7. shravi

    is it really safe to work with appen for a teenager?

  8. Claire

    Hi Sam, I was recently offered to qualify for some projects at Appen. When I received the email, I was in the airport, and registered my IP address there. I thought that the IP address was just to check I was within the country I had applied for however now I am reading that changing your IP address when you qualify for projects will deem you ineligible. Is there any way I can rectify this? Thanks.

    1. Sam Narzary

      Well, no two persons can work from the same IP address. Since you applied from home and you only checked the projects in the airport ( which I suppose was within your country), it shouldn’t be a problem.

  9. Tracy

    Hello! I was wondering if there are limits for maximum working hours allowed at Leapforce (now Appen) per week? Thanks!

    1. Sam Narzary

      Hi Tracy, there are no limits as such. It depends on the project that you work for. If the project has a weekly or a hourly cap, then there are limits ese there are none. Like for search engine evaluator position, Brazilians are limited to 20 hours per week, while Americans who are hired via Raterlabs(another sister company of Leapforce, now Appen’s) as part-time employees are limited to 20-26 hours per week.

      People from other parts of the world got no limits.

      1. Tracy

        Hi Sam, thank you for the fast reply! I have applied on both Lionbridge and Appen to increase my chance of being accepted. However, both of them accepted me (Lionbridge with $8.82/h and Appen with $5/h). I was trying to decide which one to choose from considering Lionbridge only allows 20h/week and Appen has no limit, and I chose Appen. However, I do not see any qualification exam after I was accepted. They gave me three projects to choose from and I have to qualify for my first project before they can do the final paperwork. Is this where you take the 3 parts exam ( 1 theoritical and 2 practical exams)?

        One last question, do they ever run out of work in your experience?

        Thank you so much for replying. I’m glad I can ask someone who is experienced in this!

        1. Sam Narzary

          Hi, if you got the internet analyst or internet safety analyst position with Lionbridge, go with them. That is their jargon for search engine evaluator position.

          What all positions did you get with Appen? Does it include a project called Yukon? Yukon is the term for search engine evaluation position. That three part qualification test is only for Yukon project aka search engine evaluator job. Other projects got different qualification test.

          Appen has been not so good in project allocation and work.

          I would recommend you to go with Lionbridge if they are offering you search engine evaluation.

          1. Tracy


            I got Internet Assessor position with Lionbridge, not sure if it’s the same one.

            And no, I did not get any project called Yukon on Appen. Three of the projects are called Arrow, Zeya and Truckee.

          2. Sam Narzary

            So you didn’t get search engine evaluator position with Appen which is understandable.

            Internet assessor should be the search engine evaluator position. You might have got the job description email right like what the job entails.

            Could you email me a screenshot of the job description here at That way I can confirm that it is the right opening.

        2. Sam Narzary

          And yes, we do run out of work some times. Sometimes we don’t even get like 2 hours work per day. But that being said, one can easily average 40 hours per week.

          And I am guessing you are American right? If you are, you should sign up with Raterlabs. Raterlabs is a sister company of Leapforce created exclusively for Americans. Here is the link to sign up –
          It has also been acquired by Appen.
          Americans can work as a search engine evaluator at Raterlabs and not in Appen. In Appen, you will get all sorts of projects but not search engine evaluator project.

          If you are offered search engine evaluator position with Lionbridge, go with them, else apply to Raterlabs, where you would be hired as a part time employee with a fixed weekly requirement of 20 hours (max 26).

          1. Tracy

            No, I am actually from Indonesia so Raterlabs is not really for me.

            Do you think Lionbridge is better in this case? I heard Lionbridge only allows 20h/week maximum. And also the first salary took forever

          2. Sam Narzary

            Okay. It is mostly 20 hours per week. But sometimes you get extra bonus hours like 10 hours. Lionbridge pays under NET45 terms. So your first payment will take like 45 days after invoice submission and approval.

            I am worried about the fact that you didn’t get Yukon project with Appen. Most of the projects you mentioned aren’t long term.

            And yes that internet assessor position is the search engine evaluator position.

            If you would ask for my honest opinion, I would recommend you go with Lionbrige since you aren’t offered Yukon project. But do make your own decision. t is your call.

          3. Lennox

            Can I do this work from Ghana?

  10. Josh josh

    Hello Sam, I am from Zambia, can I do this work from my country?

  11. Josh

    Hello Sam,
    I am from Zambia, can I do this work from my country?

    1. Sam Narzary

      Unfortunately Zambia is not an eligible country for this work.

  12. karan mishra

    hi sam my English is little weak ,can I pass these exam

    1. Sam Narzary

      Yes you can. You can also apply for Hindi language positions.

  13. ASHISHKumar

    I am from Bangladesh.
    Can I do this work from my home?

    1. Sam Narzary

      No..unfortunately Bangladesh is not one of those countries where they hire agents from.

  14. Dharmendra Singh

    Hello Sam,
    Thanks to you to bring this in my mind,
    I have applied for leapforceathome, and after i got a mail. Can you please tell me that when my exam will be done?

    1. Sam Narzary

      You will be notified by an email about the exam.

  15. Diane

    Hi Sam, I am in the U.S. and applied through Appen but was then turned over to Raterlabs for the qualification exam (confusing). I failed the third part of the exam but am finding your insight to be most helpful as I prepare to retake it. Wish I’d found you before I’d taken it the first time 🙂 The starting pay rate, however, is much lower than the $12 – $14 that I commonly see claimed as the hourly rate for search engine evaluators. Wonder did the pay rates decrease when Leapforce was acquired by Appen?

    1. Sam Narzary

      Thank you for the kind words Diane.

      The pay rates have decreased after Appen took over Leapforce. You are right about that. And its actually good that you were turned over to RaterLabs.
      Raterlabs was bifurcated off of Leapforce before its acquisition by Appen. Raterlabs was specially made for Americans for Search Engine Evaluator positions. For social media evaluation positions, where we get to work just 1 hour/day, Americans can work with Leapforce. But it was good that you were turned over to Raterlabs.

      Good Luck with your retake exam. Hope you clear it. And yes the pay rates have been reduced by Appen. You should check out iSoftstone too. They do have openings for Americans at the moment.

Leave a Reply