whoogle-search: [BUG] EU consent enforced, no more pending period

Describe the bug Time to accept the overlords has come. #243 is now useless, there is no more waiting period. If you block js, you are instantly sent to the consent page. Whatever you do, won’t change it. If you have the JS enabled, there is some background worker magic happening, but also a pain to extract. So the only way now, is to set the cookie to something that is generated.

Example url is https://consent.google.de/ml?continue=https://www.google.de/&gl=DE&pc=shp&hl=de&src=1, any change outside continue will error out the consent page. YES+cb.20210509-17-p0.de+F+678 is an example with everything set to no. YES+cb.20210509-17-p0.de+FX+678 is at least one or all parts accepted Can be shortened to YES+1, but probably shouldn’t.

https://github.com/benbusby/whoogle-search/blob/develop/app/request.py#L228 needs to be changed.

¯\(ツ)/¯ It’s only a matter of time untill you have to scan your subdermal chip to be able to search in the future.

To Reproduce Steps to reproduce the behavior:

Be in EU
Use whoogle 2.1. Or deactiavate js, delete cookies and access google
See error

Deployment Method

Heroku (one-click deploy)
Docker
run executable
pip/pipx
Other: [describe setup]

Version of Whoogle Search

Latest build from [source] (i.e. GitHub, Docker Hub, pip, etc)
Version [v0.4.1]
Not sure

Desktop (please complete the following information):

doesn’t matter

Smartphone (please complete the following information):

doesn’t matter

Additional context #243 was a way to circumvent the agreement, but it no longer works.

About this issue

Original URL
State: closed
Created 3 years ago
Reactions: 10
Comments: 34 (6 by maintainers)

Commits related to this issue

[fix] google news - send CONSENT Cookie to not be redirected In the EU there exists a "General Data Protection Regulation" [1] aka GDPR (BTW: very user friendly!) which requires consent to tracking. ... — committed to return42/searxng by return42 3 years ago

Most upvoted comments

sed -i "/'CONSENT':/ s/PENDING+999/YES+cb\.20210514-17-p0\.de+F+678/" /whoogle/app/request.py launched inside the container will replace it and I can confirm that restarting the container fixes the error.

You can probably use docker exec to do something like docker exec -d whoogle_container_name sed -i "/'CONSENT':/ s/PENDING+999/YES+cb\.20210514-17-p0\.de+F+678/" /whoogle/app/request.py (untested)

LivingWithHippos on May 14, 2021

So no workaround?

The fix is in this thread ? Modify line 216 of app/request.py to:

            'CONSENT': 'YES+cb.20210509-17-p0.de+F+678'

Edit: And restart whoogle.

gripped on May 14, 2021

@jeroen7s soon, planning on having a new release out today.

benbusby on May 21, 2021

Wait for it to be merged*

bruvv on May 18, 2021