Throws a 999 Status Error Code for LinkedIn links

[Jarmos-san]

Describe the bug
While checking for broken links, areyouok throws a 999 Error Status code for URLs pointing towards LinkedIn.

EDIT: Just found out, even URLs pointing towards Twitter returns a 404 Not Found Error. Here's an example issue thread for reference.

To Reproduce
Steps to reproduce the behavior:

1. Create an example README.md file with the a link to a LinkedIn profile.
2. Run areyouok against the newly created README.md file (which contains the LinkedIn URL).
3. Check the generated report for a 999 Error Status Code.

Expected behavior
areyouok should've returned a 200 OK Status Code.

Screenshots

Desktop (please complete the following information):

• OS: Ubuntu 20.04
• areyouok version: v1.1.0 built on (26 Jan 2021)

[Bhupesh-V]

Ah, seems like LinkedIn doesn't want us to query user profiles, I tried changing user-agents but doesn't work. What does this gives you as output?

curl -I --url "https://www.linkedin.com/in/jarmos" --header "user-agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.2661.94 Safari/537.36" --header "accept:text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8" --header "accept-encoding:gzip, deflate, sdch, br"

[Jarmos-san]

This is what I got:

HTTP/2 405
cache-control: no-cache, no-store
pragma: no-cache
allow: GET
content-length: 0
expires: Thu, 01 Jan 1970 00:00:00 GMT
set-cookie: JSESSIONID=ajax:3064617640713700621; SameSite=None; Path=/; Domain=.www.linkedin.com; Secure
set-cookie: lang=v=2&lang=en-us; SameSite=None; Path=/; Domain=linkedin.com; Secure
set-cookie: bcookie="v=2&9b488a2f-3f4e-4f4f-8f2e-49a6326440f7"; domain=.linkedin.com; Path=/; Secure; Expires=Sat, 25-May-2024 00:51:35 GMT; SameSite=None
set-cookie: bscookie="v=1&2022052513140383338dd3-9d5e-4566-8c28-cd18d1cb822bAQGvGRF6pEnhLRXRwl_OMb7byjTO-01X"; domain=.www.linkedin.com; Path=/; Secure; Expires=Sat, 25-May-2024 00:51:35 GMT; HttpOnly; SameSite=None
set-cookie: lidc="b=VGST09:s=V:r=V:a=V:p=V:g=2297:u=1:x=1:i=1653484443:t=1653570843:v=2:sig=AQG3IUOdKjkLUfRrjID5fUqA2rOODU8P"; Expires=Thu, 26 May 2022 13:14:03 GMT; domain=.linkedin.com; Path=/; SameSite=None; Secure
x-fs-uuid: 0005dfd5d8e2ad58e3d5b5090143297c
content-security-policy: default-src 'none'; connect-src 'self' *.licdn.com www.linkedin.com www.google-analytics.com https://dpm.demdex.net/id lnkd.demdex.net blob: https://accounts.google.com/gsi/ https://linkedin.sc.omtrdc.net/b/ss/; script-src 'sha256-DwtT8+ZZKpxH9pqZNAmJ3GdbLAh5SsYaXR3omTXPCns=''sha256-sV9jZa797T0QWBzcU/CNd4tpBhTnh+TFdLnfjlitl28=' 'sha256-aa/Q8CRBDSqTQbCIyioPhZaz+G+dbPyu7BzsjInEmiU=' 'sha256-THuVhwbXPeTR0HszASqMOnIyxqEgvGyBwSPBKBF/iMc=' 'sha256-zTIusdVJJeXz9+iox2a+pdDglzbpRpFVRzEwvW4AONk=' 'sha256-iC8MPqNLw0FDnsBf4DlSkFLNTwhkI85aouiAEB819ic=' 'sha256-2EqrEvcPzl8c6/TSGVvaVMEe7lg700MAz/te4/3kTYY=' 'sha256-y5uW69VItKj51mcc7UD9qfptDVUqicZL+bItEpvVNDw=' 'sha256-DatsFGoJ8gFkzzxo47Ou76WZ+3QBPOQHtBu9p9b3DhA=' 'sha256-k95cyM8gFgPziZe5VQ2IvJvBUVyd5zFt2CokIUwqdHE=' 'sha256-PyCXNcEkzRWqbiNr087fizmiBBrq9O6GGD8eV3P09Ik=' 'sha256-2SQ55Erm3CPCb+k03EpNxU9bdV3XL9TnVTriDs7INZ4=' 'sha256-S/KSPe186K/1B0JEjbIXcCdpB97krdzX05S+dHnQjUs=' snap.licdn.com 'sha256-9pXOIwF4N0gPltLd3AI69lkCjSC2H/Eb3sc5zdmUyYU=' 'sha256-jou6v/Nleyzoc+LXktAv1Fp8M807dVVxy7E/yzVljHc=' 'sha256-6E4e/3dSvj/8JZT2S2yR91mspqM6MyOpKl5lrhHsZa8=' platform.linkedin.com platform-akam.linkedin.com platform-ecst.linkedin.com platform-azur.linkedin.com static.licdn.com static-exp1.licdn.com static-exp2.licdn.com static-exp3.licdn.com; img-src data: blob: * android-webview-video-poster:; font-src data: *; style-src 'self' 'unsafe-inline' static.licdn.com static-exp1.licdn.com static-exp2.licdn.com static-exp3.licdn.com; media-src dms.licdn.com *.lynda.com; child-src blob: lnkd-communities: voyager: *; frame-src 'self' https://www.youtube.com/embed/ https://www.youtube-nocookie.com/embed/ lnkd.demdex.net https://smartlock.google.com/ https://accounts.google.com/ linkedin.cdn.qualaroo.com player.vimeo.com www.linkedin.com www.slideshare.net *.megaphone.fm msit.powerbi.com app.powerbi.com linkedin.github.io https://*.licdn.com; frame-ancestors 'self' https://onyx.www.linkedin.com; manifest-src 'self'; report-uri /security/csp?e=p&f=gg
x-frame-options: sameorigin
x-content-type-options: nosniff
strict-transport-security: max-age=31536000
expect-ct: max-age=86400, report-uri="https://www.linkedin.com/platform-telemetry/ct"
x-li-fabric: prod-lva1
x-li-pop: afd-prod-lva1-x
x-li-proto: http/2
x-li-uuid: AAXf1djirVjj1bUJAUMpfA==
x-cache: CONFIG_NOCACHE
x-msedge-ref: Ref A: B0160604595E4D7F8E65044FFF53D704 Ref B: DEL01EDGE0820 Ref C: 2022-05-25T13:14:03Z
date: Wed, 25 May 2022 13:14:02 GMT