DEM not gonna CON dis NATION: Rolling UK politics in the short-lived post-Murdoch era

Message Bookmarked
Bookmark Removed
Not all messages are displayed: show all messages (6314 of them)

is the robots.txt thing common practice?

Vic Arpeggio, Private Investigator (stevie), Wednesday, 13 November 2013 22:05 (ten years ago) link

yes, it's how the web works, but full marks to computer weekly for making it sound evil per se

caek, Wednesday, 13 November 2013 22:12 (ten years ago) link

http://www.bbc.co.uk/robots.txt
http://www.computerweekly.com/robots.txt

etc. etc.

caek, Wednesday, 13 November 2013 22:12 (ten years ago) link

cool, I didn't actually know that most websites use robots.txt, since so many of them are findable via web.archive.org

Vic Arpeggio, Private Investigator (stevie), Wednesday, 13 November 2013 22:22 (ten years ago) link

you use it to control which pages are findable, generally - though you can make the whole thing unfindable (fsvo 'unfindable'. search engine bots do not actually have to obey the commands of your robots.txt). how i remember the noindex nofollows of my youth.

smize without a face (c sharp major), Wednesday, 13 November 2013 22:35 (ten years ago) link

yeah. not only does robots.txt have absolutely no effect on what can be seen by people: it's can be ignored by the crawlers too. book burning!

caek, Wednesday, 13 November 2013 22:38 (ten years ago) link

no political party has a legal obligation to abide by its election promises

true.

but deleting them is like a kid in a room with their hands over their eyes, thinking they're invisible.

For bodies we are ready to build pyramids (whatever), Wednesday, 13 November 2013 23:12 (ten years ago) link

Story has been barely reported and pretty much forgotten already it seems

Thomas K Amphong (Tom D.), Thursday, 14 November 2013 09:07 (ten years ago) link

Really? Have the newspapers not gone for a tale of a big organisation deleting massive amounts of embarrassing data off their internal systems?

Mark G, Thursday, 14 November 2013 09:12 (ten years ago) link

# hi robots. you look nice today.
User-agent: *
Disallow:

:)

grown-arsed man (onimo), Thursday, 14 November 2013 11:19 (ten years ago) link

from http://ilxor.com/robots.txt

grown-arsed man (onimo), Thursday, 14 November 2013 11:19 (ten years ago) link

i 100% despise these guys and i wouldn't be surprised to the learn it was done for nefarious purposes, but this (removing old stuff from your own website and propagating those changes to search engines using robots.txt so search engines are not full of dead links) is also a totally normal and routine thing for any organization to do

Trimming dead links is good but making a link dead when it contains stuff that should arguably be on public record is nagl and not necessary. "Where are your speeches and press releases from before 2010 that used to be online" "oh we archived them to save space" - bullshit. There may be no legal obligation to keep this stuff but I can't see any reason for removing it other than revisionism.

as a chocolate salesperson (ledge), Thursday, 14 November 2013 15:15 (ten years ago) link

i'm sure revisionism is part of the reason, it's just not "scandalous" in the literal sense so much as the usual cynical beige we expect from career pols

a strident purist when it comes to band-related shirts (Noodle Vague), Thursday, 14 November 2013 15:39 (ten years ago) link

When you've already been on television and in every national newspaper saying these things it's impossible to think you could change history by adding them to your 'disallow' list. Also the stuff is still there, isn't it? It just isn't being indexed (or did I miss the bit were they actually deleted the content?).

It's possible they were thinking "when people search for our policy on X we want them to find the most recent statements rather than the (completely contradictory) things we said years ago" - which is still shady but kind of makes sense and isn't really the same as deleting your promises from the Internet.

grown-arsed man (onimo), Thursday, 14 November 2013 15:40 (ten years ago) link

Maybe if we get more scandalised about the usual cynical beige (bilge? Nah I like it) it will become less usual. Well a man can dream.

as a chocolate salesperson (ledge), Thursday, 14 November 2013 15:42 (ten years ago) link

Labour have just set up a page saying this:

David Cameron’s solution to his cost of living crisis cannot be found

The page you are looking for might have been removed by David Cameron due to its inconvenient (for him) nature, had its name changed by Grant Shapps or is temporarily unavailable.

Please try the following:

· If you typed the page address in the Address bar, make sure it is spelled correctly
· Open this page and look for the information you want
· Click the Back button and find out about the alternative at http://www.labour.org.uk
· Click here to look for the deleted information on the Internet elsewhere

HTTP 404 – File not found
But more information is available here

Tell us which of the Tories broken promises you’re most angry about below:

hatcat marnell (suzy), Thursday, 14 November 2013 16:30 (ten years ago) link

http://www.reactiongifs.com/wp-content/uploads/2013/11/unflappable.gif

Matt DC, Thursday, 14 November 2013 16:43 (ten years ago) link

really excited to vote for one of these parties at the next election

caek, Thursday, 14 November 2013 17:20 (ten years ago) link

here is the bit where i say i recognise that the pressures of a war zone are unimaginable to a civilian

here is the other bit where i say how fucking bored and depressed i am about hearing how hard it is out there for a war criminal

a strident purist when it comes to band-related shirts (Noodle Vague), Friday, 15 November 2013 00:01 (ten years ago) link

Touch harsh on Lily Allen

glumdalclitch, Friday, 15 November 2013 00:37 (ten years ago) link

Click the Back button and find out about the alternative at http://www.labour.org.uk

"Our fight for Britain starts here." Do they propose a nationwide boxing tournament?

But we're all in this together

Thomas K Amphong (Tom D.), Monday, 18 November 2013 13:17 (ten years ago) link

http://www.telegraph.co.uk/news/politics/labour/10461175/Labour-Well-scrap-benefits-for-under-25s.html

what is even the point of having an opposition any more

lex pretend, Wednesday, 20 November 2013 08:22 (ten years ago) link

People under the age of 25 would be barred from breathing under proposals being considered by the Labour Party.

Cunts.

Thomas K Amphong (Tom D.), Wednesday, 20 November 2013 09:10 (ten years ago) link

Another "me too" policy proposal from Labour, a blatant attempt to win back voters by trying to appear to be bigger Tory shitbags than the Tories. I fucking despair on two levels: 1) that politicians are so lacking in real ideas and policies that all they do is serve up the same reheated shit, 2) that the British public are so petty and bigoted that this kind of shit-on-the-poor politics is the only way to appeal to them.

fashionably early Christmas themed display name (snoball), Wednesday, 20 November 2013 09:59 (ten years ago) link

They've already come out and said they're not doing it, as far as I can see:

http://labourlist.org/2013/11/reeves-says-axing-benefits-for-the-young-is-not-and-will-not-be-our-policy/

Matt DC, Wednesday, 20 November 2013 10:03 (ten years ago) link

Speaks volumes that no one was surprised at the possibility though.

Matt DC, Wednesday, 20 November 2013 10:05 (ten years ago) link

Usual political trick (used by both parties) of proposing a hardman policy to appeal to right wing voters, then saying "oh but we might not actually do that" to appeal to left wing voters.

fashionably early Christmas themed display name (snoball), Wednesday, 20 November 2013 10:11 (ten years ago) link

A lot of the time it's just ineptitude and backpedaling, I think.

Matt DC, Wednesday, 20 November 2013 10:25 (ten years ago) link

Telegraph people making mischief?

hatcat marnell (suzy), Wednesday, 20 November 2013 11:06 (ten years ago) link

Missed this the other week, Ed trying to stop payday loan ads on kid's tv:

"I think it's wrong, it's not what should be happening and that's why a Labour government would stop them advertising during children's TV, because it's bad for young people, it's bad for families and it's bad for communities."

Mr Miliband said it was "just wrong" that payday lenders were "putting pressure on our kids to pester their parents".

ime kids are more likely to be a pain in the arse about expensive toys than Wonga loans thanks to tv ads

loan sharking is thriving thanks to everyone being fucking skint, not because of cartoon network

grown-arsed man (onimo), Wednesday, 20 November 2013 14:05 (ten years ago) link

Marketed to dimwitted adults who fall for shiny, googly-eyed pseudo-Pixar mascot thingies. It's not as if there aren't plenty of those people about.

hatcat marnell (suzy), Wednesday, 20 November 2013 14:19 (ten years ago) link

Given how much today's political leaders resemble googly-eyed characters, I'm going to start the Muppet Party. The slogan could be "Vote Muppet - you probably have been for the last few years anyway".

fashionably early Christmas themed display name (snoball), Wednesday, 20 November 2013 14:23 (ten years ago) link

My partner works in mental healthcare and a lot of the people she works with have little-to-no concept of money and the consequences of debt. They'll spend till they have nothing left and when asked how they will cope, they just say 'I'll phone the number on TV'. Those companies are vampires.

a beef supreme (dog latin), Wednesday, 20 November 2013 15:23 (ten years ago) link

My partner works in hr
My partner works in retail
My partner works in govt
My partner works in banking

Statement holds v close to true for substitution of above, non

30 ch'lopping days left to umas (darraghmac), Wednesday, 20 November 2013 15:32 (ten years ago) link

Poorest families 'need more help over debt'

Solution: cut their benefits, freeze their wages but allow them more credit.

Thomas K Amphong (Tom D.), Wednesday, 20 November 2013 15:43 (ten years ago) link

Sorry that was meant to be a link: Poorest families 'need more help over debt'

Thomas K Amphong (Tom D.), Wednesday, 20 November 2013 15:45 (ten years ago) link

There is literally nothing worse than hearing these turds "banter" like the posh school debating club tossers they are.

http://i26.tinypic.com/2udyu5e.jpg (stevie), Wednesday, 20 November 2013 16:18 (ten years ago) link

The Sun laying into the PM on environmental issues?

https://pbs.twimg.com/media/BZlidN9IQAAoJ1T.jpg

sure is a crazy old world

but my heart is full of woah (NickB), Thursday, 21 November 2013 10:32 (ten years ago) link

My partner works in hr
My partner works in retail
My partner works in govt
My partner works in banking

Statement holds v close to true for substitution of above, non

lol, is this an attempt to play Cap'n Save-a-loanshark?

In times of osterity, these Eton-educated poshboys (Bananaman Begins), Thursday, 21 November 2013 11:38 (ten years ago) link

http://www.nytimes.com/2013/11/24/world/middleeast/talks-with-iran-on-nuclear-deal-hang-in-balance.html

i like how they haven't bothered to annotate william hague

carla jenkinvingne (nakhchivan), Sunday, 24 November 2013 16:42 (ten years ago) link

lol, is this an attempt to play Cap'n Save-a-loanshark?

― In times of osterity, these Eton-educated poshboys (Bananaman Begins),

christ no, just sayin that you dont have to work in or around mental health to meet lots of ppl with no concept of personal finance or w/e, which is why these fuckers are printing money

30 ch'lopping days left to umas (darraghmac), Sunday, 24 November 2013 23:41 (ten years ago) link

i like Ed Mili more than i did after hearing this

http://www.bbc.co.uk/radio4/features/desert-island-discs/castaway/f31add9b#b03j8srb

piscesx, Monday, 25 November 2013 00:33 (ten years ago) link

>>>>>>>>>>> that

a poet and Educational Consultant based in Peterborough (nakhchivan), Monday, 25 November 2013 00:34 (ten years ago) link

god what a biddable fuckboy he is

a poet and Educational Consultant based in Peterborough (nakhchivan), Monday, 25 November 2013 00:35 (ten years ago) link

i know that his choices were worked thru by a PR group but is that really the best they could do?

uk cheese board (Noodle Vague), Monday, 25 November 2013 08:34 (ten years ago) link


This thread has been locked by an administrator

You must be logged in to post. Please either login here, or if you are not registered, you may register here.