Comments | lj_nifty: LJ Metro Concentrations

mcfnord in lj_nifty

LJ Metro Concentrations

Jan 20, 2009 03:40

I've collected about 57,000 cities from a city field found in LJ user foaf feeds. This field has its problems. It might be blank 90% of the time, people write mumbo jumbo in it, and people often write the same city's name more than one way. Still, it can sense large city names.

( #1: Moscow! )

Comments 17

lil_m_moses January 20 2009, 14:47:17 UTC

What kind of timeframe does that look at? In other words, would the distribution shift if you were to look again about 8 hours from now?

mcfnord January 20 2009, 23:30:46 UTC

It's more like a timeframe of 6 months. Yesterday I did 9,463 such samples, of 611,357 total samples. Perhaps that's a clue, perhaps not.

borgseawolf January 20 2009, 14:50:26 UTC

So basically if I'm looking for people outside USA and Russia... I should look elsewhere? :P

da_lj January 20 2009, 15:08:25 UTC

Take another look at the top four cities. One of them isn't in the US or Russia. :P

1783 | Moscow
346 | Seattle
205 | San+Francisco
202 | Toronto

For that matter, London plus Melbourne together would place at #3.

I'm curious what time-frame the foaf feeds call "active".

klgrem January 20 2009, 16:48:53 UTC

Moscow is not in Russia?
Where did San Francisco go if it's not in the US?

bitter_crimson January 20 2009, 17:24:55 UTC

Toronto is in Canada (not the U.S. or Russia), is what the above commenter was saying.

Thread 11

lushlush January 20 2009, 15:35:45 UTC

What, no Manila?

pne January 20 2009, 16:37:02 UTC

Perhaps that's obscured by people listing "Metro Manila" as well and therefore splintering the numbers -- maybe even "Maynila".

mcfnord January 20 2009, 23:34:15 UTC

There's a big hairy normalization problem in the data.

Cebu+City/Manila
Las+Pi%C3%B1as,+Metro+Manila
Manila
Manila+Below
Manila/Cebu
Manila,+Philippines/New+York+City
MetroManila
Metro+Manila
Metro+Manila,+Philippines
Metropolitan+Manila
New+Manila
Quezon+City,+Manila
San+Juan,+Metro+Manila
Tondo,+Manila
Manila
Manila+Below
Manila/Cebu
Manila,+Philippines/New+York+City
Cebu+City/Manila
Las+Pi%C3%B1as,+Metro+Manila
Manila
MetroManila
Metro+Manila
Metropolitan+Manila
New+Manila
Quezon+City,+Manila
San+Juan,+Metro+Manila
Tondo,+Manila

cdvla313 February 21 2009, 06:02:12 UTC

And if you combined New York and Brooklyn, it would be number four. Since you know, Brooklyn is part of New York City, not a separate city.