Monday 27 February 2012

Heartbeats / Can't Find My Way Home: Songs That Get You From The Start


The other day I put the Blind Faith album on my Nano. I hadn't listened to it for many years, and it came over my Bose earphones straight out of my schooldays. Blind Faith was Eric Clapton, Ginger Baker, Steve Winwood and Rick Gretsch, and they were the first "supergroup" (the other was a band called Humble Pie, but they never really convinced me). One track, Can't Find My Way Home, took me off to another place entirely, which given that I was commuting to work at the time was a major feat. 

Here is the original album version...

 For some reason I thought of Jose Gonzales' version of Heartbeats...

 
Both songs are acoustic and have similar structures, with multiple repeats at the middle eight, and their lyrics barely make sense in an evocative way. Heartbeats is a strong song, as shown by the number of people who have covered it already and the beating it can take at their hands.

Heartbeats is about, well, what, exactly? "One night to push and scream / And then relief" could be about childbirth, and the song could be about the parents coming together only for the birth and then splitting "We had a promise made / Four hands and then away". I'll go with it being a hectic and heady one-night stand between two people who are attracted to each other, couldn't be in a relationship, are confused about why they are there and need to "speed up truth" to resolve what they are feeling. I'm guessing something like this is what most people think it's about if they don't think about what it's about.

The lyrics of Can't Find My Way Home sound like a man asking a woman to stop being a distant princess and let herself get into a relationship with him. But I wonder if it isn't actually about someone on drugs: the throne being the distance a drug user gets from the real world, and quitting drugs being "leave your body alone". Again, I'll go with the love lyrics. The song, the whole thing, is a musical evocation of what it is to be "near the end and I just ain't got the time / And I'm wasted and I can't find my way home". The guitar tune, chords and Winwood's scat singing then become an essential part of the song. 

Which as I write this, I realise is also true about Heartbeats. Seriously. Play any version on You Tube - except the Knife's - and those opening chords and tune get you at the start. It's what these two songs have in common and so few songs do. Enjoy both.

Friday 24 February 2012

My Ideal Philosophy Degree: What Makes a Philosopher?

Every now and then, I've tried to design my ideal philosophy degree. There would be a fair chunk of history, and not just the history of philosophy, but some economic, military, social and scientific history as well. If you don't know anything about seventeenth-century England, you won't get the context of all those debates about duty, obligations and virtue that the moralists had. Under post-modern capitalism those ideas are more or less a joke, but when the King can demand that you put a chunk of your money and people at risk in his latest idea for a war, and it's your duty to do so because he's the King and you swore an oath, then the idea of obligation and duty becomes very meaningful. As well as costly. And of course the debate was conducted in the abstract, because if they had named the issue openly, it would have been treason.

My ideal course would have a lot of history because that was the bit I didn't appreciate and missed when I studied the subject - and perhaps 'studied' implies rather more reading than I did. The students on my course should come away with  a party trick: some obscure - to the general public - school or philosopher that they can impress dinner-party guests and strangers forevermore. And they should have been put in the way of reading as many of the classics as we can expect an undergraduate to read - that's part of the bit where they get an education.

Which leaves the bit where they get an idea about what being a philosopher is about. Most of the people in philosophy departments are teachers and scholars. At some point, they decided they liked the academic life, they could network effectively in it, could work the system and also seemed to be quite good at understanding what Leibniz, or Roger Bacon, or Heidegger or whoever, was going on about. So they became scholars of that thinker. Others find they like a certain branch of the subject and enjoy the compare-and-contrast involved in teaching the thoughts of the creative philosophers. They have jobs in philosophy departments but they aren't necessarily philosophers.

What makes a philosopher is an attitude of informed scepticism, a distrust of authority and all its works and pronouncements, a respect for logical consistency and conceptual coherence (the philosopher's version of having a sense of style), the desire and ability to see the world more clearly than others do, and a desire to understand some part of the world on their own terms - or in the grand manner of Aristotle and Hegel, all of the world. Since the world is more complicated now that it was, and since there are more people and organisations making more self-interested and dubious claims than there ever were, and there are more branches of empirical knowledge and theoretical speculation than ever before, this is a larger task than it used to be, and takes a lot more background knowledge.

One starting point is the ability to identify bogus arguments and all the tricks of informal argument and presentation. Another is to have a guided tour round the follies and promotions (in the evil eighteenth-century sense of the word) of the past - you may rightly suspect a reference to Mackay's Extraordinary Popular Delusions and the Madness of Crowds coming, and there it was. A couple of case-studies of the irrational behaviour of authority - the Lille-Reed affair, satanic ritual abuse, recovered memory - wouldn't go amiss, as would a brisk description of street con-tricks and Wall Street Ponzi schemes. I would want my students to feel confident enough to conclude that if, after careful examination and diligent enquiry into whatever it is, it still doesn't make sense, then it's a trick, an illusion, or just plain downright craziness.   

I've always thought that there should be three compulsory courses that run for the first two years: 1) The History of Philosophy and its Worldly Context, 2) Logic, Rhetoric and Epistemology, and 3) Law, Morality and Politics. Now I would add in the second year, 4) The Sceptical Citizen: Data, Statistics and Common Sense. The third year would have two projects: one would be an extended essay on the student's chosen party trick, and the second would be the examination of some recent scam, hype or madness. There are, after all, enough of them.

Wednesday 22 February 2012

Downloading Books Is Killing Literature - Or Not

Apparently you can download books now. Illegally, that is. I have to think Amazon knew that would happen, as did all the publishers who agreed to make Kindle and Apple editions of their books. Large companies who foresee a consequence of their decision and still makes that decision desire the consequence. Large companies who don't foresee consequences are just dumb or careless. This isn't true about non-millionaire people and your uncle's bakery, because they can't afford lawyers and programmers and all the other people who could have foreseen or prevented the consequence. The money guys can and it's their job.

Medieval copyists complained that once Gutenberg had set up the type for a book on one of his presses, that was it. No more work for them. I bet they put up quite a fight as well. Which worked out well for them. Every time publishing technology changes, the chances of people getting stuff for free increases.

The music industry has been bitching since forever. If it really cared about free access to music, it would stop 8Tracks, Last FM, You Tube and all the others. It doesn't. They're promotion channels. One day I may buy a Ke$ha CD, because I've been watching her videos on You Tube. Otherwise I wouldn't go near it. I suspect the music industry is doing the same as the tobacco industry, which used to sell masses of cheap cigarettes to fat guys with addresses in Malta and then say it was shocked, shocked! to see those cigarettes on sale in the poorer parts of Italy, all of Romania and all over Africa. If they didn't say that, governments might think they were conspiring to avoid paying taxes. I'm not sure about the music industry's motives, but one day we'll hear something and say.... ahhh, so that's why.

The real question is this: what are you objecting to being downloaded? The data or the story (music, movie, whatever)? Downloading data isn't stealing anything, it's making a copy. The copyright owner may have put restrictions on making it available for copying, but then their case is against the person who made the copy available. That's who the contracts are between. Copying data is not the same as stealing a physical book. Wait until the next sentence before you object.

Stealing a book is stealing a bunch of paper and ink. You deprive someone of the paper and ink, and the reason copying isn't stealing is that you don't deprive the owner of the original of anything. If all you do is copy the file to your hard drive, there's no theft. Wait until the next sentence before you object.

Once I open the file and start reading / listening / watching or using the program - that's when the theft occurs. Because nobody buys a bunch of paper and ink, they buy a story. They don't buy a plastic coaster, they buy music. They don't buy an EXE file, they buy software. It's the use that creates the theft from the author and the publisher. Stealing the book is theft from the retailer. Reading it is theft from the publisher and author.

The catch is this: when you borrow a book from a friend, or when your children read a book on your shelves, that's exactly what they are doing: stealing the story from the author. You aren't stealing the physical book, but you are stealing the story from the publisher and author.

Since no judge in the world, nor any government, is going to pass a law or allow a civil ruling that says a child can't read their parents' books or that friends can't lend each other DVD's, what everyone pretends they get upset about is the medium. Which was kinda acceptable for books and vinyl, but is hard to argue for basically costless data. After all, the whole point of going digital is that it reduces the marginal costs of the medium to almost zero. See how the exact law gets a little tricky to frame? It's very technology-dependent.

However, by now we should have a fair appreciation that putting a Kindle file in your Dropbox public folder for friends and family is the same as lending them the book but putting it on a Google-searchable filestore for anyone anywhere to download is not. If we can define or explain the difference between a real (old-skool) friend and a new-age Facebook non-qualifying friend, that would tie it down a little more.

All we would need is for the media giants to be sensible and accept the difference.

Monday 20 February 2012

Sunday, I Ran 2.4 Kms Without Getting Breathless

Big deal, I hear you say. You do a "10K" in forty minutes. Then you change into your gym gear for some serious running. But I hadn't been able to run without getting breathless for the last nine weeks or so. Since before Christmas. Nine weeks ago I hopped on the treadmill, set off at 11.6kph for two miles as I had been doing for a while and was gasping, heaving for breath after 800 metres. I had to stop three times even to manage a mile and a half at 9.6kph. It got worse.

Four weeks ago I did something I have never done before and you don't see many people doing at all, which was quitting Clarissa's Tuesday Spin class. I simply lost the will to carry on. One morning scurrying down the back streets of Waterloo to Blackfriars Bridge I very nearly just sat down on the pavement and stopped. My legs didn't want to go on walking. I haven't been spinning since.

I've only started to get my strength back over the last couple of weeks. I couldn't even walk up stairs without suffering loss of breath and heavy aches in my legs. I have never felt that bad. Of course it was a damn virus. Of course I blame the damn offices.

So when I trotted along at 9.6kph Sunday for 2.4kms and didn't feel any strain, it was a sign that I may actually be turning back into a human being again. Instead of this sick thing I was.

Friday 17 February 2012

Young Adult - Diabolo Cody, Jason Reitman, Charlize Theron

I saw this film about three weeks ago and I still haven't quite sorted it out. I like the director's other movies, and Diabolo Cody is my kind of writer. They made Juno together and that was enough for me. I was a confused by Young Adult, and when I'm confused, I turn to Roger Ebert. I don't always agree with him (especially over the grossly over-rated Synechdoche: New York) but his reviews often help me clarify what I'm thinking.

Charlize Theron plays Mavis, a late-thirties freelance writer of adolescent novels who lives in an high-rise apartment in Minneapolis, drinks too much and her battle prep includes manicures and pedicures. She's divorced, behind on delivering the final novel in the series that's been paying her bills, and suddenly gets a mail from her high-school boyfriend Buddy Slade  announcing the birth of his daughter. Off she goes to the baby shower, or whatever they call it, to bring the boyfriend back with her. 

Would a real-ish Mavis really do those things? Well, here's the painful identification bit. Mavis reminded me of me when I was her age - except I was prettier than Mavis and didn't drink Coca-Cola to get over hangovers. We both had relationships from our youth we held onto as a kind of fantasy, neither of us were happy in our jobs, neither of us were happy where we lived, both of us drank too much, but we hadn't crossed the line. I knew my unresolved crush was married and had children, and living a life more suited to her than any I could provide. Somewhere in the bit of my brain where reality rules, I knew there would be no reviving anything. But very few people have the grasp of reality I have - something I've been told a number of times, as if it's a bad thing - and without that, yes, I would have set off after her. So I accepted Mavis' homecoming both as a plot premise and as an emotional truth.

That connection was totally lost when I was asked to believe she would stick around after meeting the dreadful, gender-shaming betamax that her high school boyfriend has turned into. A man who bottles his wife's breast-pumped baby milk, and who quit drinking out of solidarity with her during the pregnancy? No. Had I actually met my unresolved fantasy, who I'm pretty sure is an exemplary wife and mother, I would have muttered something about having the wrong address and left quickly. The real exemplary mother wasn't the fantasy. So I couldn't buy Mavis not reacting the same way, and I lost the connection.

When she's visiting her parents, Mavis says she thinks she may be an alcoholic. Ebert believes this. I didn't. Alcoholics have a streak of self-pity, even after years in recovery and a good few runs up the Steps. Charlize Theron is just too tough to be a victim. I think Jason Rietman wanted it that way. Because he gets to have her behave as an alcoholic woman with neither judgement nor protective vanity, but without us emotionally believing it - because Charlize Theron's body language just doesn't communicate it. 

Young Adult is about how awful small town life is. Since you're not allowed to say that - unless it's made unreal by being spoken by a teenage girl - this has to be disguised as a Homecoming movie. Homecoming movies are either like Sweet Home Alabama, where the local-girl-made-good-in-the-big-city learns to value her home-town roots and high school boyfriend, or lead up to a Revelatory Climax in which we discover that a) the heroine was a bitch or b) the heroine was molested by her father. There's a Revelatory Climax in this movie, where we discover that the heroine nearly had the boyfriend's child, but it was spontaneously aborted. I didn't buy that as anything but a script fix, so I ignored it. It's just there to confuse us. The real climax is the speech from Collette Wolfe's character Sandra Freehauf to the effect that, yes, the small town life utterly sucks, and will Mavis please take her to the Mini Apple. Mavis says no, but the speech gets her right back on track. "Thanks, I needed that" she says.

That I did identify with. And the bit where she gets out. With a completed novel. The couple of scenes where she writes in diners and fast food joints, and steals lines from the very people who make up her audience? Those I liked, those actually swung. The film ends with her Young Adult novel's character leaving behind high-school and heading into the real world with high hopes and a couple of ego bruises. Is this supposed to be Mavis? Or is it just her book? I think that's another ambiguity to make the story palatable. Because what awaits Mavis isn't pretty: she isn't going to be happy, satisfied or content - except for a few brief moments. You understand I'm speaking from experience here. She's going to spend the next forty years showing up and faking it. Which is no way to end a general-release movie.

And that's the thing with this movie: there's no-one to like and connect with. Because that would engage our sympathies with them and against the other: with the small town, against Mavis; with Mavis, against the small town. For some reason Cody and Reitman wanted us to do neither. Which makes it more real, but for that reason, less satisfying.

Wednesday 15 February 2012

What Brainstorming Really Was

There's a fascinating article in The New Yorker  about how valuable being able meet other random smart people is for generating good ideas - that's my take on the description of Building 20. Explains a lot about why no good ideas ever come out of government or institutional British companies (neither smart, nor random nor able to meet).

What I didn't know was that "brainstorming" - the most bogus technique for idea generation ever - was invented, or described, by a Mad Man, Alex Osborn, a partner in the advertising agency B.B.D.O in the 1940's. The notion took off and has been blighting creative effort ever since.

He made the story up. Of course he did. It's what Mad Men do. He couldn't tell his readers the various truths about having good ideas. Who wants to know that good ideas come to you out of nowhere after you've been producing utter rubbish for weeks on end? Or from a random conversation with someone you met on a train, or from a song lyric, which meant something to you because you were soaked in the problem, but nothing to the person sitting next to you, because they weren't? And was he going to tell you what his "brainstorming sessions" really were?

Picture it. A bunch of the guys sitting around, relaxed enough not to be worried about sounding silly, throwing out any old bullshit that occurs to them. What does that sound like? Yep. I missed out the cigarette smoke, the drinks and the leatherette seating. They were in the bar after work, sending up each other's ideas, parodying the clients, making silly and probably obscene remarks about how to use the client's products, and suddenly... the copywriter scribbles something down and vows to use it next morning just as soon as he's had enough aspirin to ease the hangover.

Alex Osborn couldn't describe that. So he re-located it, took away the booze, cleaned up the dialogue and called it "brainstorming". How  else could it have been?

Monday 13 February 2012

Why I Can Stand On Your Toes If I Want To

A few years ago now, I was walking across a bridge in Amsterdam with my friend. A boat passed underneath, carrying what looked like celebrating medical students. I thought: "it isn't my world any more, it's theirs". 

It took me a while to understand that feeling properly, and some of it isn't pretty.

When I watched those medical students waving their drinks around, what I really felt was that the deserved self-centredness of older folk: you young people can look after the frigging planet now, we have enough on our hands just staying employed, right-weight and fed. You need to have been through the Wasteland Years from forty to sixty (I'm not quite out yet) to understand this: but when you have, you will know that you've paid all the dues you ever needed to.

Twenty years of showing up, standing your ground, fighting for your space and light, dealing with unemployment, finding jobs, gaining and losing relationships, all when the hormonal fires are going out is an endurance test enough. It breaks some people, either financially (divorce, bankruptcy, sustained unemployment), spiritually (too many compromises on the way up the slippery pole or for the sake of the marriage and kids) or physically (just look around you). Of course, for some people it's a wonderful time, but they live somewhere else I've never been.

So when I left the world to those students, I was also reserving the right to be as selfish, or self-interested, as I wanted or needed to be, to get through the remaining time. It's what a lot of older people do.

We get focused on our issues. We don't care about education, because our kids have grown up. We don't care about the planet, because we're not going to be around a lot longer. We do care about pensions and paying bills, because we're shortly to be out of work and faced with maybe twenty years of living. Those pensions and allowances cost younger generations money. Our lives contract as our energy levels decrease and our capacity for finding stuff exciting and rewarding diminishes (except for addicts and nerds, for whom The High from drugs, women, booze, music, movies, solving tough problems and putting one over on the enemy never goes away. This explains me).

My generation will cancel, or cause to be cancelled, the retirement age, because lots of us have worthless pensions wrecked by bouts of unemployment, and we will establish, or cause to be established, a de facto right-to-die based on the current idea of an advance decision. We are going to be short of money, and are threatened with a long and decaying old age of poverty. Not going to be popular with a generation who were used to being fit, present and able to spend.

Pete Townsend wanted to die before he got old because he didn't want to be helpless, compromised, poor, patronised by nurses and social workers, and a nuisance to his children. He's none of those things because the world has changed, and he's a millionaire. I'm none of those things either, and I'm not a millionaire. I still want to die before I get old, and can't find paying work.

And in the meantime, I've paid my dues and I don't owe anybody anything except good manners, settling my debts,  and a day's work for a day's pay, which are the courtesies of everyday life. It's just that now, you have to be more thoughtful to me than I do to you, because I'm the old guy with grey hair.

And if you're not, I'm going to stand on your toes.

Friday 10 February 2012

First Thoughts On Insight Analysis

Look at this year's job title and it says something about "Insight Analyst". If you've never run across one of those, it's not surprising: they only roam in companies with huge, and I mean millions and even billions of records, databases of customer data. It's what used to be called "desk research" but with mainframe computers: the buzz-name is "big data".

The insight agencies - such as Dunhumby, Tesco's in-house analyst - like to claim the value of their contributions. What they contribute is usually tweaks to the exact mix of coupons sent to a more refined mailing list. Given the costs of direct mail, that may be worth doing. Google and Facebook are basically selling their insight technology: they are offering the world's best targeted advertising. Tesco, Sainsburys and other supermarkets with loyaly cards can tie purchases to people, and banks can look at your current account transactions. Hint: if you want to hide your patterns of consumption from financial services companies, pay by cash. 

As ever, I like to contrast Amazon with the The Bank. Amazon use an insight approach when they make suggestions based on "people who bought this also bought these". It works well with genres - a textbook on Galois Theory, post-rock music, romantic novels or cookbooks - and it may work with accessories for bigger-ticket items, but outside well-defined genres, where customer volumes are small, it can get bizarre. With volume comes consistency and reliability, but also blandness: large numbers of people who bought Katy Perry also bought Ke$ha. I'd never have guessed. A mathematics publisher won't need telling that people  who bought Hartshorne also bought Hatcher, and Mumford's Red Book, but it's only news to outsiders. Which is exactly who it's aimed at: consumers like you and me who are browsing. I think the Amazon algorithms are fine, and the occasional bizarre suggestions just confirm I'm in a minority. What makes Amazon so effective aren't clever algorithms - though that helps. Amazon's real advantage is that it controls its data: you tell it what you bought, using the references that it supplies. Retailers do the same with bar codes. 

Not so much in retail banking. Retail bankers and their IT people aren't as aware of the advantages of standards as their counterparts in telecoms. As a result, a bank can identify the method of payment, but not what it was for. Reliably. That £254.32 you give to Sainsburys each month? We don't know if it's for food, a loan repayment, savings, a credit card payment or whatever else. Banking developed in the days when retailers generally did one thing - except the Co-op and Woolworth, and everyone paid them with cash. The industry never recognised a need for standards in transaction description.

As a result, when I took over a report that claimed to tell us how many of our customers were taking loans with other lenders, I found more ambiguities and estimates than had been advertised. And I can't resolve them. Nor can a room full of analysts, because we don't have the data. Big Brother may be watching you, but his glasses are steamed up, and he doesn't know what he's looking at half the time. (Are you convinced by those grainy CCTV photos they show on the news? Not me.) 

Messy data in, sloppy conclusions out. I discovered recently that people were using an earlier an even messier version of this data to calibrate pricing models. I have no shares in The Bank for  reason.

Insight analysis isn't management information, which is itself a step down from financial reporting. As long as the segment my analysis tells me should be large and spread over the country doesn't turn out to consist of two hundred people in Guernsey, I'm okay. Does it matter if it's really 4.5m people instead of 2.5m or 6.5m? As long as we start small with the ability to scale up quickly? The point is to spot a genuine segment, and it may not even be that. The point is to produce a product or service that makes money and people come back to buy. Does it really matter how precise the process is? Hell, I'd be happy if I designed the product for one group of poeple who ignored it completely but it was taken up by another group to the volumes we were hoping for. The onyl issue there is that I may not be able to repeat the fluke.

But if the success is big enough, I don't need to.

Wednesday 8 February 2012

How Not To Migrate Customer Data


So when The Bank acquired the Other Bank, they hired a bunch of contractors to migrate the data of Other Bank into The Bank's systems. Which they did. Sort of. Just how "sort of" you can judge by the way they treated customer ID's. A customer, Joe Bloggs, of Other Bank had an unique system ID number, say 1245678. When Joe's details were migrated, he was given a new unique ID in The Bank's systems (they had to do that, you can figure out why), say 7654287. 

Here's the thing. They didn't make up a table that said Joe Bloggs ID's: Other Bank = 1245678, The Bank = 7654287. So I can't link Joe's data before migration with his data after migration. In other words, he may as well have become a brand new customer a few months ago. Re-read those sentences until you realise how monumentally stupid that was, and keep going until you understand that to make that mistake, those contractors and the people guiding them must have almost no understanding of how data works. Now understand that almost everyone who works in bank IT and management is that, errrr, challenged, and you will not be surprised when the next disaster happens. Those people actually don't understand the industry they are working in.

By the way, if you don't get what the issue is, and you work with data, please choose another career. Now. Before you do any serious damage somewhere.

By searching around the wilderness that is The Bank's database set-up, and by exporting 6.5m records from the mainframe to my work laptop where I could perform some simple string manipulations, and then re-import that data, I got round the problem, at least for my product. Yes, you read me telling you I had to export the data to my company laptop. WTF? Because the mainframe DBMS doesn't have any kind of serious string editing, and if it has a companion programming language - as Access has VBA, which was what I used - The Bank doesn't have it. And do not ask how painful it is to process 6.5m strings in Access - if you have done it, you will know, and if you haven't you wouldn't even begin to believe what happens.

There are days when I get scared that these problems get solved by me. I'm not supposed to be the smart guy. This is a HUGE FREAKING CLEARING BANK. It is as important to the functioning of the economy as Thames Water or British Gas. It's not a nice-to-have company - like Apple - that could vanish overnight and we could all go on having hospital operations and getting to work. An organisation like that is supposed to have serious engineers and designers running it, not a bunch of people who make mistakes so dumb even I wouldn't make them.

I'm supposed to be helping our creative types with data-driven insights and what I really do for a living is make up for the deficiencies of a string of IT and DBA contractors, and by extension, the organisation's managers who don't understand why this stuff matters and how to manage the functions that should deal with it.

I do know one thing: it's even worse in the USA. Way, way, way worse.

Monday 6 February 2012

How Was Your January 2012?


 January was horrible. It was so bad I even went to the Quickstep meeting in Islington a couple of times – actually it’s a nice group and I will be going back. It was grey, it was cold, it was wet, it was scuttling through the back streets to get to Blackfriars Bridge and hoping I could get a bus to Liverpool Street rather than have to travel on the ram-jammed Central Line.

I spent a lot of the month wading through some philosophy of science in a book called Cosmopolitics, by Isabelle Stengers, a Belgian chemist-turned-philosopher of science who was a pupil of Iliya Prigogine. It’s written in that fluent post-modern French style that’s as slippery as a fish – every time I think I get what she’s saying, it slips away from me. It’s in two volumes, and it feels like she discusses a lot, but when I try to summarise what I think she’s said… nothing happens. This is not a satisfying reading experience. Sartre’s Being and Nothingness is by contrast snappy and to the point.

Another chunk went on trying to understand the Riemann-Roch theorem. Not the modern proofs, which aren’t that difficult, or the ideas that go into the proofs, which I suspect are simpler than all the formal frippery make out. I want to understand why it should be true – because when you take a really naive approach to estimating the dimension of a function with n poles and m zeros of varying degrees, you don’t wind up subtracting the degrees of the poles from the degrees of the zeros. How on earth did Riemann think of it? Nowhere, and I mean nowhere, will you find an intuitive explanation of this theorem, let alone why the original proof used Dirichelt’s principle, which is about solutions to the Poisson equation! Index theorems – which R-R is an example of – are deeply tied to PDE’s – the Atayah-Singer theorem uses the Dirac equation (!) – but you’d never guess it from the usual literature. This is frustrating, especially as the project of the series is to provide just such an explanation.

Another chunk went on being not-quite-right in the body and mind. One Wednesday morning in mid-January, I swear I nearly turned round, went home and called in with ME. I had practically no will to tackle the world. Let alone the daily journey to Liverpool  Street. The previous evening I had actually dismounted from the bike twenty minutes early in my spin class – I didn’t do that when I first started. I had just Lost It. I took lots of early evenings and did little gym. I took a long weekend at the end of the month, and started to feel stronger and more able to take on the world.

A lot of time went on two hefty – by my standards – projects at work. One of them was a “despite” project – one you get done despite the tool set and data you have, not because of it (if you don’t know what that means, get a job in a retail bank). The other was / is a report where the presentation is as important as the data – long story. Day after day went past with no visible progress and a lot of effort. I solved one of the problems recently and can concentrate on the next one.

Whatever it was I got before Christmas was more than just the cold and fever that laid me out over the holiday week. It’s made my breathing rough – I can barely breathe well enough to run on the treadmill for more than a mile. Some of it was cold and fever, and some of it is something else.

Soon after I wake up, I think “I can’t go on doing this”. It passes, but it’s real. I don’t like the City – like all west Londoners, I get hives if I have to travel East of the Kingsway for any length of time. I read some research that found that rooms with low ceilings are good for doing transactional, routine tasks, but to do any thinking you need higher ceilings. The ceilings in our new office feel about as high as the galleys of the Cutty Sark.  Some of me is prepared to get used to it, but the rest of me wants nothing to do with it. There’s the real conflict. I haven't felt entirely fit and well since we moved there.

Friday 3 February 2012

Accounting Ratios Are For Accountants, Not Insight

One of the many variables our accountants track is the average weighted selling price (AWSP): the loan-amount-weighted-APR. This varies slightly each week even in the most stable of times, especially with a pricing engine as sensitive to as many customer-centric variables as The Bank's, but no-one has a good idea of how much variation is just "BAU" ('business as usual") and when to start wondering if there's something going on on the outside, Mr Jones.

I'm wondering if we should even be tracking these kinds of accounting ratios at all. The AWSP and the ALA (average loan amount) are more-or-less inversely related: put up the APR and the amount borrowed goes down. (Who knew?) But when you look at what happens, it's not what you think that happens. You think that when we put the prices up by 10%, almost everyone knocks 10% off the amount they borrow. Not so much. In fact, not at all. Very few people take loans for some random amount like £5,237: they take loans of £4,000 or £5,000. The distribution of loans by amount is not normal, but has spikes at the round thousands. Almost no-one takes a loan for £18,000 and a fair proportion take loans of £2,000. And this is true no matter what the prices are.

I'll just say that again, because I can guarantee you didn't get it. You can change the prices all you want, and the peaks will always be at round thousands and multiples of six months in the loan terms. What really happens when we put prices up? A 10% in increase in APR from 10% to 11% on a £10,000 loan over 60 months makes a difference of £5 a month to the repayments. Most people can afford that, if they can afford the original amount in the first place. That's one reason why things don't change much for a building society with a fairly simple rate structure when it bumps up its APR's. However, the pricing models The Bank uses don't usually impose a constant increase on everyone. The changes are obtained by changing propensity curves which can make some hefty differences to some people and very little to others. You might have thought you were going to pay £220 a month, but actually it turns out that now you're going to pay £260. That's a week's petrol for the car for a lot of people. Decision time.

Many other people will be unaffected. I think (because we don't have research - yes, I said: "we don't have research") that some people make a big adjustment - instead of buying a second-hand latest-model car, they buy a second-hand previous-model car that's perhaps only six months older, because that knocks at least £1,000 off the price of even small cars (and that's my Top Tip for saving money when buying second-hand cars) - while some people abandon the project altogether because it's not the sort of project you can save £500 or £1,000 on.

Over half the personal loans made every day are to re-finance other debt, and maybe some people, faced with a higher price for the whole lot, go back one more time to the Bank of Mom and Dad to ask for help on the last £1,000. There's undoubtedly a rounding effect in the intial amount. The project (new TV, new kitchen, wedding, new floors) might cost, say, £8,250 and many people will round up to £9,000 so they can get the TV / holiday / new sheets / some other bunch of stuff they've been putting off for ages, as well. When we put the price up on them, they shrug, borrow £8,000 and fund the last £250 from a credit card or cash flow.

Take 2,000 of these random decisions a week and it smooths out. So the accounting ratios paint one picture, while the detailed MI shows something else. Accounting figures are accurate, but don't provide insight: MI is often slightly inaccurate, but provides insight. (Inaccuracy is fine, as long as it isn't misleading.)

I've been careful to call the AWSP and ALA "accounting ratios" rather than "statistics". Technically, accounting ratios are statistics (symmetric functions of observed values of random variables). Emotionally, they aren't. I have a prejudice that a "statistic" ought to do two things: it should tell me about the distribution, and it should be about something physically or commercially meaningful. AWSP sounds as if it should be commercially meaningful, but I'm no so sure. Because loans are about money, and you think all money is the same, I'll use a different example.

A record label could report the "average price per CD" (APCD). Under certain circumstances, it seems that might be a meaningful indicator. When it changed, you would still need to find out why. Did less people buy from "new release premium" label, or more people from the "new release budget" label, and why? No hot new releases this month? Was one of the budget releases was favourably reviewed on Radio Three? Perhaps the month's hot new release was on a competing label, so no-one bought much from yours. Or maybe the online server went down for two days, and since that's where your premium sales are, that's why the APCD dropped. Or maybe Amazon are making a point to you, which you've now understood. Or maybe a hundred other things because that's what business is: a thousand details that don't make a complete picture.

The accountants won't stop reporting the ratios, but the MI team, if there is one, should start reporting something more useful: the details of the product / price mix and how that changes. Or whatever other mix variables you need to look at to explain the make-up of some critical line.

Wednesday 1 February 2012

Resolutions For My Participation In Social Media

I joined Facebook a while ago and haven't been able to rest easy about the whole business of social networks since. Okay, I'm exaggerating. But I don't really get Facebook - maybe because I don't get that sharing stuff you're doing with others is a pleasure for you and them. My life is so based on work-gym-sleep routine and cultural consumption all before a ten o'clock bedtime that I can guarantee it's not interesting to other people. I hope what I think is, but I'm pretty sure what I do isn't.  So the whole "what am I doing on Facebook" thing turned into "am I making use of and contributing to the right sites on the Internet?"

There are two questions. Where do I need to be? And where do I want to be? "Need" is easy. I need to be on whatever industry networking site is actually used by people to hire people who do what I do. There isn't a site specifically for Insight / Pricing Analyst / Managers, though there are agencies that do a certain amount of specialising, but if there was, I would join that. Instead I'm on the general-purpose site for People In Suits, LinkedIn.

Where do I want to be? Put that way, the answer starts to be obvious. I want to be where there's stuff I'm interested in. That's music, attractive women, philosophy, mathematics, holidays, photography and other such. A lot of that is in blog-land and my contribution is by reading. I know the etiquette says I should leave comments, but I can rarely think of anything to say at the time.

Away from the blogs, we have... Amazon. This counts as a social media site: it's about the reviews. I review under my "Real Name". Books are one of my things, so this makes sense.

Other Review Sites: I'm thinking of TripAdvisor here. Google an holiday destination and TripAdvisor comes up. I do feel I should contribute, but can't get round to it. I'm very good at enjoying stuff, and taking photographs of it, but not so good at describing it.

Wikipedia. Perhaps the ultimate social content site: I have two articles from my time in telecommunications on it, under my real name. That's all. Maybe when I have loads of unpaid time on my hands, I'll do more.

Blogging. Yes. Here already. Long form, however. I don't, as you'll have noticed by now, micro-blog, so Tumblr is out. I'd like to make cool, laconic comments under equally cool photographs, but I'm a philosopher, not a fine arts grad. 

Photography. I'm not a pro, I don't do those polished Photoshop-ed pro-am photos that Flickr and deviantArt, amongst many others, are full of. It's not my style. And it strikes me that getting work up to that look, cataloging and tagging it, is a ton of work my diary doesn't have the space for. 

Guilty Feelings. No, that's not a site. I use You Tube so much, I feel I should give something back, but I'm not sure what. Or even how. I feel the same way about TripAdvisor. Google somewhere you're thinking of for a holiday and up this pops. I love the idea of 8Tracks, but the people there seem to have scarily awesome taste in music and accompanying art, and I'm suitably scared.

Forums. Like everyone else I use various forums, mostly for technical computing problems. I'm not good enough to give back in that area, and there are no forums for in-house business analysts (though there is for quants, though it's more of a career board than a how-to). This is because most in-house business analysts have a narrow and shallow transferable skill-set - what they are about is the use of in-house data, and discussing the family secrets with strangers is frowned upon.

Almost lastly, the Facebook Question. (Substitute your local social networking site for China / South America etc). I don't have a personal life - I commute, work, go to the gym, watch movies and read, write, think and sleep. What's my status update going to look like? "seven dials is... trying to calculate the first cohomology of a circle using only short exact sequences"? Yeah. Right. I'm on Facebook as so many are, to see who else is. In the spirit of reciprocity I should have some minimal, PR-friendly information about myself in case some HR department or recruitment agent goes snooping. I have the odd glimpse as to how one's page could be turned into some kind of ironic artwork, though I'm guessing someone else has already got there.

So here are my immediate resolutions. First, I will write at least one Amazon review a month from now on. Second, I will write a couple of reviews on Trip Advisor. Third, I will make up three playlists and attempt to put them on 8Tracks. Fourth, I will investigate what's involved in posting something to You Tube - if I can find something that no-one has already posted. That should get me started.