perl -pi -e 's/[\x80-\xEF]//g' file.txt

Where file.txt is a file you want to clean up.

Why this comes up is because we have a web application that was set up to hit a MySQL database, which is incorrectly configured to store text as ASCII instead of UTF-8. The application assumes that all text is Unicode and that the database is correctly configured, and every week or two someone asks me why they are getting this weird gnarly error. Typically they are pasting in some weird UTF-8 whitespace character sent to us from Ukraine.

Eventually the database will be reloaded as UTF-8 and the problem will be solved. Until then, I can tell folks to use the Perl command above. It just looks for anything with the high bit set and strips it out.

echo
echo "Incidents (P3)"
mysql -u jira jiradb< <__id3q
select year(created) as "Year", quarter(created) as "Quarter",
    count(pkey) as "Total",
    sum(resolutiondate < date_add(created, interval x day)) as "Met SLA",
    sum(resolutiondate < date_add(created, interval x day)) / count(pkey) as "SLA %%"
    from jiraissue where pkey like 'OPS-%' and priority = 3
    and assignee != 'nagios' and issuetype = 26
    group by year(created), quarter(created) order by created;
__id3q

That above is a fragment from a shell script. Shell scripts are great for complex SQL queries, I find. Set a value x at interval x day and the output looks something like:

Incidents (P3)
Year    Quarter Total   Met SLA SLA %%
2011    2       xxx     xxx     x.xxxx
2011    3       xxx     xxx     x.xxxx
2011    4       xxx     xxx     x.xxxx
2012    1       xxx     xxx     x.xxxx
2012    2       xxx     xxx     x.xxxx

The query does some things that are newer to my limited understanding of SQL. For me the magic bits are sum()ed columns and the availability of quarter() … you can do monthly reports just as easily with month(). I’d love to concatenate Year-Month into a string like “2012-05″ but for the purposes of making my boss a little happier queries like this are good to have in the locker.

Some day I’ll be hip enough to convert things like this into JIRA widgets.

Oh yeah, and if your SLAs are measured in “business hours” or “business days” this will give you only a crude understanding of how well you have met your SLAs … an accurate measure would probably get embedded in a handler that gets called on issue close which can evaluate SLA fulfillment per issue priority and the local work schedule.

“If I were committed only to being right, I would go out and talk anyway, but because I’m committed to making a difference, I wait until I’m ready.”  –Julia Butterfly Hill

What sort of disturbs me is the Christians walking out. The religion says you have an obligation to spread the gospel, to preach The Word. That means you ought to interact with non-believers and skeptics, not leave the room as soon as some public figure challenges some or another point regarding your religious faith.

Jesus would have stuck around, and perhaps had some salient response regarding the morality of slavery, stoning, and tolerance of non-traditional sexual practices.

Concrete and Electricity along a Canal

Daily Routine

In a hospital room, the Daily Routine consists mainly of waiting.

The green beans were good.

“We are the supermen who sit idly by and laugh and look at civilization . . .”

I am reading a book by W.E.B. Du Bois, based on this quote which was captured in a photo of New York graffiti.

Even as America’s race problem has evolved since Du Bois published Dusk of Dawn in 1940, his perspective is valuable. A fuller excerpt from Chapter 6, wherein he conducts a Socratic dialogue with a pair of composite “White Man” colleagues, and delivers an excellent perspective on world history, and modesty:

“But the State; the modern industrial State. Wealth of work, wealth of commerce, factory and mine, skyscrapers; New York, Chicago, Johannesburg, London and Buenos Aires!”

This is the best expression of the civilization in which the white race finds itself today. This is what the white world means by culture.

“Does it not excel the black and yellow race here?”

It does. But the excellence here raises no envy; only regrets. If this vast Frankenstein monster really served its makers; if it were their minister and not their master, god and king; if their machines gave us rest and leisure, instead of the drab uniformity of uninteresting drudgery; if their factories gave us gracious community of thought and feeling; beauty enshrined, free and joyous; if their work veiled them with tender sympathy at human distress and wide tolerance and understanding — then, all hail, White Imperial Industry! But it does not. It is a Beast! Its creators even do not understand it, cannot curb or guide it. They themselves are but hideous, groping higher Hands, doing their bit to oil the raging devastating machinery which kills men to make cloth, prostitutes women to rear buildings and eats little children.

Is this superiority? It is madness. We are the supermen who sit idly by and laugh and look at civilization. We, who frankly want the bodies of our mates and conjure no blush to our bronze cheeks when we own it. We, who exalt the Lynched above the Lyncher, and the Worker above the Owner, and the Crucified above Imperial Rome.

“But why have you black and yellow men done nothing better or even as good in the history of the world?”

We have, often.

“I never heard of it.”

Lions have no historians.

“It is idiotic even to discuss it. Look around and see the pageantry of the world. It belongs to white men; it is the expression of white power; it is the product of white brains. Who can have the effrontery to stand for a moment and compare with this white triumph, yellow and brown anarchy and black savagery?”

You are obsessed by the swiftness of the gliding of the sled at the bottom of the hill. You say: what tremendous power must have caused its speed, and how wonderful is Speed. You think of the rider as the originator and inventor of that vast power. You admire his poise and sangfroid, his utter self-absorption. You say: surely here is the son of God and he shall reign forever and forever.

You are wrong, quite wrong. Away back on the level stretches of the mountain tops in the forests, amid drifts and driftwood, this sled was slowly and painfully pushed on its little hesitating start. It took power, but the power of sweating, courageous men, not of demigods. As the sled slowly started and gained momentum, it was the Law of Being that gave it speed, and the grace of God that steered its lone, scared passengers. Those passengers, white, black, red and yellow, deserve credit for their balance and pluck. But many times it was sheer luck that made the road not land the white man in the gutter, as it had others so many times before, and as it may him yet. He has gone farther than others because of others whose very falling made hard ways iced and smooth for him to traverse. His triumph is a triumph not of himself alone, but of humankind, from the pusher in the primeval forests to the last flier through the winds of the twentieth century.

So, my Bubbledar pinged when I saw this headline this morning:

http://allthingsd.com/20120409/woof-rover-com-fetches-3-4-million-to-be-airbnb-for-dogs/

Yes! Peer-to-peer vacation homes! For pets!

And then, this thing dropped, and my Bubbledar is pinging louder:

http://finance.fortune.cnn.com/2012/04/09/breaking-facebook-buying-instagram-for-1-billion/

Yes! A billion dollars for an iPhone app that takes pictures that look like Polaroids. But you don’t just get the app, you get the iPhone users who have been uploading their photos to social networking sites, because that is a key demographic that Facebook has yet to crack!

A few years ago, Zuckerberg thought $500 million would be a lot of money to acquire Twitter. Fun story here:

http://www.npr.org/2011/07/16/138160765/twitter-co-founder-biz-stone-plays-not-my-job

Above all science was becoming religion; psychology was reducing metaphysics to experiment and a sociology of human action was planned. Fighting the vast concept of evolution, religion went into its heresy trials, its struggle with “higher criticism,” its discomfort at the “revised version” of the New Testament which was published the year I entered college. Wealth was God. Everywhere men sought wealth and especially in America there was extravagant living; everywhere the poor planned to be rich and the rich planned to be richer; everywhere wider, bigger, higher, better things were set down as inevitable.

– W. E. B. Du Bois
… who entered college in 1885

Actually, Chapter 3 of “Dusk of Dawn” describes a transition from the world Du Bois was born into of the latter 19th century:

“(As) a young man, so far as I conceived, the foundations of present culture were laid, the way was charted, the progress toward certain great goals was undoubted and inevitable. There was room for argument concerning details and methods and possible detours in the onsweep of civilization; but the fundamental facts were clear, unquestioned and unquestionable.”

In contrast with the “today” of 1940:

“TODAY both youth and age look upon a world whose foundations seem to be tottering. They are not sure what the morrow will bring; perhaps the complete overthrow of European civilization, of that great enveloping mass of culture into which they were born. Everything in their environment is a meet subject for criticism. They can dispassionately evaluate the past and speculate upon the future. It is a day of fundamental change.”

I feel my heart and mind whipsawing between a world culture which is on the cusp of some fundamental, unimaginable change, and a world in which we will pretty much keep doing what we have done, just bigger, bolder, better, faster, with nanites and a higher rate of return . . . I get dizzy thinking about this world I try to live in.

And Religionists and Conservatives keep shouting their objections to a changing world ever louder, ever more viciously. They’re still attacking Evolution, so the concept and theological implications of Anthropogenic Climate Disruption are even more of a leap . . .

But the today of 2012, when the big revolutions appear to be how the European Union will manage debt among member states, and whether Arab countries can successfully democratize, whether there will be regional wars on either side of Asia, and the capacity of fundamentalists to kill civilians . . . today’s world isn’t tottering as obviously as 1940′s “today.”

But it is the Big Things you don’t hear in the news every day; When will climate change trigger famine and mass migration? Will China’s rise be sustained to the point it becomes a world power or will it implode? When are we going to be hit by that asteroid that superheats the atmosphere? Just after the devastating global pandemic that trained against antibiotics and traveled everywhere on jet planes before we noticed it? Will nanofabrication make industry and perhaps agriculture obsolete? Will the Singularity bring upon us a supra-individualist world consciousness? Will medical science and DNA repeal the eternal inevitabilities of aging and death? Is that when we will feel comfortable encapsulating our bodies on centuries-long trips to distant star systems? The new Magellans will refer to centuries as we refer to decades. My thinking is so early 21st . . .

These are the things I tend to wonder about between meetings at work.

Most of the time, Maggie isn’t big on laps, but today my legs offer a warm dry spot to enjoy a sunny break from the wet weather.

Our Frenchman flew over to San Jose from London, and wanted a picture with our American colleague in Tokyo.

Rockin’ the Cisco TelePresence!

Not only is this not an unsubscribe feature, LinkedIn gets bonus points for trying to sign you up for MORE e-mail.

Instead of screwing around with the half-dozen sub-menus again, I dropped them a feedback saying that this burns up good will, damages the brand, discourages me from engaging, and may in time lead me to delete my profile. There’s more than one way to search for resumes online.

Taken Jan 2, 2012, this is as close to a snowman as you’ll ever get in Mountain View, CA.

This triptych of a poem caught my eye from across a classroom at De Anza college in Cupertino.

Break time during a class at De Anza College, I wander across the room. The skyline . . . that’s John Hancock. I start to read . . . words written by Kevin Coval.

My home town, Chicago, the city of broad shoulders and ambition, is where the wealthy have pushed the workers and the workers have pushed back. Jane Addams, as my memory serves, founded the Hull House back in the 19th century, to look after the needs of working people: meals, health care, education, general community services. At a time when class divisions were sharper than they are getting to be today, Jane Addams bucked the conventions of her time to push for the American ideal: that we all, regardless of class or wealth, merit a helping hand, a warm place to sleep, and nourishment for our bodies and our minds.

Growing up in Chicago, getting educated in the Chicago Public Schools, the sense of perpetual struggle for a better, more equitable future, I think it gets in to your blood. People come looking for a better life, and they find that sometimes they have to push a bit to realize that better life, if not for themselves then at least to give their children a shot. We’re all passing through those gates, at our respective levels of society, and the struggle never dies and the struggle must never be forgotten.

Now I live in the Silicon Valley, where people struggle and strive, and while the ultimate aim is to make the world more comfortable and efficient, the focus is pretty far removed from the front lines of class warfare. Even so, I ride the train every day past miles of walled mobile home parks, and I wonder if there’s more going on beneath the surface than us privileged IT folk know.

A quote from Al Franken, via The Sun:

“In her book A Distant Mirror: The Calamitous Fourteenth Century, Barbara Tuchman writes about a peasant revolt in 1358 that began in the village of St. Leu and spread throughout the Oise Valley. At one estate, the serfs sacked the manor house, killed the knight, and roasted him on a spit in front of his wife and kids. Then, after ten or twelve peasants violated the lady, with the children still watching, they forced her to eat the roasted flesh of her dead husband and then killed her. That is class warfare. Arguing over the optimum marginal tax rate for the top 1 percent is not.”

Arguing over the margins, in the grand scheme of things, describes my day job.

and we need heroes
who stand up to giants
who carry a big bat to home plate
though the pitcher is throwing money
balls and the umps are in on the fix.

I’m no hero and my bat is nothing to brag about, but I relish those occasions when I do get to step up to the bat and swing, however ineffectually, at a ball I’m not allowed to hit. Its the Chicago in me. I owe more.