What’s a backup solution?

I don’t know about you, but I’ve been listening to stories of lost data, drives and machines for what feels like an eternity. For example, Googlers reported in 2007 hard drive failure rates of about 8% per year in their datacenters.

Data security and integrity is very important, indeed many enterprises would not exist today without taking it very seriously.

Personally, I employ the following tools in my day-to-day backup strategy:

  1. Dropbox for lower-security/non-sensitive data I would not mind becoming public. Dropbox is excellent for cloud storage of personal data, easy to use (allowing me to be more productive), and free up to 2GB, which is more than I need. Regarding security…I have no idea how you break an authentication system for 4 hours such that it lets anyone in…
  2. Wuala for more personal/sensitive data I need access to on the go. Because Pre-Internet Encryption (PIE) is important if you want data to remain private. Dropbox has access to my unencrypted data on their servers, or if not that, then they have access to the key to decrypt my data (which is why their web-interface file download works without needing a Java app). My understanding is the FBI, AFP or other law enforcement organisations could in theory ask or perhaps even compel Dropbox under court order to release these files. Wuala never gets my key, all they get is an AES128-encrypted blob of data which would take something on the order of the power of the sun to brute force (math to come in a later post now I’ve been reminded). So the AFP would simply need to ask me directly – which they should do in the first place 🙂
  3. Carbonite for off-site backup of my main home system (subject to upload speed limits, which in Australia is still unfortunately quite limiting…I dream of NBN speeds). Still I’ve managed about 100GB stored securely which is most of the documents, photos, music and video that is important to me. And the 3 year deal is a huge discount!
  4. Windows Home Server for a complete onsite backup.
  5. Truecrypt and USB keys/CDs/DVDs for the super-secret stuff I have legal obligations or just want to keep secure and safe. I mean it could be a planted story if you’re uber-paranoid, but I’m pretty happy because implementing your own industrial-strength crypto-system is something for the true math geeks out there (I’ve only toyed with simpler things like a Feistel Cipher for uni courses thus far)….and it would be quite the notch on your CV if you discovered a bug in Truecrypt’s implementation !

Well #5 isn’t truly day-to-day, but I use it regularly enough it’s part of my strategy. I keep thinking I should be a little more paranoid … but even if the worst happened and I did lose everything, I’d just have to start again and the brain that created it all would probably still be here in good working order 🙂

Sometimes we choose to be a little less paranoid and far more productive and efficient.

I always seem to forget to blog…

Which is why I should do so more. You know, practice written communication skills, seem organised and on top of things (though I don’t recall missing an assignment deadline or copping a late penalty in the last 4.5 years of uni…bonus marks excluded because sometimes they are ridiculously hard and thus fun, but not necessarily solvable)

One thing I should have blogged a week or so ago was the sheer joy at being reminded of:

#define char UINT8

Now…this line was written by one of my professors for COMP343 Cryptography and Computer Security  @ Macquarie for a project early last year. No one in the class could figure out why our simple cryptalg.cc was simply not producing the results we expected when compared to a desk check of the algorithm, though a tutor spotted it early enough on he never explained why his fix worked.

Have a think about the above line, is it correct?

While you think, a little on the trigger SN311 and the tweet:

@leolaporte @SGgrc RT @slashdot: 13-Year-Old Password Security Bug Fixed http://bit.ly/luI3gJ

The signed/unsigned thing has been biting programmers for a looooong time in languages it is relevant to 🙂

If you haven’t figured it out (probably because you aren’t a coder), the following line probably won’t help greatly either:

#define char UINT8

#define unsigned short int UINT16

Even the first year programmers should be able to see the issue by now – char by default is a signed data type in C. Thus one fix in this context is:

#define unsigned char UINT8

This and other quirks of C are why personally, I prefer Python, Java, Scala and even C# far more than C/C++ these days (though there are times when C/C++ is useful and it was the first real programming language I learnt). Today the performance argument is almost moot, even Cassandra was written in Java. It feels like it has long been argued that programmer time is more valuable than computer time – to the point that internet behemoths like Google, Amazon and Yahoo have huge farms or datacenters of thousands upon thousands (if not millions) of servers and far fewer employees.

Adding G+ to a SquareSpace Site

Simple.

  1. If you haven’t added a Social Links Widget, now would be a good time.
  2. Download the G+ icons and choose the one you want.
  3. Under Website Management > Data & Media > File Storage > Upload Files, upload the icon.
  4. Get the icon’s URL, something like:

    But you should use the relative URL in case you change the domain name sometime in the future:

    storage/g-plus-icon-16×16.png

    But this doesn’t work if you need the widget to be consistent across multiple pages with different URLs (like About Me and the homepage/root URL)…if anyone knows a better solution than absolute URLs, let me know 🙂

  5. Under Website Management > Members & Accounts > Member Accounts > (Select your account) > Social Profile, add the following:
  6. Congratulations – just remember to verify you got it right 🙂

     

Thanks +Sean McGabe of Bold Perspective for the free Google+ icons.

http://boldperspective.com/2011/free-google-plus-icon-vector/

Final take on hover.com storing passwords as plaintext – and why I don’t plan to switch

TLDR: The community demanded a fix, and hover.com have fixed the issue, and without to the best of our knowledge disclosing any personal information or customer passwords to any third parties*.

* Yes your email provider will know, and possibly some routers your traffic passed through (such as your ISPs). Change your password now and it’s minor problem solved.

Security is an easy thing to make a mistake on, and a notoriously difficult thing to get right even when everyone is trying really hard.

A security mistake can and does happen to the best in the technology industry. When I boot into Ubuntu Linux and Mac OS X, I’ve seen both needing patches every other week. Skype (pre-Microsoft acquisition) allowed users to be rootkitted on the Mac. I see Microsoft shipping updates to fix bugs in their operating system every month like clockwork. Even Google got hacked by China. RSA had their SecurID tokens compromised.

Tucows has been around since 1994, and is the parent of hover.com, created in 2008 through the merger of their 3 domain registrars – NetIdentity, It’s Your Domain (IYD), and Domain Direct. That’s a lot of legacy, things like as they said, needing telephone support. Even the best developer needs some time to test their code, and changing an authentication system which could adversely affect millions of users needs thorough testing.

Today it is very hard to defend the practice of storing a customer password, and I don’t and won’t. Neither does Ross Rader, Hover’s GM. Strong cryptographic hashing is a requirement for any modern website, and hover.com is clearly working hard on that transition.

Ultimately, it needs to be placed in perspective. The threat to me is similar to that of all Django sites using SHA-1 by default, which is considered “weak” as the best known attack has a theoretical complexity of 2^51 hash function calls. It is a possible and unnecessary risk, and in general to be avoided, but far from a proven breach of security.

I first alerted Hover to this issue when I first used them – on July 2, 2011 (Sydney, Australia), as part of my first real attempt at having a presence I control online (shout out to Leo Laporte – go TWiT). I was catching up on Security Now! Episode 306, when I heard something a monkey could likely be trained to do (and thus also likely a malicious crawler/script roaming the net):

“Marc Beaupre in Montreal, Quebec said one way to know whether the site stores your password in cleartext is whether they send the password itself when you perform account recovery”.

Trying and finding hover.com vulnerable, I gave them 2 months which I deemed a reasonable time to communicate and have them understand the threat and update their systems (though I’d be interested in what is a reasonable time, especially from people who have implemented an update like this).

Dear Hover staff,

Please forward this ASAP to your security and/or web site administrators.

Hover.com’s password recovery service (see anonymized forwarded email below) is sending me back my password in plain text. This strongly suggests that Hover is storing my password as plaintext. If Hover’s password file/database ever fell into the wrong hands (e.g. ex-employee, hacker), these passwords would then be known to the attacker.

The password recovery at https://www.hover.com/send_password (+1 for HTTPS) should, upon verifying a user owns the registered email address, allow the user to change their password to something of their choosing. It would be recommended by Security Now netcast listeners that BCrypt, SHA256 or SHA512 be used many times with one or more random salts; to store the password hashes (and thus never the plaintext passwords) more securely.

NOTE: In the interests of security, I will only be sending this on to Steve Gibson of GRC through the form available at http://www.grc.com/feedback.htm 

I will not be publicly disclosing this unless it has not been fixed 2 (two) months from the send date of this email. I’m sure Steve will also behave responsibly and I and the other 100,000 or so Security Now listeners would be interested in the outcome of this.

Thanks to Marc Beaupre for the core idea.
From Security Now! Ep. 306, transcript http://www.grc.com/sn/sn-306.htm
“Marc Beaupre in Montreal, Quebec said one way to know whether the site stores your password in cleartext is whether they send the password itself when you perform account recovery”.

Best regards,

Peter Schmidt
****

———- Forwarded message ———-
From: Hover System <passwordrecover@hover.com>
Date: Sat, Jul 2, 2011 at 10:19 PM
Subject: Your Hover.com Password
To: ****

Hello,

Your Hover.com username is **** and your password is ****

Please note: This e-mail message was sent from a notification-only address that
cannot accept incoming e-mail. Please do not reply to this message.
Thank you for using Hover.

Sincerely,

Team Hover

 

(Personal details omitted)

I honestly didn’t know of the HackerNews post on July 5 until today (and have been quite sick and more interested in my honours thesis the past couple of weeks), and I think others likely have pointed out the issue as well. Since they claim to have been working on it since last Spring and implemented their final fix in 48 hours, it is good that the community effectively jolted them into action sooner.

Since I use a password manager, I don’t really care that a >20 character monster once-used random password may have possibly gotten loose, and again the issue has been fixed. For those who have been using Hover for a little longer or may have reused their Hover password elsewhere, it’s always a good idea to change your password once in a while.

Hover, to their credit and to the best of our knowledge abide by their privacy policy. Unlike other domain registrars who shall remain nameless, they claim and so far have proven they won’t upsell for necessary features like WHOIS “privacy protection”, or sell my personal information to third parties so they can target ads at me.

Hover, with Tucows legacy is also a very-well established provider with clear policies and procedures, which is important. I’d frankly like my domain registrar to be predictable rather than capricious or sexy – it’s infrastructure which should be boring and dependable.

For the above reasons, I’m not planning on switching unless someone suggests an alternative that is clearly better, and so far I haven’t seen one. That doesn’t mean I’m not open to the idea, and to the community at large – please feel free to suggest better alternatives if they exist and provide evidence of their past track record with regard to security, privacy and usability.

 

Remember, we’re all still human, and there are always slower fish, “mom & pop” sites, and so forth out there – for example http://itestate.com.au/ doesn’t even use HTTPS for customer logins (which is why I’ve only ever paid on pickup if I needed some cheap PC stuff from there). Not everyone should need to be a security expert just to have a site on the net, but sadly that’s the trend if you don’t outsource the hassle to someone else like SquareSpace.

Like most things in security, it’s far too easy to let little things be blown way out of proportion. While I’ve cut my share of Java, Python and C# code, I haven’t personally implemented Django BCrypt or something similar so I don’t know how hard it really is and what the pitfalls could be, let alone migrated millions of user accounts, or had to consider issues like malicious users with motives attempting account fraud. Full credit to Ross Rader for handling the issue amicably.

And if you’ve read all that, my sincere thanks because this is really just a post for selfish old me – so I can be clear in my head what really went down.

Cheers,

Peter

Teething issues?

It’s probably just me…I seem to have a talent for finding edge cases and issues with things 🙂

SquareSpace’s blogger.com importer doesn’t seem to be working for me, have sent a ticket and will see what drops out. My guess at this time, having gone through their post and video relating to Importing Blogger Entries – it’s related to my turning on 2-step Google authentication. 

Time will tell, worst case – I export 16 or so posts manually.

Moving

To peterjs.com

So I’ve decided it’s high time to finally move off Blogger onto something more powerful and customisable. Normally I’d take the time to consider a large number of competitors in the industry, you know – evaluate different solutions for their strengths and weaknesses.

But since it’s basically just for me, I planned well for this year of honours study and well we can really only make so many decisions in great depth, I’ll +1 ThisWeekInTech (TWiT) and go with hover.com and squarespace.com

So far, pretty painless 🙂

Now of course there are other things on the to-do list, like redirecting Twitterfeed, performing the full import, and building something of my own instead of a hastily modified SS template, verifying email addresses work and pipe into GMail and so forth, but on the whole very happy so far.

REMIX11 Sydney Highlights

Vaughan Knight “Game on with HTML5” was IMHO the star with this gem of JavaScript (serendipitously discovered of course):

while (zombies) {
    run();
}

He demoed how easy it is to use HTML5 game development frameworks to build cool stuff, and fast too.

Russ Weakley “CSS3 is everything we used to do wrong?” of Max Design gave a very solid presentation on how much he loves CSS3, how it’s another powerful tool for the arsenal (but like all tools – there are the right times and the wrong times to use it), the importance of object-oriented CSS and knowing CSS2.1 thoroughly before a deep-dive into CSS3, and how to make a site’s CSS more faster and more maintainable through resets, frameworks and other neat tips.

Aaron Powell “Chasing the evolving web: things you need to know to be a web developer” explained with live code demos how to actually use JavaScript’s this in different contexts (something like that featured here):

var x = 10;
var o = { x : 15 };


(function f(){           // self invoking function f
   console.log(this.x);
})();


f();                     // Global variable x
f.call(o, “foo”, “bar”); // Takes any number of additional args
f.apply(o, [“bar”]);     // Must have array as 2nd parameter

And other little titbits like how CoffeeScript compiles to JavaScript and how JavaScript functions can be polymorphic in that they can rewrite themselves from inside.

Speakers here if you’re looking for more info.

I’d definitely recommend REMIX to anyone looking at the future of web development…now how to make it to Melbourne next year?

PREMIX11 – Keynote to REMIX11 – Highlights

My first time at the web conference REMIX – Sydney 2011, and PREMIX is apparently having its first year (REMIX has been running for four).

I’d say pretty good so far, the keynoters (not quite speakers – but I’ll explain) were excellent.
  • Mr Percival is a wizard of sound, not my kind of music but very superbly performed and very entertaining. Not sure how to explain this, but he used real-time recording and playback, then sang to the playback. A few iterations of this and his track is sounding like it’s recorded by a half-dozen people at once. My guess is excellent use of a shotgun microphone and/or some great software and hardware behind the scenes.
  • Dan Ilic, self-styled hypocrite (working in network television); of Hungry Beast fame is predicting that TV will be dead by 2013 due to the rise and rise of internet TV with companies like Next New Networks.
  • Gordon Bell of Microsoft Research gave a presentation on his fascinating MyLifeBits project – could you record everything a human being has ever experienced? I got the impression he was predicting that by 2020, it may even be the norm.
  • And well it wouldn’t be a Microsoft event without some Windows Phone 7 and Kinect goodness. Looks like some really cool stuff coming down the pipe – there was a hybrid dancer / musician who performed on a good dozen instruments for our pleasure, and a tech demo of a high quality CAD of a Toyota concept car, running in real-time, e.g. the demo guy changed the colour, rotated at will and what looks like exploded the car…by which I mean the car parts flew out in several directions so you could see how they fit together. There was also a Qantas WP7 app which really reminded me of Paul Thurott on Windows Weekly – the phone is really designed around the user more than the corporate brand. It’s looking like it will be more and more difficult for me when my Android phone contract comes up for renewal soon enough. 
I’m happy I decided to go after all, and hey – free food, drinks and networking is always good as well!

Chrome to Phone is awesome

Soooo fast, and cool!

More details via the official Google Blog:
http://googleblog.blogspot.com/2011/03/20-percent-time-spent-coding-in-clouds.html

Starting to get a little scared though, if Froyo is the requirement, hopefully Gingerbread/Honeycomb don’t become requirements too soon for these new features (or HTC and Telstra update more frequently). Still this was heartening:
http://www.androidcentral.com/three-uk-suggests-original-htc-desire-will-get-gingerbread-update

CSE Camp – Epic bus fail, broom game, newspaper towers and internet memes

It’s been about 6 years since I’ve had the pleasure of being on a camp, the last I can remember was a Year 11 Thredbo/Jindabyne trip. So ending yesterday, for a little over 48 hours CSE@UNSW first years, and me since it’s my first year at UNSW, were at Wombaroo Adventure Center in the southern highlands about half way from Sydney to Canberra, Australia.

Internet Memes
The theme, one pretty awesome one. I just couldn’t resist going as Happycat (pics may come later). Memes in attendance (by Ben Pinto):

Pirates vs ninjas
Im on a boat
Portal
Troll science
Trollface
Fffffuuuuu
F**k yeah
Forever alone
Anon
Milhouse is not a meme
Lolcat
Domokun
Luigi
Goatse
Mac vs pc
Wonka bar
The ring/ grudge girl
Charlie the unicorn
Shamwow guy
Old spice guy
Hello world
Dancing star wars kid
Hide yo kids guy
Double rainbow guy
Leekspin
Dickinabox
Engineer (teamfortress)

The engineer won the award for best costume…not sure I agree since Callum’s PC was epic but that’s democracy for you.

Broom Game
Simply put – hold broom and face upwards, spin 15 times then jump over it. Your inner ear’s motion detector will deceive you – good luck! (Not me but some of those who participated – the end is a must see :- )
http://www.youtube.com/watch?v=zwgXt6Lr5BE

Newspaper Towers
aka Fun with Newspaper. The Australians were by far the best general building material, literally just separate, roll up and build up. You learn quickly the best ways to build things like rope to tie things together.

The two most successful teams maxed out their towers to the 4 m ceiling using tripod-based designs with a spire on top. One other got very close with a spire like a knight’s jousting post on top of a 3 very solid base rings of compacted newspaper. Guess which one I was 😉

Epic Fail Bus
Well ’twas begging to have little more than the chance of a wee snowball in the fires and brimstone of hell. A little context and story:

  • Driver tries to start bus on slight slope at Wombaroo. Driver fails a couple of dozen times, including rolling backwards several meters (luckily no one was back there).
  • Driver finally succeeds in starting the engine for more than 15 seconds, gets the bus up the incline. This is over 30 minutes after we should have left!
  • Bus breaks down at least twice on the freeway (I dozed off so it may have been more).
  • Driver decides to continue following M5 into the longest and most congested tunnel in Sydney (and possibly still the world), despite his engine trouble.
  • Driver continues in the right hand lane, starts off well on the tunnel descent.
  • *Kffppppphh*…*splutter*…*cough*…*bang*…and we’re coasting to a stop.
  • Driver attempts a restart a good dozen times before giving up.
  • Realisation of being (semi) trapped inside a bus inside a 4 km tunnel with hundreds of cars passing very close sets in for some team members. I feel for their claustrophia.
  • Some 15-20 mins in, a redirecting sign truck arrives behind us.
  • To great applause, 52 minutes in, we greet the tow truck…
  • Only to wait another half hour to be fully towed out!
  • And another 20 minutes trapped inside on the side of Marsh Street, or thereabouts. But at least with fresh air through the top air vents…some compared it to being reborn or other life changing experiences. Quite the saga.
Clearly the cases of:
  • the forgotten sleeping bag (yes someone slept the entire night before discovering their sleeping bag was actually right where it should have been), and 
  • the 7 am fire alarm (don’t go playing with circuit breakers at 4am, you don’t know when the cabin battery power will run out)
were awarded camp’s “Biggest fail” far too soon. Everyone scored a trophy – the limited edition purple cake camp shirt.
In summary: