Blog

  • Installing Ubuntu 14.10 on a Dell R630 with PERC H730 hardware RAID 10

    If you arrived here, you’re probably spending your weekend doing this too, so perhaps I can save some of your weekend for you. Here’s how I did it. FYI, I’m using a PERC H730 hardware RAID controller with a 1.1TB virtual disk made up of 8 physical disks in RAID10 config. As the title says, this is a fresh DELL R630 and it has single processor and 128G of memory. See my notes below about using a 100g boot partition and creating a larger partition once you have the system up and running with grub installed in the MBR.

    • Switch the BIOS boot mode from UEFI to BIOS.
    • If you’re booting from a USB thumb drive, set that to your first boot device.
    • Boot and hit CTRL-R to go into your raid controllers bios and blow away the virtual disk. Recreate a new identical one. You’re doing this to get rid of the GPT partition.
    • Boot into ubuntu 14.10 server 64 bit.
    • Go through installation and make sure you install openssh server because you won’t be able to access the console when you first boot.
    • Also make sure that when you partition your disk, you don’t create one huge partition larger than a terabyte. Instead, you probably want to create a boot partition and then a larger partition. I use 100G boot partition and 1TB big partition which I create once I have the system up and running. When I tried to create a 1.1TB partition it has trouble installing grub into the MBR. Using UEFI or a GPT partition table might fix this but I haven’t gone down that rabbit hole and don’t really want to.
    • The grub installation onto the MBR will fail. This is because if you’re installing from thumb USB, ubuntu switches the /dev/sda and /dev/sdb devices and tries to install grub onto your thumb drive instead of your hard drive. To fix this hit CTRL-ALT-F2 open a console, then run the following:
    • chroot /target
    • grub-install /dev/sdb
    • update-grub
    • Then hit CTRL-ALT-F1 and go back to your installation.
    • Continue without installing a boot loader (because that’s what you just did).
    • Once done, when you reboot, go back into the bios and disable booting from your thumb drive (or just unplug it if you’re not doing this remotely like I am).
    • Boot into linux, except that all you’ll see is a blank screen at this point.
    • SSH into the server.
    • Edit /etc/default/grub
    • Change the value of GRUB_CMDLINE_LINUX_DEFAULT to be “vga=normal nofb nomodeset video=vesafb:off i915.modeset=0”.
    • Run update-grub2
    • Reboot and your console should now work and also won’t freeze up.

    Congrats, I just saved you a few hours. Go enjoy them.

  • The FAA needs to get their hands dirty to enable UAV innovation

    In the 1970’s and much of the 80’s, passengers on commercial aircraft would occasionally experience the joy of the ‘holding pattern’. Having their plane stacked with other planes circling in a spiral due to a delay at a destination airport. Planes would circle sometimes for hours, with priority given to those about to run out of fuel.

    Then in 1981 the FAA used a ground delay program (GDP) for the first time during an air traffic controllers strike. The advantage of keeping airplanes on the ground at their departure airport was immediately obvious: passengers are just as unhappy, but they’re safer and the aircraft isn’t burning fuel at 161 lbs per minute (or 73kg per minute for the 767) in a holding pattern. Today the ground delay program is run by the  Air Traffic Control System Command Center, in Warrenton, Virginia which coordinates commercial flights around the USA and Canada and implements a GDP for destination airports if their arrival rate drops below a threshold.

    The FAA is catching a lot of heat for their delay in implementing UAV (or drone) legislation. The drone pilot part of me sympathizes with the public and I think what is particularly frustrating is that a small handful of commercial operators have actually been granted licenses to operate giving them an unfair advantage over other operators. The article in the Denver Post today probably stung a bit among unlicensed operators when one of the already-licensed operators described the FAA’s pace as “about where it should be”. Sure, it works for them.

    But the private pilot part of me – and the aviation history enthusiast part of me is sympathetic towards the FAA’s plight. Make no mistake, I think we should bringing as much public pressure to bear on them as we can. In the legislative environment we’ve inherited that’s the only way anything will get done. But this country has a long and storied history in traditional aviation and we have achieved a remarkable improvement in safety by creating well engineered solutions for specific problems. A glance at the chart below showing safety from the 70’s until 2012 illustrates that. [Source: The Economist on air safety and MH370]

    20140315_gdc500_0

     

    The FAA is not asleep at the switch – they are continuing to innovate and improve safety and efficiency with the rollout of the Next Generation Air Transport System which started in 2012 and is due to complete in 2025. Part of this rollout was support for ADS-B which is just about complete. This remarkable system gives everyone including hobby pilots like you and I the ability to buy an $800 transceiver, attach it to our iPAD and get real-time traffic and weather data as we fly anywhere in the USA while sharing our own position with other pilots and air traffic control. Previously you had to buy expensive avionics systems and a subscription to a commercial provider’s satellite feed.

    Unfortunately we are stuck, while we wait for formal FAA legislation, using an FAA advisory circular (91-57) that applies to radio control model aircraft as our legislative guide. It says, don’t fly near populated areas, don’t operate near spectators until you’re sure your aircraft works, don’t fly above 400ft, don’t fly near an airport without notifying them, give way to full scale aircraft, ask the FAA for help if you need it.

    Comparing a model aircraft to a drone is like comparing the Wright Flyer to a 767. One has wings and an engine. The other has GPS, avionics, autopilot, gyros, accelerometers, real-time ground station connectivity, real-time logging for later analysis and flight modes ranging from fully-autonomous to the pilot having an advisory role with the computer taking over when needed – to fully manual. (I am comparing most newer commercial long range aircraft with the IRIS+ by 3DRobotics for $750).

    Most drone innovators are very excited by the prospect of being able to fly their aircraft out of sight autonomously. Whether it’s Amazon wanting to do package delivery, a survey company wanting to offer services to farmers or me wanting to deliver beer to my friend a few blocks away. Autonomous flight is the most useful aspect of drones and they are very very good at it. I can go outside right now and get my IRIS+ to fly 3 miles away at 390 feet, descend to 60 feet, point the camera on gimbal at my friend’s house, circle the house in a smooth spline navigation path as it films the home, ascend back to 390 and return to me and I can get telemetry via an excellent 900 mhz transceiver from the drone the whole way and even take over manual control if I feel the need. But that’s not allowed because the FAA won’t let us fly out of sight until they make laws which may simply formalize the fact that hobby drones can’t fly out of sight.

    The USA is filled with tech innovators that are salivating at the prospect of trying out new things with drones – things that may drastically improve our quality of life and safety. I’m reminded of the horrific King5 news chopper crash a few years ago in Seattle which killed 2 and burned a third victim. Today that job can be done by a drone costing under $2000 – filmed in 4K video, gimbal stabilized with real-time first person view as film is being shot. With an amateur radio FCC license the operator can legally boost the drone telemetry and video signal from 0.2 watts to 10 watts with a high gain antenna and increase range to the point where battery life is the only issue.

    But autonomous flight innovation of that kind is banned and the only laws we have to guide us right now are an advisory circular relating to model aircraft and public statements by the FAA. Some operators are saying “to hell with it, we’re flying” as is the case with Texas EquuSearch. The search and rescue operator was issued a warning by the FAA, they then turned around and sued the FAA and a federal court threw out the case saying that the email the FAA sent EquuSearch did “not represent the consummation of the agency’s decision making process, nor did it give rise to any legal consequences.”. EquuSearch have interpreted this as the FAA having no jurisdiction and so they have decided to continue flying.

    In my view the FAA must be very careful to not treat drones like manned aircraft because they risk band-aiding the situation and crippling innovation. They need to look at the modern air space systems and innovations that have worked there and then assess drones as unique and completely different entities that happen to exist within their jurisdiction. I think giving everyone from hobbyists to commercial and government operators the ability to perform out-of-sight autonomous flights is a very important and necessary goal if they are to be an enabler of innovation rather than being a crippling force that ensures we aren’t competitive in this new arena of aerospace.

    It is essential that this country (the USA) maintains its dominance in aerospace and we worked incredibly hard to get to where we are today – from the Wright Flyer to breaking the sound barrier, to getting our asses kicked by the Soviets when they made it to space first, but we regained the lead by getting to the Moon first. Then on to Stealth technology and military UAV’s. We’ve managed to stay out in front. To do this we need to enable the private sector to conduct research into autonomous flight and the private sector includes individuals and small groups of entrepreneurs. We need to enable them and we need to do it as fast as possible.

    To allow autonomous flight I would propose a system similar to DUATS which pilots today use to file flight plans. The FAA should create a system whereby drone operators at defined levels of competence and commerciality are able to file a flight plan before flight. The plan would include waypoints with latitude, longitude and altitude. The flight plan would be filed an hour before flight and define a window for the flight. It would also be approved on the spot or rejected due to a conflict with another plan, temporary flight restrictions (TFR’s) or an airspace conflict.

    I would suggest that a system like this could be used for autonomous flights under 400 ft in open areas. With additional licensing operators should be able to enter our national airspace system which starts at 500ft and this may include additional equipment like an ADS-B transceiver. And with further licensing, as with the current pilot requirement of an instrument rating, pilots may be able to complete autonomous flights above 18,000 feet.

    To truly enable innovation in autonomous flight, the FAA can’t simply bandaid the existing system. They need to be an enabler and create new products and services to support drone operators and ensure that, as we have with manned aircraft systems, innovators are able to improve safety, efficiency and quality of life with unmanned aircraft.

  • OS X 10.10 Yosemite WiFi Problems Analyzed with Wireshark

    I never realized how often I google and how much I rely on sub-second response times until I upgraded my Macbook Pro to OS X Yosemite. After muddling through issues like upgrading VMWare and a few other items and fixing my terminal emulation, I couldn’t figure out why I was in such a bad mood.

    Then it hit me. My Google searches while I had been doing that had been slow. I would type something in and Google’s search results page either would not appear for about 3 to 6 seconds, or it would half-appear and then the search results would only show up after 3 to 6 seconds.

    There is so much garbage SEO bait out there about “what to do about Yosemite wifi problems” so I’m not going to bore you with the details of my investigation and I’m just going to cut straight to the chase:

    I put a network analyzer on my wifi. It turns out that the problem appears to be duplicate packets arriving on the WiFi network card. I switched to Ethernet via the Thunderbolt adapter and the problems instantly went away.

    Here’s what it looks like in Wireshark….

    Screen Shot 2014-11-13 at 2.21.31 PM

    What happens is the network card transmits an acknowledgement. Then there’s a 2.7 second freeze where nothing happens. And then a few packets arrive followed by a flood of duplicate packets.

    The duplicates are both duplicate application data packets along with duplicate TCP acknowledgements.

    Scrolling further down you can see the duplicates increase and Wireshark starts labeling them “TCP Spurious Retransmission”, implying an issue with a network interface on the network.

    Screen Shot 2014-11-13 at 2.23.50 PM

    Another test shows exactly the same thing. A 3.1 second delay where I’ve highlighted in blue and then a few good packets and the duplicates start.

    Screen Shot 2014-11-13 at 2.30.26 PM

    And then the frequency increases…

    Screen Shot 2014-11-13 at 2.31.38 PM

    Deleting and re-adding your wifi network or network card device does not fix this. Neither does some of the other suggestions out there like turning off bluetooth, joining a 2.4 Ghz network instead of 5Ghz, etc…etc..

    To me this seems to be a driver issue where the network card freezes and when it comes out of the freeze it’s sending the OS large numbers of duplicate packets. It’s curious that the freeze is around 3 seconds each time.

    This test was done on a: MacBook Pro (Retina, 15-inch, Early 2013). The only other software running while this test was being done was Chrome, Excel, X11, Wireshark, Terminal and Keyboard Maestro (a keyboard macro utility).

    Writing this post after the test was done on ethernet and I can feel my sanity already returning.

    Apple please fix. Thanks.

     

  • Startups that Move the Needle

    Something that I’m becoming more cognizant of and that I see in my friends as we all get a little older is the question about whether what we’re doing is actually moving the needle for the rest of humanity. If it’s making positive change by enabling our species or improving quality of life for others.

    My business is cybersecurity and the biggest positive impact I see is when we help mom and pop or small businesses keep their websites and businesses secure. But I question whether we can do more. I think Elon’s SpaceX and Tesla moves things forward for our species as a whole.

    An old friend arrived in Seattle this weekend. He has a really exciting startup based in Europe and is one of the most persuasive and energetic guys I know. It’s his second or third time in Seattle, ever – he doesn’t even live in this country – and  we show up at the Black Keys concert, sold out show on Saturday night at Key Arena, he walks up to security and talks us into a sold out show without any bribes or cash changing hands.

    So in between rocking out to Black Keys and then hitting a Bollywood party in Freemont, I learned about what he’s been doing for the last few years.

    Oradian creates software for banks in developing countries to do what banks do. Most of their target market is either using paper or using antiquated systems that are cobbled together and run on an old PC or laptop. Oradian provides a cloud based core banking system that gives banks a way to drop in an IT solution and get up and running fast.

    My first thought was skepticism that a bank in a developing country would have access to the Net. But Antonio has been on the ground selling directly into these organizations and markets for a few years (he was previously in micro-finance) and because of the heavy reliance on cellphones in these markets, the Internet is more reliable than the power grid.

    They’re currently raising series A in the USA and Europe and it’s interesting hearing his perspective and seeing other companies that are raising in Seattle and the Valley. I think there are other exciting businesses out there that are moving things forward, but there are so many that are spending precious energy on attracting a few more clicks or a few more eyeballs and I’m not sure how they help make the World a better place.

    It’s gotten me thinking about how we measure success and gauge whether something is a great idea or not. I’m not sure I’ve ever seen a startup appear on the West Coast that has a for-profit model that has the potential to make positive change in developing countries. I grew up in South Africa (as did Antonio, Oradian’s CEO) and we’ve seen and continue to see first hand how important it is to create a strong middle class in developing countries that is empowered with commercial opportunities and the services that surround them in the form of banking.

    I’d like to see more smart people thinking about this space and if Oradian is anything to go by, my sense is that there are opportunities in the developing World that can be both profitable for investors and make significant positive change.

    Edit: Found this video which gives you a better idea of what Oradian does…

  • 4th of July Post

    Posted this on Facebook today and felt like cross posting it here.

    I feel obliged to post this after seen all the posts in my timeline connecting patriotism with the US military. There are ways to express love for your country without expressing a love for war or the machine that wages war.

    Omitting an expression of support for your country’s military is not unpatriotic. Neither is criticizing it. The last three decades have seen the US at war in Libya, Grenada, Panama, Iraq, Somalia, Bosnia, Haiti, Kosovo, Afghanistan, Iraq (again) and Libya (again). On what’s left of this independence day weekend, consider that citizens of other countries are patriotic too. Try to remember that we’re part of a global whole and every citizen of Earth has fears, hopes and dreams and they too are proud of their history and would prefer that it remain intact.

    Consider that the idea that we keep American families working on peaceful private enterprise on US soil instead of dividing them through military deployment is also a patriotic goal.

    Remember that a quarter of world military spending is what we spend on our own war machine.

    There will always be evil in the world and fighting evil will always create jobs and new wealth and those jobs and that wealth are missed when they’re gone. But at what cost do we go looking for new wars? At what cost do we glorify the military industrial complex as part of what makes us American?

    On what remains of this fourth of July weekend, remember that old maxim: That you should treat others the way you want to be treated. And lets instead celebrate our open culture, our freedom of speech and our freedom to choose who governs us, whether they wage war and how they treat others on our behalf.

  • Liars and Geniuses – Thoughts on Live Jazz

    There’s something about Jazz live performance that has bothers me and I think it’s the audience. It’s the beatific smiles on many of the faces that last through the entire performance – smiles that remind me of a congregation in a church that know that it’s the wanting to believe that matters most, not whether it’s true.

    It’s the guy in the front row with his index finger at shoulder height pointed at the roof bouncing it back and forth to a rhythm all his own.

    Jazz performance appreciation – to truly understand live jazz greatness when you see it in the flesh – is the epitome of musical achievement. To understand how a group of musicians anticipate each other’s switching from one complex time signature to another, move fluidly and rapidly between keys and throw in a little used mode to add some humor or a chromatic run which morphs into another key – or to understand when the musicians are reverting to a jazz standard or improvising something new and truly great – to understand all of this, you have to be an accomplished musician. Someone who has spent thousands of hours either studying or performing or listening.

    I think those that claim live jazz appreciation are either liars or geniuses.

    I listen to Rock.

  • Where the term "Zero Day" comes from

    After seeing a FOIA request earlier today that someone created asking for FBI training documents that teach staff how to understand/communicate using hacker leet-speak, I was reminded about something I’ve wanted to put in virtual ink for a while.

    Leet speak or 133+ sp34k or hacker speak did not actually originate with hackers. Neither did the term “zero day”. Back in the late 80’s and early 90’s the Internet was but a pup and most of us communicated via BBS – a dialup modem (often a bank of modems on popular BBS’s) attached to an individual’s PC that members dialed into to connect. [We also used something called Prestel or Beltel which was essentially a big government run BBS]

    Phone calls were expensive in those days so if you wanted to connect to BBS’s far away – and at the time I lived in South Africa and the best BBS’s were in the USA – then you needed to become a phone phreak. So I’d fire up a piece of DOS software called Bluebeep (created by the venerable Onkel Dietelmeyer), hold a headphone to a phone mouthpiece, generate CCITT5 tones and take control of international phone trunks to get free overseas phone calls. [I’d also hack into the Post Office X.25 network to get access to an overseas modem (a DTE) which I could then control with AT commands. X.25 was a precursor to the TCP/IP Internet]

    Then once you’re connected to the BBS you could upload, download, send email via fidonet and talk to anyone else online. My favorite hacker BBS was in Orange County, Californa called Digital Decay and run by a chap called Arclight. Little did I know that my future wife was also in Orange County busy being a college kid.

    At the time underground BBS’s were divided into two types: Those that were hacking and phreaking related and those run by the warez crowd. The hacker/phreak BBS’s would distribute exploits, tools like Bluebeep to hack the phone lines, copies of phrack and so on.

    The warez crowd would distribute pirated software and they took their job very seriously. 133+ speak originated with the warez crowd and the hacking/phreaking crowd hated it.

    The term Zero Day also originated in the warez scene. On warez BBS’s software would be divided into zero day, 1 to 7 day, 8 to 14 day and so on with the lower ‘day’ being the most elite and hardest to come by. The number of ‘days’ was the days since the software was released to the public and Zero Day was software that was not commercially released yet. So someone had hacked into the company servers to grab their commercial software before they released it.

    The relationship between the warez crowd and the hacking/phreaking scene was that the hackers would invent the means to get zero day warez (exploits used to hack into a company), the phreaks invented and continually reinvented the means for ‘warez couriers’ distribute the warez among BBS’s (ways to circumvent trunk seize tone filters the phone companies were using for example). Hackers and phreaks looked down on the warez crowd – even though we’d get software from them – which was a little hypocritical.

    This was all around 25 years ago. At some point ‘zero day’ became something applied to vulnerabilities and the number of days a vendor has had to fix them. And at some point ‘133t sp34k’ became something hackers use. I have no idea why or when this transition occurred. 133t sp34k used to be scorned by hackers as something warez ‘pups’ did.

    Times change. Like hashtags originating on Twitter where they indicated subject, which originated on IRC where they were channels – and which syntactically may have been inspired by C preprocessor directives.

    Edit: Very cool discussion thread on HN about this – including some other old-schoolers checking in.

  • The Qantas A380 Engine Failure: The story of an ops team pulling through a crisis

    [Thanks to ‘evanm’ on Hacker News, here’s a link to the full documentary if you don’t want the abbreviated versions below.]

    As a low hours pilot I spend a lot of time reading NTSB reports and postmortems on flight incidents to try and avoid repeating the mistakes others have made or learn about how they successfully dealt with problems encountered during flight.

    One of the most impressive stories I read about fairly recently was the Qantas A380 engine failure. I have a lot of respect for pilots who deal with crises successfully and for me Sullenberger’s landing in the Hudson has always been my favorite and most heroic story. Even though Sullenberger was facing a high workload during his engine failure, he focused on flying the plane and did a textbook water landing.

    But what fascinates me about the Qantas A380 failure is it’s more about the team pulling through, especially the first officer. After the engine fails the first officer is confronted with a monster list of system failures that the avionics dumps on him and he has to very quickly work through each item. They eventually gain an understanding of the aircraft status and come up with an operational plan to put it back on the ground.

    As someone who writes software for a living and used to be an operations guy, for me the Qantas A380 engine failure is the story of an ops team facing tremendous pressure with zero option for failure and incredible time pressure, and transforming a severely damaged system into something operational again in order to successfully shut it down.

    If you have the time, I’d recommend watching this two part documentary which captures most of the story. You can tell from the first officer’s recounting of the incident how much pressure he was under at the time.

  • Why you should fly United Airlines

    We just flew United from Portland, Maine to Colorado and will be flying back in the next few days. We brought 3 pets with us, 2 cats and our Australian Cattle Dog, Joey.

    Their pet handling was awesome in the midst of a serious winter storm blowing through Maine with very cold icy conditions. My dog was well taken care of by the folks at United Freight in Maine (he flew with us on the same flight, that’s where you drop them off) and both cats flew in the cabin and there was plenty of leg room even with a cat carrier at our feet. The staff at Freight put us at ease and kept our dog in a climate controlled area (with visible air conditioning unit on the roof) while he waited to board our plane.

    Everyone arrived safely but I left my $2500 macbook on the plane at DIA and with a significant amount of Bitcoin and 3 other digital currencies in assorted digital wallets on the Macbook.

    I drove back to Denver International the next day and a United staff member went out of her way to recover my laptop from a locked box which was about to get shipped to central lost & found in Houston. She had already ended her shift and ended up running around the airport trying to find a colleague who had access to the box, which she eventually found and who managed to find my laptop. Got it back with all digital wallets intact and the Macbook in perfect condition.

    So, thanks United. I’ll be flying you again with my animals and my valuables.

  • Linksys N600 Wifi Router doesn't do Gigabit with Apple Thunderbolt to Ethernet Adapter

    I’m filing this under the “Things that suck” category.

    My two mac’s when connected directly to each other using a Cat 5e ethernet cable connect at 1 gigabit/second.

    Take the same cable and plug it directly into a Linksys N600 which is supposed to support Gigabit ethernet, and it’s stuck at 100 megabits per second.

    Used the ethernet cable bundled with the router as well as my own Cat5e cable and no luck.

    Guess I’ll buy Netgear from now on.

    Post a comment if you arrived here via Google and had a similar experience.