Made in China: Feeding the Factory

July 13th, 2007

Around 2,500 years ago, the phrase “min yi shi wei tian” was coined by Prime Minister Guan Zhong; there are several ways to translate it. One side of the coin takes the literal approach and says that “people consider food divine”, or “for people, food is next to heaven”. The other side of the coin looks at it as a piece of governing advice, “the government’s mandate [synonymous with heaven] is only as robust as the food on people’s plates”. Or, it could be just thought of as an excuse to procrastinate: “let’s eat first [since it is as important as heaven]”.

Which ever way you cut it, I think the saying still holds in China. So one important metric for gauging the quality of treatment of the factory employees is how good the food is, as it’s common for factory workers to be housed, fed, and cared for on site.

The food is actually quite good at some factories. The photo above is at the factory that does the chumby circuit boards. It was a mix of steamed fish, broiled pork, egg rolls, clean fried vegetables, and some pickled-vegetable-and-meat combo. Rice, soup, and apples were also provided in help yourself quantities.

One interesting fact is that every facility I went to had separate utensils and plates for guests. You can see in the above photo how my food is on a styrofoam plate with disposable chopsticks, where as the factory worker’s food is served on a steel plate with steel chopsticks. This is because I haven’t passed the factory’s physical examination. They do this to prevent me from contaminating the factory with potential foreign diseases. The food in the above photo consists of smoked fish, ma po tofu, boiled vegetables, and turtle shell jelly (for dessert). The turtle shell is very bitter and apparently it’s supposed to make you feel cooler on the hot summer days in China.

The menu is quite interesting in China. I think the menu the day I went to this factory had items on it like pig intestines, kidneys, fungus and vegetables, along with some other more western-friendly items.

Again, the scale of some food operations is pretty impressive. I heard that Foxconn–the place that makes the iPods and iPhones–consumes 3,000 pigs a day. I saw this truck of pigs going off the exit on the highway toward Foxconn, and it reminded me of that factoid.

From pigs to iPhones! It all happens right here in Shenzhen.

Made in China: Scale

July 13th, 2007

Probably one of the most stunning things about working in China is the sheer scale of the place. I haven’t been to an auto plant in Michigan, or to the Boeing plant in Seattle, but I get the sense that Shenzhen gives both of those locales a run for the money in terms of scale. Shenzhen has 9 million people, and most of them are women (something like 7:1 women to men). Despite the popular wisdom that China has net more males than females, it’s no surprise that the region of Shenzhen has all the women. Once you see the gender ratio of a major factory, such as the New Balance factory below, you’ll understand. The factory employs 40,000 people and has a capacity for over a million shoes a month. I estimate that from raw fabric to finished shoe, the process takes about 50 minutes, or about $1.80 in labor costs.

(Below are some videos, you will need Flash 8 or better to play them…)

[Youtube link for whose who cannot view embedded SWF]

That’s right…everyone of those perfectly stitched bundles of plastic and leather are sewn by hand. You can see a detail of the process below. Each station is designed so that each worker takes about thirty seconds to do their job.



[Youtube link for those who cannot view embedded SWF]

Now, you know you are big when you have your own exit off the freeway:

Foxconn is where all of the iPods and iPhones are made. It’s a huge facility, apparently with over 250,000 employees, and it has its own special free trade status. The entire facility is walled off and you apparently need to have your passport and clear customs to get into the facility…just short of the nuclear-powered robotic dogs from the nation-corporation franchulates of Snowcrash.

Made in China: Getting Started

July 8th, 2007

I found setting up a supply chain in China to be enlightening, and I’d like to share more of my experiences with the readers of this blog.

Presenting this material is challenging; there is a lot of detail and its easy to get overwhelmed and lost in the vagaries of electronics manufacturing. In order to focus my writing and create a more succinct body of works, this series of posts will be thematic. In other words, instead of talking about the details of how pick and place machines work in China, I’ll post about a more abstract theme such as “automation” and just show sound bites to give the reader a flavor of what’s going on.

The theme of this first post is “Getting Started”.

In September of 2006, Chumby was just a team of about a half dozen people, and we had given away about 200 early prototype chumby devices at Tim O’Reilly’s FOO camp. The devices were well received by the attendees of the conference, so I got the go-ahead to build the Asian supply chain.

Before we went to China, we had a trusted vendor in the US give us their best quotation for the job, so we had a reference point to work downwards from.

In a nutshell, we called up a lot of our friends who had some experience in China, and we lined up a series of about a half dozen factory tours in China. We hit quite a variety of places on our tour, from specialty factories as small as 500 people to mega-factories with over 40,000 people.

Being open source helped a lot in terms of kick-starting the process, because first we had no fears about people stealing our design–we’re giving the design away–and there were no NDAs to sign when sharing critical information, like the bill of materials. I think this kind of openness actually gave us a better reception with the factories in China; they seemed more willing to open up to us because we were willing to open up to them. Also, there was no question in the factory’s mind that they were in a competitive situation. It was plain that anybody could and would quote and bid on the job (in fact, we received a few unsolicited quotations that were quite competitive), so it saved a round of huffing and puffing. And finally, it seems that despite handing out our BoM without an NDA, nobody in the general public is aware of the strategic improvements we rolled into the chumby hardware since the FOO prototype (then again, chumby has no serious competition at this point in time).

In November, Steve Tomlin and I went to China to do the factory visits, and some of my first impressions were documented in my post Adventures with the Venture Communist.

There is no substitute for going to China to tour the factory. Pictures are always deceiving, and you just can’t get a sense for the scale and quality of the factory without going to see the actual facility. In general, factories welcome you to take a tour–I wouldn’t work with one that didn’t allow me to come visit. However, most factories do appreciate a week prior notice before you come and visit, although as your relationship with the factory progresses things should become more open and transparent.

While almost every factory will “clean up” the day you come to visit, a sharp eye and the right questions can see through any quick veneers put in place. One place I always liked to visit was the QC room. I expect to see rows of well-maintained and well-worn binders with design documentation and QC standards, as well as “golden samples”. I would point at a couple of random binders and demand to view their contents, see the product’s golden sample, and verify that they knew what was going on in the binder–that it wasn’t just some random data they threw in there. Also, hard investments in equipment is a good sign: the best manufacturers I visited all had a couple rooms with sophisticated equipment for thermal, mechanical, and electrical limit testing, and of course operators were in the room actually using the equipment (I could definitely believe a Chinese manufacturer would buy a room of equipment just for show and not actually use it).

After reviewing several manufacturing options, we decided on one, which was PCH China Solutions. PCH itself owns only a few facilities, but it has a comprehensive network of trusted and validated vendors–primarily in China but also Europe and the US as well. Not surprisingly, the factories that PCH sub-contracts to were some of the best facilities we visited while we were in China.

PCH is actually headquartered out of Ireland, and as such, most of their staff engineers are Irish, so there was no langauge barrier. They are hard working, resourceful, well-trained, and as a bonus they always seemed to know the best places to find a pint no matter where we are. I had no idea China had so many Guiness taps.

In retrospect, this is definitely the way to go–I learned a lot about what it takes to do business in China by shadowing their engineers while I was out there. From 10,000 miles away it looks easy but it’s anything but easy working with even the best Chinese contract manufacturers. I’ll cover some of the “frustration stories” in another themed post later on.

Wanted: Red Ring of Death

July 8th, 2007

Some of you may have heard about the Xbox360’s massive warranty upgrade program and the Red Ring of Death. I’m looking to acquire an unmodded(!) console that “reliably” exhibits the Red Ring of Death (some anecdotes on the net of consoles coming back from the dead–I don’t want one of those), and I’ll pay cash (via paypal) for it at market value ($299 for the core system–I’m only interested in the core, of course…). Leave a comment or preferably send me an email if you have such a unit and are willing to part with it…

FOO Camp 07 and RNA Folding

July 2nd, 2007

I was at FOO camp last weekend and it was a blast. As usual, Tim brought together quite an interesting crowd of people. It was a pleasant surprise to see old friends from MIT, some whom I hadn’t seen in years. To date, four FOO alumni worked on the same robotics team (ORCA) building autonomous submarines at MIT back when we were all students there, and at least three students/ra’s of my MIT graduate advisor, Tom Knight, have also attended FOO. Of course, I got to meet some interesting new people, including a group of folks who have expertise and great interest in manufacturing in China (we had a little round table discussion about doing business in China and China’s economic role in the world). I also gave a little presentation about how chumbys are made in China, something which I will blog about in the next couple of days through a set of posts forthcoming (I have a lot of material to go through so it’s taking me a while to organize them and write them).

One FOO attendee who I was most fortunate to stumble upon was Christine Smolke. She gave a fascinating talk about the capabilities of RNA that really opened my mind. As many may be aware, the “central dogma” of biology is being rewritten, and RNA is starting to take a more active role in everything from heredity of genetic traits to catalysis of reactions. Recent findings have caused some hypotheses to be revisited, such as the “RNA world” hypothesis, which indicate that life may actually have started through self-replicating strands of RNA, instead of DNA.

The most interesting connection I made listening to her talk was with my experience looking at the protein folding problem. In a nutshell, protein folding is one of the “grand challenges” of computer science today, and the basic mission is to predict the 3-D structure of a protein given its amino acid sequence–in my opinion, one important part of the “uber-tool” for nanotechnology engineers that would create a catalyst for an arbitrary substrate (another application for protein folding is also to elucidate the structure of proteins that cannot be crystallized and are thus unsuitable for X-ray diffraction analysis).

Protein folding is hard. I mean, really hard. It’s one of the few computational problems that truly scare me. There are whole supercomputer projects devoted to the subject, from DE Shaw’s ambitious project to IBM’s Blue Gene series of machines, to Stanford’s Folding at Home distributed computing project. My facts are a couple years out of date but iirc, a typical goal for such a big project would be to fold one “small-ish” protein of about 50 to 100 amino acids in about a month–a reaction that happens in a cell on a timescale on the order of milliseconds. And, the problem doesn’t scale particularly well. The reasons why protein folding is hard are numerous, and most of them have to do with the enormous dynamic range of timescales required for the simulation, the very sensitive interactions that the numerous hydrophilic and hydrophobic amino acids have with the surrounding water, and the sheer number of particles involved. The simplifying assumptions made in even the most sophisticated simulations today are crude compared to the actual conditions in the cell. The way a protein folds depends upon the rate of sequence output, the temperature, pH conditions, presence of helper molecules, coordinating ions, and even post-folding sequence modifications–all things that challenge current computational models.

To illustrate the point, even the iconic double-helix of DNA is a direct result of its interaction with its surroundings. The double helix arises from the fact that the base pairs are “greasy” (hydrophobic) and they repel water, so they stick together…thus, a structure that might otherwise look like a straight ladder collapses in on itself to minimize the distance between the rungs, squeezing out the water, and in the process twisting the backbone into a double helix; the process also requires coordinating ions from the water to neutralize the concentration of charges brought on by the collapse into the double-helix. Before I learned about this I just took the twisting of DNA for granted…shows how little I know about the real mechanics of biochemistry, but boy, is it fascinating.

Christine’s talk on RNA got me thinking…RNA is nice, as it can function single-stranded, and is very pliable. It only has four base pairs, instead of the twenty basic amino acids found in proteins. The secondary structure of an RNA molecule is also predictable. And, RNA can be active on a variety of substrates. Granted, RNA may not be as effective, efficient, or as versatile as the more complex protein counterparts, but I can’t help but wonder if maybe a good baby-step would be to first try to solve the RNA folding problem. It’s only a hunch right now but it feels like RNA might be an easier beast to tame than proteins. And as a molecular tinkerer, I’d rather have a tool that creates less than optimal results but is available sooner, can iterate faster, and is more affordable, instead of a tool that gives ultimate results but also comes at enormous cost and effort. There are a lot of simple molecular problems that need solutions today, and perhaps from these learnings we can eventually develop smarter tools for the more complex problems.

Ah, if only I had the time and the money…too many interesting things to do! I wonder if I had become a professor instead of a professional, if I would have had the priviledge to investigate such interesting diversions, or if I would simply be consumed by the tenure clock…