S E R V E R   S I D E
View current page
...more recent posts

Man I have so many posts brewing but I'm just not sure when they will come out. I feel like everything has been on hold for so long, and now it is all starting to happen at once.

The new server is our way of playing a little part in this next phase of the internet. Disk space has plunged in cost, bandwidth - both fixed and especially mobile - have soared in speed, and new protocols - especially BitTorrent and RSS/ATOM - are allowing for new applications that will create a significantly richer media experience.

Here's one example. If you're a Mac user (Windows and Linux clients are on their way,) go download DTV. It's an RSS reader that pulls down feeds that contain video clips. You subscribe to different "channels" (which are like different websites,) and your DTV client polls them at a selective interval and downloads any new content. It's a program you just keep running in the background all the time, and then whenever you want you can open it up and there will be tons of new video clips that you watch right in the DTV program. And the downloads can themselves be torrents, in which case the DTV client is also a BitTorrent client - except the user doesn't see any of this, nor needs to know what any of these protocols are or how they work. Very very slick.

The DTV client looks and works much like iTunes. Click on 'Channel Guide' at the top of the left hand column (like clicking on your 'library' in iTunes) and you get a listing of different channels they think you might like to subscribe to. But the channels are just RSS feeds, so anyone can make a feed that can be shown (this is an open system - not a walled garden.) Just click 'Add Channel' at the bottom of the left hand column and you can enter any URL. Here are two to start with:

http://del.icio.us/popular/system:media:video
http://www.commonbits.org/rss/tag/daily-show

The first is a feed of popular video clips from the group site del.icio.us. The second are daily short clips from the Daily Show.

Now nothing here is completely new. We've been reading RSS feeds for years now. And downloading with BitTorrent as well. But it's never all been easy enough to reach critical mass. Now it is. And the way they have baked BitTorrent into this thing is just mind blowing. It solves the bandwidth bottle neck of being a content producer. And that means it levels the playing field significantly in terms of who can distribute the media.

What blogs have done for the written word, and what is generally called "news", which is much like what P2P networks did to the music industry, BitTorrent and RSS combos like DTV will now do to television and movies. It won't destroy them, but it will completely change everything, creating a lot of opportunities for new comers and a lot of disappointment for entrenched players who don't see it coming.
- jim 11-09-2005 6:08 pm [link] [4 comments]

Server shipped. Should arrive on Wednesday.
- jim 11-07-2005 10:03 pm [link] [3 comments]

Like most things I try to do this project is taking much longer, at every stage, than I ever anticipated. But today I finally ordered the server. Should ship early next week.

Dual Opteron server with 2 GB ECC RAM, and 12 400 GB SATA hard drives in a 3U Supermicro case.
- jim 11-03-2005 11:02 pm [link] [3 comments]

One good thing about not being an expert is that when you get something to work it feels like a blessed event has occurred, rather than something routine just happening the way you expect.

I took the server in just before noon this morning. Slid it into my little cage (looking enviously at the beautiful Apple Xserve someone else had in the cabinet above mine.) Hooked it up and booted not really knowing what to expect. Theoretically the machine was all set up and should just work. Realistically I knew this might not be the case.

And of course it wasn't. The server booted, of course, and everything *seemed* okay, but I couldn't get out onto the net. And I figured if I couldn't get out, certainly no one else could get in. Ugh. What a horrible feeling. I didn't even really know where to begin.

So I left and came back here and started googling. Wrote some frantic messages on some discussion boards. Even fired off an email to an old college friend who is a professional geek asking if he knew of anyone I could hire for a day.

I didn't get too far with my research, but I did figure out a few things to look for. And I knew in order to get anyone else's help I would have to have some detailed info that I didn't have (not having any access to the server from here.)

So I headed back to the colo. Turns out to be ridiculously convenient from my place - 4 stops on the J M Z. Anyway I set up again. They have carts with some monitors and keyboards on them for everyone to use, and you just wheel one over in front of your cabinet and hook it up. I decided, what the hell, I'll just wipe the hard drive and install from scratch. I didn't really think this would work, but I didn't really have too much to go on.

After a short spell in a strange place called boot loader hell - and a second complete wipe and install - I finally got back to where I was before. Broke. So I started taking the careful notes I would need (like the outputs of ifconfig and route -n as well as the contents of /etc/hosts, /etc/sysconfig/network, /etc/sysconfig/network-scripts/ifcfg-eth0, and /etc/resolv.conf) and started packing up, more than a little depressed at my failure right out of the gate.

But by pure luck one of the guys who works there walked by and sort of asked off handed how I was doing. More out of politeness than from actually wanting to know how I was doing. But I answered anyway, saying I was having some trouble, but also that I was just learning, and I sort of expected to run into trouble. I really didn't think it could possibly be their fault. He made a few suggestions which made sense, the best one being to hook my laptop to the ethernet connection and see if I could get that to work.

Of course. Good idea since I am very comfortable networking on the powerbook. This would help isolate where the problem really was. And the exact same thing happened. Everything configured like it was okay, but then I couldn't get anywhere. Pings just timed out.

The guy had gone around the corner where the big switches were for a minute, and when he came back he had a real sheepish look on his face. "How much time did you waste on this?" he asked. Turns out he had plugged me into the wrong switch. "Try now" he said, and I did, and it worked. Just like it was supposed to.

Hey, this stuff is easy!
- jim 10-01-2005 1:42 am [link] [add a comment]

Just got my IP addresses. Server goes in tomorrow. My goal is just to get it up and running and to be able to SSH in using an IP address. Then over the weekend I will hope to get DNS working and to make Apache respond to a domain name. If that all works I will pull the trigger on the new server next week. Not sure how long that will take build and arrive. I'm hoping about a week.
- jim 9-30-2005 12:45 am [link] [add a comment]

Volunteer needed. Here's your chance to be part of the empire! :-)

The colocation facility has the usual high tech key card security. I want to list someone else to be issued a second key card. Responsibilities would be minimal, and include taking one trip down there with me so I can show you how to reboot the server (just flip the switch - going down there is just so you know where it is and where the switch is,) and then actually going down there and rebooting the server if it ever needs to be and I am not in town. Most likely this would never happen, in large part because I am almost always in town. Still, it is nice to have a backup.

Eventually, if the business side of things works out, this would be something I would pay someone for. For now though I won't be moving any business accounts to the server (until I know it is stable,) and the only thing that will be there will be digitalmediatree. As such I am looking for a volunteer.

Not really a big deal - I'm sure I can add someone later. And I am certainly not going to be out of town in the near future since I am trying to get everything going. But if this sounds not so horrible to someone here let me know and I will get you a card. Thanks!
- jim 9-28-2005 9:54 pm [link] [3 comments]

Just committed verbally to the colocation arrangement. Waiting for faxed documents. Hopefully the test server will go in over the next few days.
- jim 9-26-2005 9:10 pm [link] [2 comments]

I have restarted talks with the colocation facility here in NYC. Getting close.
- jim 9-21-2005 9:11 pm [link] [add a comment]

After many many reinstalls today I have finally made a little more progress. The server comes up on my local network and I can ssh in to it from my laptop. Plus Apache is set up and running and will serve files over the local network. Again, this is all pretty easy, but that dosen't mean it doesn't feel good the first time you see a page from your server load up in a browser on a different machine. It's alive!
- jim 9-18-2005 1:21 am [link] [1 comment]

Notes for myself (so I remember when setting up the real server.)

Install minimal system from disc, then:

rpm --import /usr/share/doc/centos-release-4/RPM-GPG-KEY

yum upgrade

yum install perl-DBD-MySQL mysql-server mysql php-mysql mod_auth_mysql openssl-devel openssl mod_ssl php-devel php httpd rpm-build rpm-devel gcc perl-CPAN autoconf automake

Make sure apache and mysql start on every reboot:

chkconfig httpd on
chkconfig mysqld on

And start them both now (since we don't want to reboot):

/etc/init.d/mysqld start
/etc/init.d/httpd start
- jim 9-18-2005 12:43 am [link] [add a comment]

older posts...