Archive

Archive for October, 2008

FraudBand?

I was reading an article today at www.app-rising.com in which Geoff Daily commented how he first heard the term “FraudBand”:

“This was the first time I heard the term “fraudband,” which is defined as broadband technologies that over promise but will ultimately under deliver. The specific technology Dirk called out as fraudband was DOCSIS 3.0, which promises a racetrack with 120Mbps upload capacity but then fails to admit the limitations of its shared network where that 120Mbps may be spread across hundreds of homes.”

My question then would be isn’t the FTTH technologies operating under the same principle?  Take for instance Alcatel-Lucent solution and you notice that the transport there is 2.5Gb/s downstream and 1.2Gb/s upstream that eventually reaches a splitter in which that aggregate bandwidth is actually split and shared by 32-64 subscribers?

I don’t know that I see a difference?  Don’t get me wrong I know there is a big difference in the bandwidth, but the principle behind the “fraudband” statement seems to be about the fact cable is a shared resource in which case FTTH is no different?

What am I missing here?

Categories: General Tags: ,

LUS Fiber Alcatel-Lucent Fiber To The Home (FTTH) Solution?

Ever since the CampFiber meeting this past weekend in Lafayette, Louisiana where I heard from Major Joey Durel and Terry Huval the Director of Lafayette Utilities System (LUS) who reported that they had selected Alcatel-Lucent for the Fiber To The Home service I have been very interested in more technical details of the network.

Being the geek that I am with a thirst of knowledge for all things networking related I decided to try seeing what solutions by Alcatel-Lucent might be used for this.

I didn’t find much but I did come across the Alcatel-Lucent 7342 Intelligent Service Access Manager (ISAM)

What I found interesting about this solution is on pg. 3 where it states:

“Each PON line supports 2.5 Gb/s downstream and 1.2 Gb/s upstream. In addition to GPON performance, PON lines can be extended up to 20 km with 32 subscribers per PON, or up to 64 subscribers per PON for shorter distances.”

So, each PON supports between 32 to 64 subscribers.  Each PON also supports 2.5Gb/s downstream and 1.2 Gb/s upstream.  So, lets say we go the minimum 32 subscribers.  If you divide the 2.5Gb/s by the 32 subscribers you get 78 Mb/s per user on the downstream.  If you divide the 1.2Gb/s by the 32 subscribers you get roughly 38 Mb/s.

None of this is a problem when we are just talking about the 10Mb/s for the internet service.  But it does lead to some concerns about the 100 Mb/s peer to peer capabilities.  Of course it is understood that all ISP’s over subscribe their service so it’s not a big surprise.

The numbers do get pretty darn low however when you go to the full 64 subscribers each PON is capable of.  For example, the 2.5 Gb/s downstream divided by 64 subscribers gives you only about 40 Mb/s.   The 1.2 Gb/s upstream divided by the 64 subscribers gives you only about 19 Mb/s.

Again I will be the first to admit that none of this is really all that bad.  It’s well above the 10 Mb/s minimum internet service they will be offering.  And since the 100 Mb/s Peer to Peer is kind of a lagniappe service I doubt anyone will complain if they find themselves in a situation where they are unable to attain the full 100 Mb/s service.

To me the most interesting part of it all is the fact that the upstream and downstream aren’t equal within the underlying infrastructure.

And what I would really be curious about is whether the video and voice services also use up some of this bandwidth as well which would effectively lower the total rates I provided previously.  The numbers above assume that the 2.5 and 1.2 are dedicated to data only which I really don’t think is the case.

Of course I don’t even know if this is the solution they picked and I suck at math so I could be way off about everything.  :-)

Another good read about this from Alcatel-Lucent:

http://www1.alcatel-lucent.com/com/en/appcontent/opgss/23168_DeployFiber_wp_tcm228-1336491635.pdf

Categories: General Tags: , , ,

Net Neutrality, QoS and Over Subscription?

As someone who has spent 15 years, entire career now, as a network engineer for both enterprises and for ISP’s it’s difficult to have a single opinion on some things when it comes to networks.   

I really do see and understand both sides of most arguments around net neutrality. When I take off my network engineer hat and put on my consumer hat I wouldn’t be too happy with a lot of this stuff either.

However, when I sit back and think about things rationally its just not so black and white to me.

I know that often when analyzing network traffic the bulk of that traffic will be due to a few offenders.

This sort of thing reminds me of the days in grade school where you had a few bad students creating havoc and thus affecting the whole class in some way.  It always seemed unfair why the class would get punished for the actions of a few.

People want to do voice, video and data over the network these days but they don’t want the ISP’s to interfere with their traffic.  On private LANs and WANs we do the same thing (voice, video and data) but we also know that in order to do this successfully we have to employ quality of service (QoS).  Without QoS voice quality would be very unpredictable and video would be choppy.

The way QoS works is by looking at all the traffic coming in, orgainizing the traffic by various priorities and then allowing the highest priority traffic to leave first.  What often happens is the lowest priority traffic might get dropped.  This is typically ok because most traffic can tolerate being dropped as the sending device will get notified that some of its data was dropped and it needs to resend it.

Applications like voice and video however do not tolerate dropped traffic very well.  If you drop voice traffic the user will notice this change because they are actively listening.  People don’t notice dropped packets when surfing the internet because the retransmits of this dropped data happens so quickly and at worst it may just mean the website they were going to loads up a little slowly.

So you have these people out there who believe that ISP’s should simply provide a dumb pipe with no QoS or anything since that would interefere with or manipulate their traffic in some way.

The problem with dumb pipes is that ISP’s rely on the principle of ‘over subscription’ in order to make money.  You simply cannot be profitable as an ISP without oversubscribing.

Consider this, here are some of the largest pipes ISP’s can get to the internet.  

OC-48 = 2.5G = 2488Mbit/s  divide by 10Mbit/s = 248 users

OC-192 = 10G = 9953.28Mbit/s  divide by 10Mbit/s = 995 users

The reason I got on this whole topic was because of some things I heard at this weekends CampFiber meeting.  Those living in Lafayette, Louisiana know that the local utilities company (LUS) is building out a fiber to the home solution for the cities residents.  LUS has been in the fiber business for some time providing service to businesses.  According to the info on their website (http://www.lusnet.net/) they have two DS3′s to the internet.  DS3′s are roughly 45Mbit/s, so combined were looking at about 90Mbit/s of capacity to the internet.

Again I have to say I do not know how old this data is and I do not know if these same circuits to the internet will be leveraged by their new home user service.  This would be good info to know though and I would love for anyone who does know to inform me of the truth.

OK, so we have established LUS has 90Mbit/s of internet connectivity.  This is currently being used by their business customers and by the City of Lafayette as well.  And it could potentially be used by their home customers but that is not a fact yet.

LUS Fiber is advertising that their minimum internet package will be 10Mbit/s for home users.   It’s also important to note that based on this document that they estimate their subscriber count will be 28,500.  The document states a pass count of 57,000 potential customers and sub count of 28,500.  For those that don’t know what this means its pretty simple, pass count is who could potentially be a customer because the service passes close enough by them.  Sub count is the actual subscribers.

Lets give LUS the benefit of the doubt here.  Lets make the sub count lower than their expectations, so lets round down to 20,000.  Each customer gets a minimum of 10Mbit/s.  So if every user actually used the full 10Mbit/s we would be looking at 200,000Mbit/s.   And they have 90Mbit/s of internet bandwidth?  Thats a bit oversubscribed.

Now anyone in the business knows thats not going to happen.  You will never see all users fully utilizing their internet connection.  If 90Mbit/s is their total bandwidth and each user gets 10Mbit/s it would only take 9 users out of 20,000 fully utilizing the 10Mbit/s to max it out.  That is very possible however.

Now lets really give LUS the benefit of the doubt there.  Lets say they have an OC-192 connection to the internet.  So, thats roughly 10,000Mbit/s (its actually more like 9,000 but just making the match easy and giving them the benefit of the doubt here remember).   So we take 10,000Mbit/s and divide by 10Mbit/s and we get roughly 1000 users who could be running a full 10Mbit/s.  Thats not too bad there.  Thats like a 20:1 subscription ratio.  BTW, I SUCK AT MATH so please correct the basic math if I am wrong but realize I am generalizing here and not being exact.

So far I have only discussed home subscribers using the LUS internet connectivity despite the fact that businesses use it as well.  If business customers and home customers will share the same internet backbone that LUS has then my guess is that LUS will at a minimum seperate traffic into two priorities, one for business users and one for home users.  And it would make sense to give the business users higher priority then the home users so that home users can’t impact the business users internet connectivity.

If all of what I said is true (highly unlikely) then would this be deemed a non net neutral situation for the home subscribers?

I ask because Chance with LUS stated at CampFiber they had to be careful to not get into a net neutrality situation so they were just giving dumb pipes and thats it.  And if this is true, based on the numbers above which again were very generous it wouldn’t take much for a few subscribers to effect the internet performance of all subscribers without some means of QoS.

Which brings me back to the issue of whether network management by using any sort of QoS create a net neutrality issue?

Lets say you have a 1Mbit/s pipe to the internet.  You have two users who share this pipe but you sold them each 1Mbit/s.  For the sake of argument lets say that User A is doing streaming video that takes up the full 1Mbit/s pipe.  User B starts to do something else but only requires 500Kbit/s from the pipe.  Obviously something has to give here.  If you QoS things so that during peak times no one can get more than 500Kbit/s so that one person does not impact the other well then your not living up to what you sold them.  If you give video a higher priority then you aren’t being very neutral since you will impact what user B is doing effectively saying that user A’s traffic is more important then user B’s traffic.

How can one be “net neutral” in an over subscription business model?  You either can’t over subscribe, or hope that your aggregate traffic never exceeds your biggest pipe.

Looking for enlightenment here, would love to be shown the err in my thinking about this.

 

CampFiber – Takeaways

My last post regarding CampFiber reads awfully negative despite that not being my intent.  I did appreciate the event and I really do look forward to any future events that may come of this.

Kinda sad that it took someone from outside of Lafayette to organize the event, I sincerely appreciate Geoff Daily for doing this.

Here are a few key takeways for me from the event and things I look forward to in the future:

1.  Keith Thibodeaux from Lafayette Consolidated Government (LCG) mentioned an iPhone application that was in the works!  This was something I actually planned to mention as an idea at the meeting so it was nice to here.  Wish there were some details as to what all it would do.  I envisioned an application that would have quick access to news and events in Lafayette, traffic cameras, traffic accidents and so on.  I will elaborate more on my application idea in another post.

2.  Someone discussed the idea of a tech festival of sorts.  Something like South By Southwest (SXSW) combining both technology and the ‘creative class’.  I kinda like the idea in general.  This is Lafayette, Louisiana after all where festivals are in our blood.  I could envision something like TechSouth meets Festival International.  It would be best to do it in conjunction with Festival International in my opinion.

3.  No A-La-Carte.  It was funny to hear Terry Huval say how impractical A-La-Carte service is and no one made a peep.  When the cable co’s and others state this everyone gets in a tizzy, but when LUS states this oh well thats ok we all understand.

4.  Wireless is a part of LUS’s plan / strategy but due to its unpredictable nature they don’t want to push it much.  Understandable.  I am still very intrigued about the possibilities surrounding the 700Mhz spectrum and what Cox will do with it in the Acadiana market.  Mobility is more important to me than any fiber to my home and its this technology that excites me.  There was some recent news regarding successful testing of 10GB wireless in labs!  Long time away from being anything more than just fantasy, but exciting stuff.

Categories: General Tags: , ,

CampFiber – Lafayette, Louisiana

I had the opportunity to attend an event today titled “CampFiber” here in Lafayette, Louisiana.  I am grateful for the event and those who presented, but over all I was a bit underwhelmed and disappointed.  However I must say I don’t think I was really the target audience.

The event was aimed primarily at developers in an effort to brainstorm ideas on how best to leverage the soon to be fiber to the home (FTTH) deployed in the city of Lafayette, Louisiana by the local utility company, LUS Fiber.

Granted I am a network engineer and life long geek so anything to do with technology and networks I am interested in and thus why I attended.

One of the first things discussed was the set top box that LUS has picked to standardize on and its capability to provide a basic web browsing experience through the use of a wireless keyboard and mouse.  As developers they all wanted to know what the capabilities of the box and browser were so they could possibly work on solutions targeting those consumers.

We also got an earful from the owner/founder of Abacus Data Exchange.  She is quite proud of herself and her little business.  Which I just found to not be very impressive and not very well thought out.

The #1 issue I found actually seemed to be common shared ideal by most participants and with Abacus Data Exchange was they all just focused on what they could do just with LUS Fiber.   Granted this was “CampFiber” so I guess it makes sense.  But I just don’t know why anyone would create a business or application that was completely dependent on this one provider and 100Mbps peer to peer connectivity.

With Abacus the first issue I see as a network engineer is lack of peering relationships.  Heck they even have “exchange” in their name as to indicate they are an internet exchange point but the only connectivity they have is with LUS.  As a network engineer who has spent 15 years building, designing and working on networks for ISP’s and data centers one of the first things you do is ensure you have diverse paths.  Not just physical diversity but provider diversity as well.

I believe Lafayette is prime for a public data center right now.  But personally if I were designing it one of the first things I would do is ensure we had peering relationships with each of the main providers; LUS, Cox and AT&T.  This would be similiar to what NTG has done in Baton Rouge.

Why?  Well with true peering relationships with each of the main local providers you can tap into each of these consumer / user bases.   In some situations you could also possibly be able to avoid having to route traffic between say an LUS customer and Cox customer out over the internet and back.  This would be a great advantage for a data center especially if you offer colocation services for businesses looking to tap into one or more of these user bases.

I think Joey Durel and Terry Huval actually help make my arguement here when they both discussed how this network would be so far ahead of its time that the rest of the country might not catch up for 20+ years.  I find that hard to believe but if it were true then why would anyone want to develop anything that would only be useful to those on this network?   I simply wouldn’t want to limit myself in that way.  I read some LUS Fiber document that stated the pass rate as being roughly 57,000 and the take rate was estimated at 28,500.  Even if those numbers were on the low side I don’t know why one would want to design an application that solely catered to that market.  But thats just me.

Again I don’t blame anyone but myself here as I know I was not the target audience.  Despite all this being said I look forward to future events and what this might start.

Categories: General Tags: , , , ,

Cisco Cookbook

To some I have been doing this job for a long time, about 15 years, to others I am just another young tech guy. No matter what I have always been fascinated with networking, and since the first time I got the privilege to help pull some cable for my mentor who was setting up a Cisco router I knew what I wanted to do in life. I wanted to be that guy, the one who got to work on what I felt was the ‘cool’ stuff like the Cisco routers. Well years later that is me now. I am one of the “Cisco Guys” at work, for a major communications company. If it has Cisco’s name on it then its my job to learn it, implement it, admin it and love it. :-)

And I DO! So, why the rambling? Well its all because of a book I have fallen in love with. It’s called “Cisco Cookbook” and its done by only the top tech publisher “O’Reilly”. Its just a great resource no matter how knowledgeable you are about IOS. One thing I have always regretted was my lack of scripting knowledge. Simply never bothered with it or learned it and have always wished I had. This book has some great useable examples I think anyone would helpful. Don’t know what else to say about it, just love it and think its worth a read and having in your personal library.

Categories: General Tags: , , , ,

MS Network Load Balancing and Cisco

I originally wrote this in Sept. 2006 and have decided to resurrect it from an old blog for my benefit only.

Begin Repost:

Just recently worked on a last minute project to utilize MS Network Load Balancing on a few servers. I was pulled in to handle the network side of it and wanted to comment on it to possibly help others out in the future.

By default MS Network Load Balancing (NLB) works out of the box if you will even with Cisco switches / routers by using Unicast. However it is not the best or recommended way of doing things, it is the simpliest though. The main reason for the concern with using Unicast is switch flooding, all ports will get the data regardless if they want it. Kinda defeats the primary point of switches right?

So your other option is to leverage Multicast. This is an option with MS NLB, but it poses a problem with many devices not handling it correctly. See the MS multicast is not true multicast. You don’t use Class D (multicast) address space for your IP addressing for one. MS simply adds a virtual (fake) multicast MAC address to the data packets. These things hit the Cisco router on the network and well the router is smart enough to know that you cant’ or not suppose to anyway have a Class A, B or C address with a multicast MAC. So it never adds or creates an ARP entry.

So that is the best and easiest for me to describe the root of the problem in laymens terms. Now how do you make it all work?

Ok, so you want to leverage NLB using multicast with Cisco routers and/or switches. First you can just go ahead and select the multicast option with MS NLB. Now you will want to get on your core router and add an arp entry. You need two things, the virtual MAC created in NLB and the IP address of the cluster.

Create your ARP entry as follows:

arp 10.10.10.10 5555.5555.5555 ARPA – obviously use your cluster IP and MAC

Thats it really, as long as you got the right router in the network and barring no other unrelated problems you should be good to go. You can test by pinging the group IP. You can also keep a ping running and try shutting down one of the servers in the cluster, your ping should continue with no problems.

Now, before you think thats everything I should warn you that you are still in the same boat using multicast as you were with unicast in regards to switch flooding. Since the switch you have your cluster servers plugged into does not have the group multicast mac in its mac-address-table it is simply flooding all ports with the data. Not good.

If you have a Cisco switch here is one way, to me the easiest, to fix this. From within MS NLB where you choose Unicast or Mulitcast you can also select IGMP support. Go ahead and select this. Now at this point you probably just broke your network connectivity again. Why? Because it appears (at least it happend to us) that when you select the IGMP support it changes the group MAC. So you again have no ARP entry for the cluster.

Also, possibly unrelated to the lost of connectivity but you will need and want to now configure the switch for IGMP snooping. When you select the IGMP support what happens is the hosts in the cluster will now start sending out IGMP join messages. The switch takes that info “if IGMP is enabled” and uses it to put those ports into a multicast group. So now your multicast traffic for the group multicast MAC will only be sent to members of the group.

On a CATOS switch that supports IGMP it’s pretty simple commands:

set igmp enable

set igmp querier enable 200 – substitute your vlan# for 200

Couple of things to note. First this is not going to work for everyone. You may have to upgrade your IOS or CATOS to support IGMP, you may be using IOS instead of CATOS which is what the above commands are for. You do not have to enable the igmp querier, I personally found it useful as I did not configure a multicast router.

Ok, so you have multicast enabled with IGMP support. You added the ARP entry on the core router for the multicast MAC. You can ping the cluster. You enabled IGMP on the switch. Now lets see if the switch ports the servers are connected to now show up in a multicast group on the switch.

sh multicast group

Results (should look something like this):

Console> (enable) sho multicast group

VLAN Dest MAC/Route Des Destination Ports or VCs / [Protocol Type]

—- —————— ————————————————

200 01-00-5e-05-06-07 2/1,2/3-4

Well good luck, hope you find it some what helpful. Its pretty easy and the whole network load balancing stuff is pretty cool. If you need any help feel free to contact me.

Useful and related links:

Multicast Does Not Work in the Same VLAN in Catalyst Switches:
http://www.cisco.com/en/US/products/hw/switches/ps708/products_tech_note09186a008059a9df.shtml#solu2

Configuring IGMP Snooping:
http://www.cisco.com/en/US/products/hw/switches/ps708/products_configuration_guide_chapter09186a00804356ac.html

Multicast in a Campus Network: CGMP and IGMP Snooping:
http://www.cisco.com/warp/public/473/22.html

:
http://cio.cisco.com/univercd/cc/td/doc/product/lan/cat5000/rel_4_3/config/multi.htm#xtocid237780

Categories: General Tags: , , , ,

Why AT&T Sucks

Believe it or not but AT&T sucks.  Yup, they really do.  And even more shocking is that they don’t care.  Hard to believe I know, but its sadly very true.

You may ask, ‘How do you know this Dane?’ well I know from first hand personal experience as a customer of their cell service and in my talks with their customer support.  I wouldn’t call them “customer support” since they really don’t offer any support or care about your issues, rather I think they are simply just “phone agents”.  Primary goal appears to be to get you off the phone as quickly as possible so that their calls answered measurement goes up.

AT&T doesn’t have to care right?  They are too big and they know it.  The reality is they are MaBell but with a new name and image.  Not to mention when it comes to cell / wireless you get to blame everything else when its not working since there is no physical line to test or trace.

Too bad there isn’t an ATTCARES like there is a ComcastCares that I could speak with.

The latest round of issues started when they rushed out 3G service here in Lafayette, Louisiana.  They did a week or two before the iPhone 3G launched as to not disappoint those buyers.  Yes I am one of those buyers.

The 3G service here is obviously broken and they don’t seem to care.  Not a day goes by that I and my wife doesn’t experience the inability to call someone or dropped calls.  It’s kinda funny to be in the middle of a conversation with someone and then all of a sudden hear “Were sorry but the number you dialed is not a working number”.  Huh?  Umm funny it was working about oh one second ago when I was talking to them!

And no this isn’t just happening to my wife and I.  It’s everyone I know on AT&T in this area.  Which makes no sense to me as to how they could allow this to continue.

Hell just turn 3G off so that we can actually use our phones for phone calls again.  The nice thing about the iPhone is you can turn off 3G which I do when I am in Lafayette.  When I work in Baton Rouge I turn it back on with NO issues.

Have called in to customer service numerous times about this and the responses are absolutely hysterical.  When I call in about my phone (iPhone) and explain things the solution is turn 3G off.  Umm… ok, so I spent this much money on this phone and service that doesn’t work?  And you don’t feel there is a bigger problem here that should be addressed?

When I have called in for my wife who has a Motorola V3 Razr something or other the answers really get fun.  So far the answers to this problem have been:

1.  They are working on the tower in your area and it should be fixed tonight.   (Seriously?  like I am the first to report this and they are gonna rush out and fix it for me tonight?  Wow thats service.  Of course its still an issue so they must not have made it out to the tower yet)

2.  You need a new SIM card.  (humm… this SIM card is only a few months old, this issue happens to every other AT&T customer I know, my iPhone works when I turn off 3G, but my wifes phone needs a new SIM card and its going to magically solve everyones issues in this area?)

3.  You need a new phone.  (yes I need to go buy a new phone because they turned on 3G, not even a offer to replace her phone but I need to go buy a new phone to replace her phone which is a few months old.  I can’t even begin to state all that is wrong with this)

4.  Well Sir it is wireless, its not going to be perfect.  (This was actually the most honest answer I got, and I agree with it completely.  I got this answer by going to an AT&T store and speaking to someone face to face.  They admitted there are lots of problems with the service and they have been complaining as well, and he believed the service was rushed through for the iPhone launch.  He stated that on his own and I almost wanted to hug him for being honest like that)

At no point in all of this has anyone offered to assist in any way.  Nothing that wouldn’t cost me more money that is.  And no one has muttered the words “credit” at all.  Dropped calls?, thats normal.  Can’t make a call?, thats normal.  Credit your service any for all your troubles?, thats not normal.

So I either need to find a phone for her that is edge only, or buy her an iPhone 3G so she can turn off 3G.

Thanks for nothing AT&T!

Categories: General Tags: , , ,