Archive for the 'Grid Performance' Category

Havok4 Fireside Chat with Sidewinder Linden

April 15th, 2008 | Category: Chat, Discussion, Grid Performance, Lindens, Simulator

Please join us tonight, Tuesday, April 15th at 6:00 pm SLT at the ISTE Island Beach/Campfire area for a presentation/discussion about the Havok4 physics engine by Sidewinder Linden, program manager.

Havok4 is currently being rolled out across Second Life (literally as we speak), with the goals of a more realistic simulator experience, increased viewer stability, and greater design capabilities for inworld developers.

We will be doing a rolling restart this Wednesday and Thursday to roll out the patches to the server that were to be rolled out with last week’s cancelled rolling restart. Changes include security patches, performance improvements for Havok4 (including the issue that “openspace” or “void” sims have with Havok4), and code designed to mitigate the load on the central database systems. Source: Rolling restart Wed/Thu April 16/17 for 1.21 Server Deploy

Via Tonight on ISTE Island: Havok4 Fireside Chat with Sidewinder Linden from The Story of My Second Life

Popularity: 10%

1 comment

Cisco’s ASR 1000 Presentation in Second Life

March 05th, 2008 | Category: Grid Performance, Second Life Learning, cisco

Cisco’s ASR 1000 Presentation

I got to see the Cisco presentation of their new Aggregation Services Routers, specifically the ASR 1000 series edge routers, in Second Life today. It was pretty interesting even considering voice died on me when the main presentation started; I have posted shots of the presentation below. The main speaker said had they been running these routers that the lag problems he experienced when he first walked onstage would not have happened; he walked through the stage and not on it. Later on, I flew half way across the sim on one keystroke.

Cisco’s ASR 1000 Presentation 2

Cisco’s ASR 1000 Presentation 3

It’s been so long since I even looked at a router, I’m not going to try to speak intelligently on this one, but will say it looks like a pretty good one. “The ASR 1000 Series features software virtualization to enable “instant-on” provisioning and simultaneous use of a wide range of service functionality, including firewall, IP security virtual private networks (IPSec VPNs), deep-packet inspection (DPI) and Session Border Control (SBC).” The cost savings alone make it well worth the price tag and each implementation of the Cisco ASR 1000 Series could result in savings of up to 3754 gallons of gasoline or 17 tons of coal each year because of reduced carbon footprint, and it’s easily upgradeable and should be able to support stuff they haven’t even thought of yet, according to Cisco.

Cisco’s ASR 1000 Presentation 4
Read more

Popularity: 9%

No comments

Today’s Second Life Problems Continue

February 13th, 2008 | Category: Grid, Grid Performance

Here are some of today’s problems posted to the Second Life blog. I am still waiting for my friends list to update, using the new Windlight client, I don’t know who waiting is, but I’m getting tired of looking at him. Otherwise performance seems normal to me, i.e. slow.

[Resolved]Rails Application Error Aspects of which uses the rails application are unavailable. This includes Classifieds and the drop down for last name registration.

[RESOLVED] More DNS Woes Wow. Apparently it’s International Borked Router Day or something. We have another group of residents who are getting DNS failures when they try to reach us. This time, the malfunction’s in London.

[Resolved] Support Unavailable One of our web servers is currently having technical problems. If you need to view knowledge base articles, please log in as a guest.

Intermittent Issues with In World Voice The Operations Team is tracing a leak in the voice chat system. Over time, backbone services for various regions can become bloated and cause failure in group voice chats.

[CLEARED] Some Residents Experiencing DNS Failures on Login Some residents (and Lindens) are getting DNS errors trying to connect to Second Life. We’re not sure where the issue is yet or how widespread the impact is, but we’re on the hunt for it. We’ll keep you posted.

Popularity: 4%


Logins Down, Again

January 09th, 2008 | Category: Grid Performance, Second Life News

Is it just me or is Second Life experiencing problems on an almost constant basis this new year? Let’s check:

Logins Down
[Resolved] Live Chat Support
[Resolved] Login issues

January 7th:
[RESOLVED] Login Difficulties
In-world map and wiki problems

January 6th:
[Resolved] Group Dividends
[RESOLVED] Intermittent asset server issues

January 3rd:
[RESOLVED] SL Inventory Issues at this time
[Resolved] Second Life Support Portal Restored

January 2nd:
[RESOLVED] Various inventory problems affecting some residents
Previous Login Difficulty
[COMPLETE] Rolling Restart - Wednesday January 2nd
[RESOLVED] Difficulties Rezzing Objects and Connecting To Second Life

Now, it is hard to tell, exactly, which days some of these took place, as they will post an announcement, and move it to the top when they update it. There were also numerous problems at the end of December, but not anywhere near as many as in January. Is this a sign of things to come? As more residents come online, and some even stay, it will probably get worse and worse. As Tateru notes on Massively,

When can we expect the current spate of problems to end? We honestly have no idea - there’s just not enough information to even guess; which is sort of the point here. Things seem to be getting worse, though, rather than better. It gives the feel of the service falling apart in a serious way. If that’s not the case, maybe someone should say something about that, and why that’s the wrong impression. Source: Peering inside - Second Life grid problems a daily occurrence for 2008

Me, I’m still waiting to be able to sign in tonight, looks like yet another night without any sim reviews or anything other than news being posted here.

Popularity: 3%

No comments

Grid Shutdown

December 19th, 2007 | Category: Grid, Grid Performance

Linden Labs has just posted notice that they are shutting the grid down to investigate a slowdown of the asset system in Second Life. The slowdown can cause you many problems inworld, including:

  • Inability to save notecards

  • Inability to compile scripts
  • Refusal of rezzed objects to return to inventory.

They recommend that you do not rezz anything of value until they have figured out the problem and fix it.

We’re still scoping this issue, and will keep you updated as we move past diagnosis and toward resolution. Until the scope of this issue is clear, we strongly suggest you avoid rezzing or transferring valuable (no-copy) assets or L$. Source: [GRID] Shutdown Imminent.

Popularity: 4%

No comments

Second Life Connectivity Problems

October 13th, 2007 | Category: Connection Issues, Grid Performance

By Stone Culdesac

If you are having trouble connecting, they have posted a notice on the Second Life blog about connectivity issues with Europe, people having trouble logging in and teleporting, apparently, it is some issue not related to Second Life, the way that I read it at least.

[10:55 a.m. PDT]

The connectivity issues are due to problems with the connection from Europe to the US via the UK and are affecting more than just connecting to Second Life. Source: Connectivty Issues

They’ve updated the blog, apparently it was a routing problem in London, they have redirected the traffic through Paris.

Popularity: 2%

No comments

Tired of Loosing Inventory Items?

October 13th, 2007 | Category: Grid Performance, Inventory Loss

I have several friends who have lost lots of their inventory recently, one lost all of her shapes skins, etc, and Linden Labs was only able to restore one of them, at least it was the best looking one. ;) Ina blog post on the Second Life blog, Hamilton Linden discusses the Inventory Loss Reduction Initiative, which contains several internal projects like Metrics Instrumentation, Region Crash Reduction, Asset Collection Improvement, Bug Fixing, Resident Reported Inventory Loss Analysis, Architectural Enhancements, and Perceived Inventory Loss.

How are they planning on doing it? Read on…

Metrics Instrumentation - For this project we are adding much more precise logging of error codes throughout the entire system for inventory rez, derez and transfers, as well as other system processes including teleport errors. For those not familiar with this terminology, in this context: rezzing is the act of taking an object out of your inventory and placing it in a Region, and derezzing is the reverse act of taking an item from a Region and placing it in your inventory.

Region Crash Reduction - Residents sometimes experience data loss during region crashes. This is especially true if a Resident rezzes a no-copy item and then the Region has to rollback to a previous checkpoint. Currently, 8% of all Residents sessions are terminated because of region crashes and rolling restarts. While most of these region crashes are able to recover without a rollback or data loss, we know this number is unacceptable.

Asset Collection Improvement - When an asset is no longer in any Residents’ inventory and not rezzed in any Region, then we collect it and set aside for deletion. However, because it is a very complex problem to determine which assets are not being used, there are cases where we accidentally collect an asset, which is still in someone’s inventory. Fortunately, we have a program that is watching and puts the item back in your inventory within an hour if we still have it. So next time you get this error, do be sure to check back in an hour. Source: Inventory Loss Reduction Initiative

Much more to read there in that post about the bug fixes, architectural enhancements and loss analysis, they also mention there is perceived inventory loss, where the item is not actually lost, residents just need to clear their cache and relog, and the steps are:

Go to Edit > Preferences on the menu bar
Click the Network tab
Click the Clear Cache button
Exit Second Life
Log back into Second Life
Wait in place for 5 minutes; Second Life needs to reload much of your previously cached information.

Be sure to check the Inventory Recovery Steps on the wiki.

If you have further questions or would like to discuss this blog post inworld, they will be holding an office hour at Longfellow at 56, 146, 25 on 2007-10-17 @ 2 PM PDT.

Popularity: 2%

No comments

More Grid Problems

October 06th, 2007 | Category: Grid Performance

I just logged in to grab a couple of Second Life URL’s for some other posts, boy, talk about bad timing, took forever to get the actual slurls, and now I see in some messages from residents that the search is still down, and some are having teleporting issues. I just needed to grab two slurls and that took me about 15 minutes. The latest post on the Second Life blog makes note and says they are addressing the problems.

[RE-OPENED 11:52 a.m. Pacific]

And yet again, the issue has raised its ugly head. Our Ops Team is already working to resolve it.

We will keep you posted on the progress. Source: [RE-OPENED] Gridwide Slowdowns

Popularity: 2%

1 comment

Large Portions of the Grid Will Be Down Saturday

September 15th, 2007 | Category: Grid Performance, Second Life News

Due to some electrical work being done to the collocation facility that houses much of Second Life’s grid, the entire beta grid and about 320 regions in the main grid will be down. The work will begin at 9pm SLT and may last until 3am SLT. This was previously supposed to be done tonight but for some reason was changed to the busiest night of the week. Via Second Life Insider

Popularity: 2%

No comments

The Grid of Late

August 12th, 2007 | Category: Grid Performance

Linden Labs has posted a blog post detailing some of the problems that have come about lately, such as the login problems yesterday, problems that have caused issues with inventory, search problems, transaction problems, you name it, and they had a disk drive fail, but not completely, so it was actually running but just really, really slow, and the raid software left it running instead of shutting it down, what it normally does. More information on their blog.

For the curious, I want to shed more light on the causes of the stability problems Second Life has experienced over the past four days. First, some background: the two facilities which currently make up the grid use encrypted IPSec tunnels (a form of VPN) to securely communicate with each other over the Internet. This is what allows, say, a simulator in Dallas to query our databases in San Francisco. Needless to say, if these tunnels don’t work, SL doesn’t work very well either.

On Wednesday, we experienced a failure wherein our primary bandwidth provider started dropping about 95% of our IPSec traffic bound from one site to another, but only for some of the tunnels. Other, non-IPSec, traffic was largely unaffected, and so this was a very difficult problem to diagnose and, crucially, get the provider to fix. Source: More info on this week’s grid problems

Aren’t computers great?

Popularity: 2%

No comments

Issues with the Grid

July 30th, 2007 | Category: Grid Performance

In a post at Second Life Insider, they say the recent issues we have been having with the Grid are being caused by some script kiddies named The Patriotic Nigras, and they figure someone else has to actually be causing all of the problems.

It’s unlikely that the Nigras themselves are actually responsible for the work, as most of them are ’script kiddies’ (people who cannot create or modify software) and this sort of thing seems to be well above their usual displayed capacity (usually limited to screaming obscenities, using cage-guns or employing the work of others). Most likely, their eagerness to cause trouble is being exploited by someone else.

As for the exploit itself, it was reported at least as early as February 12, 2006, and apparently remains unpatched to this day. It is relatively simple to take advantage of and as such, we’ll not be publishing the specifics at this time.

The exploit takes advantage of a feature-by-design, and as-such, is going to be tricky to fix without (a) breaking the actual intended feature, and (b) breaking something else - That said, there are several possible points at which the exploit can be closed. Source: What is wrong with the SL grid?

Some think it is because of the gambling ban, others think it’s just griefers causing trouble, we may find out one day and we may not. ;)

Popularity: 3%

No comments