tag:blogger.com,1999:blog-6569681.post114235189585994458..comments2024-01-15T13:17:33.771-08:00Comments on Geeking with Greg: Remote storage on Amazon S3Greg Lindenhttp://www.blogger.com/profile/09216403000599463072noreply@blogger.comBlogger15125tag:blogger.com,1999:blog-6569681.post-45124947908296460872007-10-09T12:31:00.000-07:002007-10-09T12:31:00.000-07:00Thanks, Robert, glad to see that they are doing th...Thanks, Robert, glad to see that they are doing that.<BR/><BR/>Oops, sorry about the timestamp format on the comments. I fixed that.Greg Lindenhttps://www.blogger.com/profile/09216403000599463072noreply@blogger.comtag:blogger.com,1999:blog-6569681.post-33991606034487477582007-10-09T12:20:00.000-07:002007-10-09T12:20:00.000-07:00S3 now has a service level agreementhttp://www.ama...S3 now has a service level agreement<BR/><BR/>http://www.amazon.com/gp/browse.html?node=379654011<BR/><BR/>Why do the comments list only the time they're posted and not the date? How useless and annyoing.Robert Vadnaishttps://www.blogger.com/profile/12159736951880674539noreply@blogger.comtag:blogger.com,1999:blog-6569681.post-25110182269642012492007-06-21T21:01:00.000-07:002007-06-21T21:01:00.000-07:00Greg, I always appreciate the way you do a "look b...Greg, I always appreciate the way you do a "look back" on a post and give updates as time passes. <BR/><BR/>Good stuff,<BR/>JoffAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-6569681.post-1166016296711226572006-12-13T05:24:00.000-08:002006-12-13T05:24:00.000-08:00Check out http://www.btdigitalvault.bt.com and als...Check out http://www.btdigitalvault.bt.com and also http://www.bell.ca/PersonalVault<BR/><BR/>The big Telco's are catching up - the differentiator is that after you upload your data what do you do there after? Hence a portal to share all your media and also social networking extensions.<BR/><BR/>I believe that this solution is build by a company called Casero and the website is www.casero.comAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-6569681.post-1156271068895364982006-08-22T11:24:00.000-07:002006-08-22T11:24:00.000-07:00I suppose I'm sitting on both sides of the fence h...I suppose I'm sitting on both sides of the fence here. On the one hand, I've just added <A HREF="http://cardbox.wordpress.com/2006/07/11/amazon-s3-and-cardbox-2/" REL="nofollow">automated backup onto Amazon S3</A> as a feature of <A HREF="http://www.cardbox.com" REL="nofollow">Cardbox</A>, and I can definitely see some opportunities for building exciting business on the basis of S3.<BR/><BR/>On the other hand, there are some serious risks too. <BR/><BR/>I've been going into some detail about both the benefits and the risks of using S3 in <A HREF="http://www.tunesafe.com" REL="nofollow">an ongoing blog series</A>. I'm using an (imaginary) iTunes backup service called Tunesafe as an example. The benefits were covered last week; this week I'm going through the risks, and they get worse the longer you look. By the end of the series it looks as if using S3 will put you at risk of arrest...Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-6569681.post-1143235177573068342006-03-24T13:19:00.000-08:002006-03-24T13:19:00.000-08:00How about using the S3 service as a second tier ba...How about using the S3 service as a second tier back up, where all you house there is encrypted datasets that you go get when something really bad happens?Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-6569681.post-1143076151222325632006-03-22T17:09:00.000-08:002006-03-22T17:09:00.000-08:00It's amazing how someone can sneeze at Google and ...It's amazing how someone can sneeze at Google and it's front page news, while there are other very cool companies (much like yours Greg) doing cool stuff. It's nice to be "hot" until of course the time comes when your "cold". S3 looks interesting and Amazon has been very quiet about it.amckinnishttps://www.blogger.com/profile/01669076739841687326noreply@blogger.comtag:blogger.com,1999:blog-6569681.post-1142479593287114432006-03-15T19:26:00.000-08:002006-03-15T19:26:00.000-08:00Internet latency doesn't *have* to be 100s of mill...Internet latency doesn't *have* to be 100s of milliseconds. Having datacenters close to most of your users or edge caching can take that down to 10s of millis. And with asychronous javascript you can make web applications *feel* responsive even though their data is more than a local disk seek away. Look at Google maps (an app that uses both these techniques) and reconsider your comment "There's no way you can make more than a couple data requests to S3 in the 0.5 - 1 seconds you have to serve your web page in real-time."John Cormiehttps://www.blogger.com/profile/08624945931699192996noreply@blogger.comtag:blogger.com,1999:blog-6569681.post-1142460965432019462006-03-15T14:16:00.000-08:002006-03-15T14:16:00.000-08:00I can't see anyone using this to build a real busi...I can't see anyone using this to build a real business. There are countless web hosting services that offer significantly cheaper storage, PHP/CGI capabilities and no latency (assuming you are building a web app hosted on their machines). Or, you buy and co-locate a machine if you need more power/storage.<BR/><BR/>If you're building a application that needs access to a massive amount of storage you wouldn't use someone elses remote web-based storage. It just doesn't make any sense.<BR/><BR/>Just like your comment about other "Web 2.0" sites turning to sh*t once they get big enough to be used by more than hobbyists, this is something that will never scale. Oh sure, amazon will have plenty of disk space and bandwidth to serve billions of people, but no business-class (read: revenue generating) service that uses a lot of either would tolerate the crappy performance and security issues.<BR/><BR/>I can't even see this being used for amazon's web merchants. They pay some hosting company a small fee so they can have a URL and some files there, and then use amazon's merchant interfaces and existing databases for everything else. They don't need S3. Unless amazon gets into the "domain/web site hosting" business and then everything is on their servers.<BR/><BR/>I guess that hobbyists who pay for a very small hosting package and need storage for their service that makes it so you never have to leave the house to interact with the 43 people who share photo libraries of koala bears with you via personalized RSS search. Maybe they need S3.<BR/><BR/>Web 2.0 is just as much bubble and hype as Web 1.0.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-6569681.post-1142445590106172052006-03-15T09:59:00.000-08:002006-03-15T09:59:00.000-08:00That's an interesting thought, Guan. But I'm havi...That's an interesting thought, Guan. But I'm having difficulty seeing exactly how that might work.<BR/><BR/>So, you'd build out your Flickr knock-off photo sharing site front-end, but only have a small pool of webservers for your app? Use Amazon S3 for storing all the photos?<BR/><BR/>So, you probably can't retrieve all the photo data in real time from Amazon S3 due to latency. At the very minimum, you'd have to cache the active set of thumbnails on your webservers. You could store inactive thumbnails and the full photo data on Amazon S3.<BR/><BR/>Okay, so lets say you do all this. What savings did you get from using Amazon S3?<BR/><BR/>You still have to build out the webserver cluster and thumbnail storage cluster. You outsourced having to build a large array of disks for storing the larger imagine files.<BR/><BR/>Is that all that much easier? Even if it is, does the hit to response time on your website, the higher ongoing costs of using S3 over your own disk cluster, and loss of control from outsourcing this piece of your infrastructure make this a good tradeoff?<BR/><BR/>Not at all clear to me. But maybe I'm the only one.Greg Lindenhttps://www.blogger.com/profile/09216403000599463072noreply@blogger.comtag:blogger.com,1999:blog-6569681.post-1142444224905395732006-03-15T09:37:00.000-08:002006-03-15T09:37:00.000-08:00I see this being useful for web applications that ...I see this being useful for web applications that <I>require</I> large amounts of storage, but where storage as such is not the product.<BR/><BR/>For example, a good photo sharing service is not primarily a storage service, but it would require large amounts of online storage in a way that's difficult or expensive for small startups to provision; the primary value-add is not in the storage, however, but in the photo sharing app itself.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-6569681.post-1142374905443613572006-03-14T14:21:00.000-08:002006-03-14T14:21:00.000-08:00S3 is offering a base platform with a defined set ...S3 is offering a base platform with a defined set of economics that startups will have to beat in order to be competitive. Hence my suggestion that this is sort of raising the minimum bar.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-6569681.post-1142372415567862342006-03-14T13:40:00.000-08:002006-03-14T13:40:00.000-08:00I would think there is a lot of room to add a surc...I would think there is a lot of room to add a surcharge on top of the $15/month for 100GB.<BR/><BR/>XDrive charges over $1100/month for 50GB!<BR/><BR/>Of course, the bandwith charges from Amazon would increase your costs somewhat.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-6569681.post-1142370906916089702006-03-14T13:15:00.000-08:002006-03-14T13:15:00.000-08:00Definitely applicable for backup/disaster recovery...Definitely applicable for backup/disaster recovery. Also interesting for something like storing images (ala Flickr).<BR/><BR/>However it doesn't expose any sort of search API so you can store data but you can't find it unless you know the exact ID you're looking for. Seems to me that any intelligent application is going to want search... So you keep the data on S3 and have indexes elsewhere in your infrastructure? Why?Andy Harbickhttps://www.blogger.com/profile/01207294937045717563noreply@blogger.comtag:blogger.com,1999:blog-6569681.post-1142359820457795242006-03-14T10:10:00.000-08:002006-03-14T10:10:00.000-08:00Hey Greg. Good points. I didn't mean to imply th...Hey Greg. Good points. I didn't mean to imply that this was an enterprise level offering or scalable offerings for large numbers of users. Instead, I'm talking about smaller "situated apps" that can suddenly be easily created without much difficulty. The ease of being able to just use this rather than setting up a system on your own can make it much easier for rapid prototyping and simple design for small focused apps -- an area I think is going to be very important.Anonymousnoreply@blogger.com