Off the Top: Web Entries
Showing posts: 1-15 of 232 total posts
A Blog Move and Thin Catch-up
Yah, I know. It has been a while. Some things have changed, as I’m searching for what is next on the work front. Where I was it was a bit restrictive on sharing outward, so things got a little quiet. I’m still working on the Social Lenses / Complexity Lenses and have 80 to 90 stubs of ideas in my backlog of blogfodder, for here or the Personal InfoCloud.
A Move of Personal InfoCloud
I hadn’t posted to my blog, Personal InfoCloud in a long while. I was in the midst of a 16 part “Shift Happened” series, which was hitting embracing complexity as the next part of the series. I’m not sure if or when I will return to that. But, my work agreement frowned on sharing things out and I had a long negotiation about my prior work and corpus of IP around the Complexity Lenses. But, now that I’m back and able to freely write and share again I realized my blog where that happened much of the time needed to move off SquareSpace. Why? Poor customer support and small things breaking and them blaming me, when I hadn’t touched it in years.
The last two plus months I focussed on the move out and into another platform. I had looked at a few options for a month or so prior, but SquareSpace had one easy export path out, which is to WordPress, which I could self host (I have a few small blogs and sites that I have on self-hosted WP and they are fine). While there is a lot of turmoil in the WordPress sphere, going with the self-hosted option seems viable as a transition, if not longer option. I did an export of my SquareSpace site and in 20 minutes of export I had all my posts in WP and all comments, tags / categories, most media in blog posts, and the structure was there.
While the first step was 20 minutes to get to about 80 percent of a move done, the next portion took about two months between many meetings around advisory to start-ups, discussions about next steps (everybody was holding out until after the election, then to sort out what level of chaos may ensue, now…, and finding a lot of interest it is just getting things to a reality), mentoring professionally to director and up leadership in product management and cross-functional design and development engineering (with a lot of data focus and AI), data analytics and analysis of my own 20+ years of what I know so it can be better organized for others to pick-up. But, I had a deadline of the first week of February for the move out of SquareSpace to take place, as it was the next billing cycle.
The last two months of the move of the blog focussed on getting the design transitioned over or finding a viable design theme to use and bend to something I could work with. I found something, but it came with a lot of options and capabilities, which I initially embraced, then started printing out screens to single screen PDFs and taking the red pen to them (even after the move I think there are some things that may go, but also things that need work to come back). The next big haul was touching every post fixing some media links broken and fixing the URLs, which included the pre-post name date slug as part of the post name. I got those finally sorted out at the end of last week and Thursday I started moving the domains (from where I was developing it in a sandbox), shift to the production site, adding certificates, fixing odd typography issues, fixing routing issues, and other oddities. I hit the deadline.
Move Done and Next Steps for PIC
With the move done, I didn’t realize how much stress and mental clutter I had tied up in that move. I was managing todo lists in Obsidian, GitHub, and some quick reminders with times and dates on them. I felt free to start thinking about what I was focussing on two months prior and a ton of pressure released.
With the Personal InfoCloud blog I still need to fix links that go to Slideshare as most are broken, but I need to sort out what I want to do with those presentations. Jon and Rashmi have started a new replacement for Slideshare as a modern attempt, which I need to try a bit more and assess the fit for needs.
I also need to sort out the homepage of the site, as I’ve long wanted to have a homepage that sits in front of the blogs. I have that now, but I’m not happy with it. With the deadline out of the way I can have it as one of my projects I’m working through.
The categories, post listing, and search is also something I need to re-think and get into a better state. When I moved from TypePad to SquareSpace in 2011 to 2012 there wasn’t a good way to manage this, and what I cobbled together I hated. But, for PIC the platform is something I don’t want to think about I just want to use to post things I write. WordPress has a lot more options and I played with a couple before I put a hard focus on making the deadline about 5 to 6 weeks ago.
I have quite a few blog posts ready to be written. An introduction to the Complexity Lenses (there are over 90 of them now and in my master outline of them with sub-nodes there are over 1,500 nodes all together, which each node capable of being a page to at least 5 pages of explanation). This introduction post may iterate over time, which I’m fine with and not true blog with a line in time tied to it that other posts have. I also need to write up my “20 Social Roles”, which I do a lot of work around helping organizations sort through the roles and dynamics of their work, collaborating, cooperative, and collective environments, but also tool and platform builders creating tools that close the gaps of missing support for any and all of these Social Roles.
What Happens Here?
Here at vanderwal.net I need to get back to building a habit of blogging again. The weeknote is something I may do to help my rhythm. I still write a ton, but it is all in my notes. My daily notes, or “Daily Dump”, looks an awful lot like my first 4 to 7 years of blogging here (so 2000 to 2007 / 2008), before short snippets and observations started ending up in Twitter.
I still need to spend a week of heads down work to update the underlying code that the site runs on. I started that about 2 years back, but a day or two here and there weren’t cutting it and not a good way to make progress, particularly since it requires rewriting the code on my many templates to get data out and filling the pages in. Once that is done I have a few things I really want to address, like pagination on tag pages, and fixing the flow of the blog across time.
Whew!
If you have interest in chatting and catching up, or if you have a project, product, or work you would like help with please reach out.
Take care.
Weeknote - 18 October 2020
Okay, that week was the prior week’s weeknote. Now I’m trying to capture two weeks in one. The prior week was rather busy and the weekend full too.
The morning coffee walk, this week turned a bit wet and chilly. I may need to change from wearing shorts for my this trek to get me out my door and a bit of exercise to start the day. Seasons and other temporal changes of worldly transitions have really flown past this year with little acknowledgement. The trees are just starting to turn in their autumnal color pageant, but it seems like they were just bare and bright green sprouts coming out.
I got a note this week from my webhost, which had been bought quite a while ago by GoDaddy and they finally said they are transitioning and my host is going away. I know a lot of people who work at GoDaddy and the leadership and inhumane leadership problems are gone. But, they are planning on moving from a hosting plan and platform I love that fits what I want to keep going (this site) and some small experimental spaces playing with Python, NodeJS small services, and a little Ruby and moving to a service that really isn’t clear about what it does, nor what it offers, nor pricing, nor service, and it is only based in the UK. With Brexit it is deeply unclear what is going on in the UK with regulation and anything and that is one of the last places I would want to have anything hosted.
So, some of my time will be focussed in the next couple or few weeks transitioning elsewhere. I think I know where, which is a hosting platform from former founders and employees of my current host. They have similar offerings, but I’m needing to sort out what these changes will entail for some of the custom pieces I have and dealing with email.
I was in the midst of starting to plan an upgrade to the underlying code of the site to bring it to a modern version of PHP. This is on hold until I get the site moved.
Read
There wasn’t a lot of reading time this week. But, I sort of parked An Absolutely Remarkable Thing for now as the micro-fame discussions were something that was causing a lot of self reflection around similar. I picked up John Green’s The Fault in Our Stars and just a few pages in I’m happy with the swap as John Green’s writing voice is one I find comfort in.
I’m also reading / skimming back through some Richard Feynman as some friends have stumbled on to it and has lead to interesting discussions. I read Six Easy Pieces around 2003 or so after writing the draft of Model of Attraction and as I fleshed it out and it turned into Complexity / Social Lenses there is a strong underpinning in physics through Feynman’s introduction, followed by discussions with good depth in physics and quantum underpinnings.
Watched
The Pete Souza documentary, The Way I See It about his time as White House photographer for Reagan and Obama. It was completely wonderful and a solid reminder of what a great leader does through understanding things deeply and supporting all others through leading with empathy.
Listened
Tigran Hamasyan is a musician I stumbled upon through a “what is this” explainer on YouTube, which lead to a mini deep dive. The two videos that had been deeply intrigued and really enjoying his music are IMPOSSIBLE Time Signature or 4/4? Tigran Hamasyan Explained and The Rhythms of Tigran Hamasyan on David Bruce’s channel, which I have enjoyed and stumbled on before. The cross over and different mental model using math transformations and mapping patterns through size relevance patterns that are adaptive is really intriguing.
Food
I don’t understand why sole, particularly Dover or Petrale, is so hard to find on the East Coast. I swear they were pretty much a year round fish growing up on the West Coast. This week I stumbled on a decent sale on Dover Sole so made a quick fry in virgin olive oil and brown butter, with a dry coating of corn starch, rice crumbles, sea salt, and black pepper then finishing with lemon and quick fried capers and pickled capers. This was a good Sunday brunch to say the least.
Productivity
In this transition from light too mid-term notes in NValt to Obsidian for better organization and cross-linking and an app that actually works (NValt stopped working spectacularly). One of the things I was peeved about was the tagging I had done in NValt. But, Brett Terpstra knows tagging well and tucked the tags in the user interface of NValt into the tag field in Apple’s file metadata. The one that I’m really wanting to get organized is my blogfodder tag, which is really rough drafts of posts, or collections of notes no a subject.
Diffen for Comparisons
I stumbled across Diffen the other day thanks to Macdrifter’s Diffen mention. I have found it a great service for comparing things. But keep thinking of all the things I really want it to compare, but since it has two fields that allow you to compare any two things you can do it. I may keep the Diffen compares Holland vs Netherlands close at hand as it is a pet peeve and explaining it isn’t quite as easy as pointing to the link (particularly when people say, “well everybody calls it Holland”, the answer is everybody doesn’t and understanding what is correct is easy).
What to do with Podcast Favorites
Another thing I’m wanting to sort is podcasts I like, make that one’s I listen to and like. I have a list of podcasts I regularly listen to tucked into the left column in my links: podasts.
But, there are often podcasts I listen to that I really like and would like to easily share out to others. When I run into podcasts episodes that I hear mentioned I will track them down and most often use Huffduffer to grab it and putting into my listening queue that I most often consume in Overcast in the car driving to get my son or going through my morning routine that includes making breakfast and coffee and consuming them while scanning news and the day’s plans.
Last year I found many of the episodes of Exponent with Ben Thompson and James Allworth that I really liked a lot. While Overcast has a nice share component within it, that functionality takes the person clicking to it to Overcast’s web page for the podcast (or to the exact timestamp in the podcast) and to play it. While I like the idea of this, what I’m really wanting is to primarily link to the actual podcast page (hopefully this is something beyond a Soundcloud page, which I find to be really frustrating for this purpose as well).
Potential Zeef Solution
I do use a “podfodder” tag in Pinboard, which I occasionally push things into. But with this I don’t have it easily exposed elsewhere and people aren’t exactly looking for a podfodder tag they don’t know of (well they may do so now, but now isn’t then). I keep thinking I will do something similar I do to the “linkfodder” tag in Pinboard, which I use on things I read I really like (when I remember to tag them).
With “linkfodder” I pull that tag into Zeef, which is a list making and managing site that structures related content well, as a link widget. The Zeef link widget pulls the last 10 from the “linkfodder” list and makes them available in as a JavaScript component, which I embed in the side of this vanderwal.net blog. I could do the same thing for "podfodder’ (in 2 minutes I added the feed to a private page in Zeef and may make it public), but I’m not sure where the widget will be best placed.
Wishing a Solution Were Just Here
About a year ago Matt Haughey wrote about podcasting needs and more directly Matt Haughey has social subscription list wish. I keep hoping somebody would have built this podcasting social subscription list as a tool. It seems like a perfect thing for Huffduffer as a “rate after listening” feature. This seems to be wide open for somebody to do, it may not have great money attached to it, but it would be a great service that has value.
Happy New Year - 2016 Edition
Happy New Year!
I’m believing that 2016 will be a good year, possibly a quite good year. After 7 years of bumpy and 2015 off to a rough start on the health front it stayed rather calm.
I don’t make resolutions for the new year. It is a practice that always delayed good timing of starting new habits and efforts when they were better fits. The, “oh, I start doing this on on New Years” always seemed a bit odd when the moment something strikes you is a perfectly good moment to start down the path to improvement or something new.
This blog has been quiet for a while, far too long in fact. Last year when I was sick it disrupted a good stretch of posting on a nearly daily basis. I really would like to get back to that. I was planning to start back writing over the past couple weeks, but the schedule was a bit filled and chaotic.
Digging Through Digital History
This past year I did a long stretch working as expert witness on a social software case. The case was booted right before trial and decided for the defense (the side I was working with). In doing this I spent a lot of time digging back through the last 5 to 10 years of social software, web, enterprise information management, tagging / folksonomy, and communication. Having this blog at my disposal and my Personal InfoCloud blog were a great help as my practice of knocking out ideas, no matter how rough, proved a great asset. But, it also proved a bit problematic, as a lot of things I liked to were gone from the web. Great ideas of others that sparked something in me were toast. They were not even in the Ineternet Archive’s Wayback Machine. Fortunately, I have a personal archive of things in my DevonThink Pro repository on my laptop that I’ve been tucking thing of potential future interest into since 2005. I have over 50,000 objects tucked away in it and it takes up between 20GB to 30GB on my hard drive.
I have a much larger post brewing on this, which I need to write and I’ve promised quite a few others I would write. The big problem in all of this is there is a lot of good, if not great, thinking gone from the web. It is gone because domains names were not kept, a site changed and dropped old content, blogging platforms disappeared (or weren’t kept up), or people lost interest and just let everything go. The great thinking from the 90s that the web was going to be a repository for all human thinking with great search and archival properties, is pretty much B.S. The web is fragile and not so great at archiving for long stretches. I found HTML is good for capturing content, but PDF proved the best long term (10 years = long term) digital archive for search in DevonThink. The worst has been site with a lot of JavaScript not saved into PDF, but saved as a website. JavaScript is an utter disaster for archiving (I have a quite a few things I tucked away as recently as 18 months ago that are unreadable thanks to JavaScript (older practices and modifications which may be deemed security issues or other changes of mind have functional JavaScript stop working). The practice of putting everything on the web, which can mean putting application front ends and other contrivances up only are making the web far more fragile.
The best is still straight up HMTL and CSS and enhancing from there with JavaScript. The other recent disaster, which is JavaScript related, is infinite scroll and breaking distinct URLs and pages. Infinite scroll is great for its intended use, which is stringing crappy content in one long string so advertisers see many page views. It is manufacturing a false understanding that the content is valued and read. Infinite scroll has little value to a the person reading, other than if the rare case good content is strung together (most sites using infinite scroll do it because the content is rather poor and need to have some means of telling advertisers that they have good readership). For archival purposes most often capturing just the one page you care about gets 2 to 5 others along with it. Linking back to the content you care about many times will not get you back to the distinct article or page because that page doesn’t actually live anywhere. I can’t wait for this dim witted practice to end. The past 3 years or so of thinking I had an article / page of good content I could point to cleanly and archive cleanly was a fallacy if I was trying to archive in the playland of infinite scroll cruft.
Back to Writing Out Loud
This past year of trying to dig out the relatively recent past of 5 to 10 years with some attempts to go back farther reinforced the good (that may be putting it lightly) practice of writing out loud. In the past few years I have been writing a lot still. But, much of this writing has been in notes on my local machines, my own shared repositories that are available to my other devices, or in the past couple years Slack teams. I don’t tend to write short tight pieces as I tend to fill in the traces back to foundations for what I’m thinking and why. A few of the Slack teams (what Slack calls the top level cluster of people in their service) get some of these dumps. I may drop in a thousand or three words in a day across one to four teams, as I am either conveying information or working through an idea or explanation and writing my way through it (writing is more helpful than talking my way through it as I know somebody is taking notes I can refer back to).
A lot of the things I have dropped in not so public channels, nor easily findable again for my self (Slack is brilliantly searchable in a team, but not across teams). When I am thinking about it I will pull these brain dumps into my own notes system that is searchable. If they are well formed I mark them as blogfodder (with a tag as such or in a large outline of other like material) to do something with later. This “do something with later” hasn’t quite materialized as of yet.
Posting these writing out loud efforts in my blogs, and likely also into my Medium area as it has more constant eyes on it than my blogs these days. I tend to syndicate out finished pieces into LinkedIn as well, but LinkedIn isn’t quite the space for thinking out loud as it isn’t the thinking space that Medium or blogs have been and it doesn’t seem to be shifting that way.
Not only have my own resources been really helpful, but in digging through expert witness work I was finding blogs to be great sources for really good thinking (that is where really good thinking was done, this isn’t exactly the case now, unless you consider adding an infinitely redundant cat photo to a blog being really good thinking). A lot of things I find valuable still today are on blogs and people thinking out loud. I really enjoy David Weinberger, Jeremy Keith, and the return of Matt Webb to blogging. There are many others I read regularly (see my links page for more).
24 Ways: A Web Holiday Favorite
Nothing makes me happier than to see the winter holiday begin and 24 Ways start its annual release of web development and design goodness. Drew McLellan and the 24 Ways crew have done another great job and I look forward eagerly for every day’s gem that is released.
To make all of this better, 24 Ways is in its 10th year. Congratulations for all the great content and work, from the very first to the current offering of the day.
Deconstructing for Fun
There are two video gems I have fallen into really liking in the last year Every Frame a Painting and Comedians in Cars Getting Coffee.
Every Frame is a Painting
Every Frame is a Painting tickles the film nerd in me. This takes me straight back to a great class in media criticism by Father Mike Russo in undergrad. We not only learned how to watch film, but how to deconstruct it, which turned into how to make film for many in that class.
Tony Zhou who creates Every Frame is a Painting provides great insight into film direction and cinematography, by breaking down scenes and the make-up of a shot to convey a story through film. Film and its genres as well as directorial influences not only help see film with a new eye of appreciation, but the world beyond film. A lot of interaction design in technology heavily references film and the ability to direct attention and create an enjoyable experience.
Comedians in Cars Getting Coffee
I’ve wasn’t a fan of the Jerry Seinfeld show. I saw a decent amount out of inertia (was watching the show on same channel prior) or it was a lead-in to something I wanted to watch. But, while there were some gems, most was listening to people whine, which lead to that same whining tone coming from myself the following day.
But, Seinfeld’s stand-up was something I had appreciation for and enjoyed. But, he has a web video series with the construct of him driving a historic car to pick-up another comedian to go get coffee. Most of the episodes are 15 to 20 minutes of he and his fellow comedian talking craft and sharing stories.
Much like Every Frame… Comedians in Cars… puts the focus on deconstruction of the craft, background of the artist, and breaking things down. There is often quite a bit of humor, which also helps.
In college and the years when I lived in San Francisco I loved going to stand-up shows. There were a lot of really good comedians working through their craft in SF in the mid–80s to mid–90s. The best times were often at open mic nights where comics would try out new material and often spill out into the parking lot or streets for an hour or few of riffing and stories.
Deconstruction is Essential for Understanding
A lot of undergrad for me seemed to be about not only learning (building a corpus of knowledge), but learning to deconstruct and understand the world and craft around me. Comedy and film (media in general got this treatment) were two of many of the disciplines I learned to breakdown to understand at more atomic levels, so to understand how to build more than capably as well as much better.
Learning the craft of deconstruction through something fun like film and comedy is a great place to start. Warning - this will change how you not only watch and consume things and may change the enjoyment and mindless nature that is desired, but it does give enjoyment on many other levels.
Refinement can be a Hinderance
Refinement can be a hinderance.
We learned the lesson in early blogging years (late 90s and very early 00s) that just getting things out there in rough form has value. I look back at my early blogging at vanderwal.net from 2001 to 2003 and it is not exactly refined.
(Now for the big but)
Those early blog posts, up through 2006 are the ones I continually go back to and refind (or more of Google surfacing them for me when thinking I need insight on something that I want more insight on). They were a paragraph or few. They were straight brain dumps. Most importantly they were nodes that brought conversation, next thing colleagues, invitations to explain at conferences, and a great cadre of like minds.
Over time I was encouraged to be more refined and edited, which slowed things down. It slowed down to the point I am sitting on a massive amount of text and markdown documents tagged “blogfodder”. So, much I fear being called the godfather of blodfodder.
The past year my most valuable inbound content has been from a few voices sending things in TinyLetter. A few blog friends have sparked up their old blogs with old school medium length (one paragraph to eight or so) blog posts. Both TinyLetter and these medium length posts are most often stream of consciousness, not heavily edited, and are incredibly valuable as they are good smart insights from real perspective, not contrived want to be smart BS that just rehashes what was common knowledge for the last 6 to 15 years.
Enter the Tilde
This past month Paul Ford popped up Tilde.Club and the old internet and web was reborn. It is pure nostalgia, less for the tech, but for the mindset of discovery of people, how to do things, how to do things better, and connecting like souls and minds. Everybody was a maker and striving to understand the tools, but also to connect to a wider world. It was the new way forward, which didn’t exactly play out at all like that as the band of hacker / maker / understand deeply to make better for all was just an incredibly small group that connected in a couple thousand or so in the early 2000s out of the billions of people on this planet. We thought it was the mainstream as a couple thousand looked like a lot of people to have in a convention center in Austin (in 2001 there were about 1200 and that was the best tight group of similar minded people I’ve ever run across).
But, the early 2000s the hackers and makers blogged. It was unfinished. It was raw. It was fluid. It was quite valuable.
I’m loving Tilde (yah, most don’t understand it and may never and that is all good too). Also loving those back to writing and sharing regularly, nearly daily with short blog posts.
Manufacturing a Habit
I’m going to make an attempt to get back and make a habit of posting daily. I’ve been writing daily and just not posting. The more I write the shorter the pieces. The more I write the more I focus on writing better. But, this blog on vanderwal.net is going to be rough and non-edited (okay maybe lightly and after posting), while Personal InfoCloud will have a little more time and editing put into it (I have 40 to 50 social lenses related posts and about 15 Shift Happened posts to get posted there, along with a lot more that fits in neither of those categories).
As I found in the early 2000s getting things out there in rough form has a lot more value than just sitting on my hard drive, now tagged blogfodder. Sitting on things to refine may be the dumbest thing I’ve done in a long long time. I’m tired of the dumb things ruling.
Others that Pushed This for Me
Site Shift has Started
After seven to eight years with the same web host a move is underway again. This will be slower and it may hit reverse for parts. Having read Phil Gyford’s recounting his host move I think I am prepared for the scope of what this move entails.
In my time with this host I put up dev projects that then moved to their own servers, I experimented with a lot of different tools and services that I continue to use (or would love to get back to using), and I have a boat load of mail accounts set up for contextual use and family.
The are a few domains, a lot of subdomains, many databases, and many applications (my hand built and third party creations). I’m expecting to have to tweek some code and scripting to handle different versions of PHP and Python than I currently run.
Two Host Mambo
The move is splitting things to two different hosts (one a VPS and the other a modern hosted web host). The split is to give some of the more resource heavy applications like Fever and ThinkUp room to flex and grow, these are applications that only I use and are really helpful for a variety of reasons. Other applications I have run locally on a Mac Mini will move there as will old services I shuttered due to lack of web resources availalbe.
The bulk of what is here at vanderwal.net and publicly available will move to a web host with good management consoles and mail (for now). While I am comfortable living and working at command line, I like a good console to make things easier. Also having someone else doing security updates, patching, and upgrades is nice as well so I can focus on the things I really want to do.
Mail is something that I really want to improve. Having to pester to have somebody give the mailserver a kick to get mail functioning again is something that shouldn’t need to happen. I have run my own mail server in the past (10 years back) and I know not to do that again as it was a pain and that pain is much worse with dealing with SPAM as well as getting on the wrong side of a SPAM blacklist (difficult to get off of a blacklist or greylist for domain or IP block when you are fewer than a few thousand accounts). The days of small email services died 5 to 10 years ago and that gets worse with each passing year.
Mail for the moment is going with my web hosting. This is less than optimal, I know that well. But, a good sized web host has the bulk to deal with black / grey listing to some degree. I know my optimal choice is FastMail, but making that move will take more decisions to narrow down mail accounts and sorting the size I am willing to limit some accounts to.
Getting Real
This only gets real when the domains get repointed and propigate. That is not today.
Changing Hosts and Server Locations
I’ve been in the midst of thinking through a web host / server move for vanderwal.net for a while. I started running a personal site in 1995 and was running it under vanderwal.net since 1997. During this time it has gone through six of 7 different hosts. The blog has been on three different hosts and on the same host since January 2006.
I’ve been wanting better email hosting, I want SSH access back, more current updates to: OS; scripting for PHP, Ruby, and Python; MySQL; and other smaller elements. A lot has changed in the last two to three years in web and server hosting.
The current shift is the 4th generation that started with simple web page hosting with limited scripting options, but often had some SSH and command line access to run cron jobs. The second was usually had a few scripting options and database to run light CMS or other dynamic pages, but the hosting didn’t give you access to anything below the web directory (problematic when trying to set your credentials for login out of the web directory, running more than one version of a site (dev, production, etc.), and essential includes that for security are best left out of the web directory). The second generation we often lost SSH and command line as those coming in lacked skills to work at the command line and could cripple a server with ease with a minor accident. The third has been more robust hosting with proper web directory set up and access to sub directories, having multiple scripting resources, having SSH and command line back (usually after proven competence), having control of setting up your own databases at will, setting up your own subdomains at will, and more. The third generation was often still hosting many sites on one server and a run away script or site getting hammered with traffic impacted the whole server. These hosts also often didn’t have the RAM to run current generations of tools (such as Drupal which can be a resource hog if not using command line tools like drush that thankfully made Drupal easier to configure in tight constraints from 2006 forward).
Today’s Options
Today we have a fourth generation of web host that replicates upgraded services like your own private server or virtual private server, but at lighter web hosting prices. I’ve been watching Digital Ocean for a few months and a couple months back I figured for $5 per month it was worth giving it a shot for some experiments and quick modeling of ideas. Digital Ocean starts with 512 MB or RAM, 20GB of SSD space (yes, your read that right, SSD hard drive), and 1TB of transfer. The setup is essentially a virtual private server, which makes experimentation easier and safer (if you mess up you only kill your own work not the work of others - to fix it wipe and rebuild quickly if it is that bad). Digital Ocean also lets you setup your server as you wish in about a minute of creation time with OS, scripting, and database options there for your choosing.
In recently Marco Arment has written up the lay of the land for hosting options from his perspective, which is a great overview. I’ve also been following Phil Gyford’s change of web hosting and like Phil I am dealing with a few domains and projects. I began looking at WebFaction and am liking what is there too. WebFaction adds in email into the equation and 100GB of storage on RAID 10 storage. Like Digital Ocean it has full shell scripting and a wide array of tools to select from to add to your server. This likely would be a good replacement for my core web existence here at vanderwal.net and its related services. WebFaction provides some good management interfaces and smoothing some of the rough edges.
There are two big considerations in all of this: 1) Email; 2) Server location.
Email is a huge pain point for me. It should be relatively bullet proof (as it was years ago). To get bullet proof email the options boil down to going to a dedicated mail service like exchange or something like FastMail, a hosted Exchange server, or Google Apps. Having to pester the mail host to kick a server isn’t really acceptable and that has been a big reason I am considering moving my hosting. Also sitting on servers that get their IP address in blocks of blacklisted email servers (or potentially blacklisted) makes things really painful as well. I have ruled out Exchange as an option due to cost, many open scripts I rely on don’t play well with Exchange, and the price related to having someone maintain it.
Google Apps is an option, but my needs for all the other pieces that Google Apps offers aren’t requirements. I am looking at about 10 email addresses with one massive account in that set along with 2 or 3 other domains with one or two email accounts that are left open to catch the stray emails that drift in to those (often highly important). The cost of Google for this adds up quickly, even with using of aliases. I think having one of my light traffic domains on Google Apps would be good, the price of that and access to Google Apps to have access to for experimentation (Google Apps always arise in business conversations as a reference).
FastMail pricing is yearly and I know a lot of people who have been using it for years and rave about it. Having my one heavy traffic email there, as well as tucking the smaller accounts with lower traffic hosted there would be a great setup. Keeping email separate from hosting give uptime as well. FastMail is also testing calendar hosting with CalDAV, which is really interesting as well (I ran a CalDAV server for a while and it was really helpful and rather easy to manage, but like all things calendar it comes with goofy headaches, often related timezone and that bloody day light savings time, that I prefer others to deal with).
Last option is bundled email with web hosting. This has long been my experience. This is mostly a good solution, but rarely great. Dealing with many domains and multitudes of accounts email bundled with web hosting is a decent option. Mail hosting is rarely a deep strength of a web hosting company and often it is these providers that you have to pester to kick the mail server to get your mail flowing again (not only my experience, but darned near everybody I know has this problem and it should never work this way). I am wondering with the benefits of relatively inexpensive mail hosting bundled into web hosting is worth the pain.
I am likely to split my mail hosting across different solutions (the multiple web hosts and email hosts would still be less than my relatively low all in one web hosting I currently have).
Server Location
I have had web hosting in the US, UK, and now Australia and at a high level, I really don’t care where the the servers are located as the internet is mostly fast and self healing, so location and performance is a negligible distance for me (working with live shell scripting to a point that is nearly at the opposite side of the globe is rather mind blowing in how instantaneous this internet is).
My considerations related to where in the globe the servers are hosted comes down to local law (or lack of laws that are enforced). Sites sitting on European hosts require cookie notifications. The pull down / take down laws in countries are rather different. As a person with USA citizenship paperwork and hosting elsewhere, the laws that apply and how get goofy. The revelations of USA spying on its own people and servers has me not so keen to host in the US again, not that I ever have had anything that has come close to running afoul of laws or could ever be misconstrued as something that should draw attention. I have no idea what the laws are in Australia, which has been a bit of a concern for a while, but the host also has had servers in the US as well.
My options seem to be US, Singapore, UK, Netherlands, and Nordic based hosting. Nearly all the hosting options for web, applications, and mail provide options for location (the non-US options have grown like wildfire in the post Edward Snowden era). Location isn’t a deciding point, but it is something I will think through. I chose Australia as the host had great highly recommended hosting that has lived up to that for that generation of hosting options. It didn’t matter where the server was hosted eight years ago as the laws and implications were rather flat. Today the laws and implications are far less flat, so it will require some thinking through.
Non-UNIX Timestamping has Me Stamping in Frustration
In the slow process of updating things here on this site I have nearly finished with the restructuring the HTML (exception is the about page, which everytime I start on it the changes I start to make lead quickly to a bigger redesign).
Taking a break from the last HTML page restructuring I was looking at finally getting to correctly timestamping and listing the post times based on blog posting location. Everything after the 1783rd blog post currently picks up the server time stamp and that server is sitting in Eastern Australia, so everything (other than blog posts from Sydney) are not correctly timestamped. Most things are 14 to 15 hours ahead of when they were posted - yes, posted from the future.
Looking at my MySQL tables I didn’t use a Unix timestamp, but a SQL datetime as the core date stored and then split the date and time into separate varables created with parsing timestamp in PHP. This leaves 3 columns to convert. It is a few scripts to write, but not bad, but just a bit of a pain. Also in this change is setting up time conversions that are built into the post location, but shifts in time for day light savings starts adding pain that I don’t want to introduce. I’ve been considering posting in GMT / UTC and on client side showing the posting time with relative user local time with a little JavaScript.
I would like to do this before a server / host move I’ve been considering. At this point I may set up a move and just keep track of the first post on the new server, then at some point correct the time for the roughly 500 posts while the server was in Eastern Australia.
Mind the Construction Dust
I’m in the midst of a structuring here across all the pieces of vanderwal.net. It started in January with another project, a meetp-up hack to dive into Zurb Foundation. Within a couple weeks of starting down that path I decided it would be fine time to rebuild and redesign vanderwal.net using Foundation. Before I started down the road leaving the horses behind I desided I was going to update the structure of the HTML of these pages and bring them into modern times with HTML5 and CSS3.
This thinking and tinkering has been finally fixing some of the underlying details that bugged me, but it also allowed to set a much better and more object focussed semantics. This shift will also enable the content objects to flow better and be better foundations for a redesign as well.
While I have no idea what the redesign will be and not even thinking of that, I did find the original photo that I modified to be used for the header image and I put that to the pages I have touched. The new image now is much wider to allow for a fluid page and the “vanderwal.net” text is now out of the image and I a truly proper H1, that has alluded me for a long time (and bugged me to no end). The menu of the updated pages has brought back the selected portion of the site with a bleed to page, which was there at the beginning, but some shift in CSS caused it to go away.
I may, possibly likely, shift hosting at some point in the near future, but that may wait until I have some of the underpinnings of the blog tool updated a little. Some of those changes will wait a little, but have been brewing a long time. I don’t think I am bringing comments back, but will likely bring in web mentions (Jeremy Keith has a great explaination). There is a lot going on in the IndieWeb that has been inspiring and may trigger some more changed that I have longed for to finally get put in place.
BTW, this is the short version of this. Two prior attempts at writing up something short both ended up over 2,500 words.
Brett Terpstra Focusses on His Work Full-time
I have been a fan of Brett Terpstra for some time. I found his site through a few buds who focus on productivity and personal workflows (including scripting). I have followed his Systematic podcast since the first episode and have found it is the one podcast I listen to when my weekly listening dwindles to just one podcast. His nvALT became an app that is always running and where a lot of writing snippets get stored on my Mac (that content I also reach on my iOS devices to edit and extend). His Marked2 app not only is my Markedown viewer, but a rather good writing analysis tool.
Not only all of this but Brett is a tagger and not only tags, belives tagging is helpful for personal filtering and workflow, but has built tools to greater extend tagging in and around Mac and iOS. If you talk folksonomy and pull the third leg of it, person / identity back into just your own perspective and keep the tag and objects in place you have the realm that Brett focusses and pushes farther for our own personal benefit.
Brett Steps Out to Focus on His Work
This week I have been incredibly happy to learn that Brett moved out of his daytime job to and his new job is to focus on his products, podcast, writing, and new projects and products. This is great news for all of us. Brett took this step before, but we can help him keep these tools and services flowing by supporting him.
If you have benefitted from Brett’s free products of want to ensure the great services and tools that Bret has created you paid for keep improving go help him out.
Prepping to Move Personal InfoCloud
I am in the midst of moving my Personal InfoCloud blog from TypePad to SquareSpace, so blogging there has slowed down a little bit. The move is related to some of my modifications and TypePad updates after they SixApart was sold and the TypePad pages picked up a ton of JavaScript for Facebook and other things I do not use, but the scripts add to the download time and occasional funky display. Some modification on their end broke all of my pagination that I had ensured was still working even though I use my own templates. The point of having a hosted service is things just work.
I have all my posts and comments from Personal InfoCloud moved over and it is just a clean-up of the HTML and getting the CSS set properly. I am going to move the domain before the rest of the design is done as it may be some time doing the a redesign.
I am not using SquareSpace 6, the latest and greatest version as that did not automatically import form TypePad and and version 5 did. The template I spent a couple nights a month back modifying was built for version 5, so for now it will stay there. I’m not sure when I will flip the switch on it, but it will likely be in this next month.
HTML5 Demo Watch
Thanks to the Berg Friday Links I found the Suit up or Die Magazine and Cut the Rope HTML5 demo sites.
Both have me thinking this is really close, then I remember one of my favorite periodical apps, Financial Times went HTML5 more than a year ago. FT went HTML5 to better manage the multi-platform development process needed for iOS and the multitude of Android versions. While many have said the development is roughly 1.5x what it would take for just one platform development it does same incredible amount of time building an app across all platforms. Since all the major smart phone platforms have their native browsers built on webkit, there is some smart thinking in that approach.
Personally, my big niggle with the FT app is while it is browser based doesn’t have Instapaper built-in and it moves me out of the app to send a link of an article (often to myself because lacking Instapaper) rather than natively in the app, or exposing browser chrome so that I can do that while still remaining in the app and in reading their content mode. It would be really smart for FT to sort this out and fix these as it would keep me in the site and service reading, which I am sure they would love. If they could treat both of those like they do with Twitter and Facebook sharing out all within the app it would be brilliant.