avatarAlex Philippe

Free AI web copilot to create summaries, insights and extended knowledge, download it at here

4873

Abstract

f Ads’.</h2><p id="e5e8">A developer at Jyllands-Posten pointed me to a setting in <i>the</i> performance measuring tool, <a href="http://www.webpagetest.org/">WebPageTest</a>.</p><p id="b8c3"><i>(WebPageTest is <b>what you use</b>, when you do performance tests. <b>SpeedCurve is actually based on WebPageTest</b> — and the most important things in SpeedCurve are the automated tests and a much better design/UI, at least some of the parts — I’ll get back to that.)</i></p><p id="ac27">What you have to do, before you do a WebPageTest test, is to ask WebPageTest to <b>remove the letters ‘PTST’ from the user agent string</b> (which every browser uses to identify itself):</p><figure id="f815"><img src="https://cdn-images-1.readmedium.com/v2/resize:fit:800/1*XitVzBWd_DGzCIjccWOjHw.jpeg"><figcaption></figcaption></figure><p id="e364"><i>(I’ve written <a href="http://ebudvikling.dk/blog/2016/02/15/et-flueben-i-webpagetest-kan-betyde-meget-for-din-performance-maaling/">a blog post in Danish</a> about this nifty little feature.)</i></p><p id="31bb">‘PTST’ is the culprit in all of this. When our ad technology provider AdTech (<a href="http://oneadserver.aol.com/">now a part of AOL</a>) sees a browser with these four magic letters in the user agent, it withholds the ads from rendering. The reason: <b>To avoid wasting ad displays on tests</b>. Which makes sense, when you think about it.</p><p id="a021">Run a test on WebPageTest with this checkbox checked and you get <i>everything</i>. And that’s what we want. I’ve seen tests where the<b> ‘fully loaded’</b> time (the browser is saying “I’m totally done with loading this site now”) <b>multiplied by 5</b>; that’s a 400% increase! In the same test the <b>total number of requests was multiplied by 3</b> (200% increase).</p><p id="1f8d">Oh, and our <b>SpeedIndex</b> value (an expression of how fast the first screen view/viewport loads) <b>increased by 30%</b> in a test.</p><p id="24ab">But while WebPageTest can give us the correct data, <b>it can’t automate it</b>. We could do something via <a href="https://sites.google.com/a/webpagetest.org/docs/advanced-features/webpagetest-restful-apis">the WebPageTest API</a>, but this is something we want to avoid, so as to not have too many products and service to monitor and maintain.</p><p id="8a91">We then went back into SpeedCurve, but there was no feature to allow this. But… in the ‘Enterprise’ edition of SpeedCurve you are allowed to use <a href="https://sites.google.com/a/webpagetest.org/docs/using-webpagetest/scripting">the WebPageTest scripting language</a>. One of the things you can do here is <b>set the user agent, which is exactly what we wanted to do</b>.</p><p id="eefd">Documents were written, meetings were held, decisions were made. And we (across JP/Politikens Hus, that is Ekstra Bladet, Politiken and Jyllands-Posten) <b>signed up for SpeedCurve Enterprise</b>. O, how we thought we had it made.</p><p id="a842">We now saw SpeedCurve rendering the <i>entire frontpage</i>. Just like we wanted. And we <b>started lacking in the comparisons </b>in SpeedCurve, just as we had expected. Especially compared to the Danish Broadcasting Corporation (which has no ads, since they are funded through Public Service).</p><p id="2930">And the good times kept on coming. SpeedCurve announced that they would now support the <b>same browsers as you can choose between in the developer tools in Google’s Chrome browser</b>. A developer at Politiken tested this and yes, it meant we no longer had to script our user agent. This was a huge plus.</p><p id="3606">Just look at what happened once SpeedCurve updated the browsers and <b>started including ads</b>:</p><figure id="3451"><img src="https://cdn-images-1.readmedium.com/v2/resize:fit:800/1*qDl1ZCRvq4Df8XJ_-4E_1w.png"><figcaption></figcaption></figure><figure id="f16c"><img src="https://cdn-images-1.readmedium.com/v2/resize:fit:800/1*S0yQfx9Xvxm3BpTAXBSUTA.png"><figcaption></figcaption></figure><figure id="ca74"><img src="https://cdn-images-1.readmedium.com/v2/resize:fit:800/1*coOQm61VDAbkCz7rD7TFKA.png"><figcaption></figcaption></figure><figure id="8af5"><img src="https://cdn-images-1.readmedium.com/v2/resize:fit:800/1*bjoBX9-KatudVZE_IKPv_w.png"><figcaption></figcaption></figure><p id="bbdb">As you can see, ads have a…certain influence on our front page.</p><p id="767b">These two screenshots from SpeedCurve shows how big a percentage third party stuff (here; ads) take up of the front page:</p><figure id="db75"><img src="https://cdn-images-1.readmedium.com/v2/resize:fit:800/1*AoHX6PgiVGzvOWyyWKtOPg.png"><figcaption></figcaption></figure><figure id="2d69"><img src="https://cdn-images-1.readmedium.com/v2/resize:fit:800/1*rAHw9tS-CTQNzbV_B-zfIg.png"><figcaption></figcaption></figure><p id="4480">Notice those percentage numbers…</p><p id="51e5">When something takes up almost 80 p

Options

ercent of a websites requests and sites shouldn’t it also receive about 80 percent of the attention?</p><h2 id="4c1a">PSTS back in, ads back out</h2><p id="955b">Alas, it wasn’t to last. <b>SpeedCurve changed the browsers and reintroduced ‘PTST’ into the user agent string.</b> Therefore; no ads. We noticed this and went back to scripting the user agent. But that didn’t work either. Though it had earlier.</p><p id="6f31">I got in touch with the SpeedCurve folks. They told me they had fixed a ‘bug’ and that <b>a test browser should <i>always </i>label itself as such</b>, as Mark from SpeedCurve told me in an email:</p><p id="a423" type="7">WPT should always be identifying itself, even if the UA string has been set via scripting.</p><p id="276d">Instead he created <a href="https://github.com/WPO-Foundation/webpagetest/issues/606">an issue</a> with WebPageTest to allow the user to set the user agent (without ‘PTST’) in the scripting language. <b>Nothing has happened since April 25th.</b> Steve Souders (who is the closest you’ll come to a ‘Mr. Performance’) who also works at SpeedCurve has created <a href="https://github.com/SpeedCurve-Metrics/SpeedCurve/issues/62">an issue</a> with SpeedCurve itself to allow us to remove PTST via a checkbox, like in WebPageTest. <b>This issue was created on March 1st</b>.</p><p id="d119">We still had one shot left though: <b>Whitelist a browser with a ‘PTST’ user agent with our ad technology provider</b> to to allow the SpeedCurve test browsers to see the entire page rendered. Unfortunately, this is not possible since it is a “global setting across all client networks”. That means, it would have to be changed across all of the sites that use their technology. According to <a href="http://oneadserver.aol.com/">their own website</a> they have 74 countries with active clients.</p><p id="484c">I then asked if we could allow the browser through if we scripted the user agent to include the word “SpeedCurve”. In effect, <b>their block functionality would allow a browser through if <i>both </i>the words ‘PTST’ and ‘SpeedCurve’ are in the user agent string. But no dice:</b></p><p id="3ef4" type="7">As long as PTST is in the UA we will block it.</p><h2 id="c77f">Alternatives?</h2><p id="bb21">This is, obviously, a precarious situation for us to be in. <b>We can’t measure the performance of our entire site automatically</b>.</p><p id="0fdf">The logic step is to look at alternatives. So far I’ve only tried one: <a href="https://calibreapp.com/">Calibre</a> (which was suggested to me by the same colleague who suggested SpeedCurve). I even wrote to the guy behind Calibre up front to be sure that it would include ads. But the same result: A fast, lean website. Which just isn’t the truth ;-)</p><p id="5988">Until SpeedCurve (or WebPageTest) comes up with a change we <i>might</i> look at the initial no-no: <b>Running automated WebPageTest tests through their API</b>. As Jyllands-Posten’s developer suggested, <b>we might be able to get it up and running pretty fast <a href="http://calendar.perfplanet.com/2014/webpagetest-private-instances-in-five-minutes/">using Amazon</a></b>.</p><p id="9432">So… here we are. Thinking about what to do. Since we can’t automatically measure our entire page render, we can’t <i>really</i> do any performance budgets. We can’t measure any tweaks or changes, either. <b>We could do it via manually tests but that is the last way out.</b></p><p id="77b0"><i>(Also note: Performance budgets are really hard to do, once you’ve got ads in the mix. The load and performance of them vary a lot; week to week, day to day, hour to hour, even banner to banner. Also, the biggest influence on your performance is outside of your control. So ask yourself if a performance budget is the way to go.)</i></p><p id="fa04">If you made it all the way through this article and have either a trick (or a fully fledged automated performance test tool which include ads…) up your sleeve, <b>please leave a comment.</b></p><p id="3b36">Banner ads (and for us; the way they are found, delivered and rendered) are a huge performance culprit but we can’t automate the measurements of that fact. <b>We are stuck with manual tests in WebPageTest — or browser developer tools like those in Google Chrome.</b></p><p id="be1a">(I you found this post by Googling your own frustrations, know this: <b>You are not alone</b>.)</p><h2 id="4029">Update on June 14th, 2016:</h2><p id="d99c">Apparently this <b>isn’t a problem will all ad tech providers</b>:</p> <figure id="e652"> <div> <div> <img class="ratio" src="http://placehold.it/16x9"> <iframe class="" src="" allowfullscreen="" frameborder="0" height="undefined" width="undefined"> </div> </div> </figure></iframe></div></div></figure></article></body>

SUCCESS

The Scaffolding Principle: Here’s How You Can Reach That Impossible Goal

Making the impossible possible

Public domain historic photo

In the movie Meet the Fockers, there’s a hilarious scene where a cat gets out of the toilet after a flushing noise. Did I say to myself: WTF? A trained cat that goes to the loo?! Little did I know this was not far from reality, as we’ll see in a couple of lines.

Many times, we feel intimidated by seemingly impossible goals. You know the expression:

The fool didn’t know it was impossible, so he did it.

Which begs the question: is our common sense limiting us?

That’s what we’ll find out in a few lines.

The cat who learned to take a dump in the toilets

Many years after watching the movie Meet the Fockers, I finally saw a picture of a cat taking a dump in the toilet:

Photo by Reward on Wikipedia Commons

I was intrigued. We know how stubborn a cat can be, right? That kind of feat wouldn’t be that easy!

In fact, it was stupidly simple. You just need to put the litter on top of the toilet bowl. Then you remove it gradually, using some kind of toilet training kit.

This kit bears a striking similarity with the concept of scaffolding. Except this is used for learning. As long as the cat can’t pee in the loo by itself, you sustain it with a device. Then, you remove the device gradually. As simple as that!

This impossible feat now looks so simple!

In academic terms, a similar notion is “instructional scaffolding”.

Instructional scaffolding is when you help a student learn a task or master a skill by giving them extra guidance and support.

The young boy who dreamed about Formula 1

Now let’s see if we can apply this concept to our most grandiose goals, shall we? For example, let’s pick: becoming a Formula 1 champion. How do you transition from complete Formula 1 newbie to Formula 1 champion?

Looks almost impossible if you are not rich, right? Well, the answer is to scaffold your way to the top. Lewis Hamilton won seven world champion titles. But as a young boy, he just took the challenge gradually.

At five, his father bought him a radio-controlled car. He then competed in the adult British Radio Car Association championship and finished second. When he was six, his father bought him a go-kart for Christmas. He then promised his son he would support his passion if he worked hard at school.

His son quickly began winning races and cadet class championships. He became the youngest driver to win the British cadet karting championship at ten.

At 13, he was enrolled in the McLaren driver development program. He then became European Champion with maximum points.

At 16, he began his car racing career with Formula 3 and won several championships.

Finally, he joined the McLaren Formula 1 team at 19. The following year, he became the then-youngest Formula One World Champion in history. Contrary to what one might think, there were a lot of intermediate steps to reach the top. Now let’s see some other examples from my experience.

How I crushed my limits

Many times, I have had imaginary limits that I would then crush. I would fail badly. Then I would dust myself off. I would use another angle of attack and succeed.

When I was 12, my mathematics teacher told me I would never be good at math because I could not do mental calculations on my feet. He was a brutal teacher and loved to insult us.

Then I arrived at high school, and suddenly, there was so much more respect. I managed to have a 60% mark for my High School Diploma, and I got accepted into a class that prepares students for elite French engineering school.

But again, the conditions were very harsh. The teachers were racing at full speed when they wrote the course on the blackboard. The pace was impossible to follow. I finished 37th among a total of 39 students.

I was so disappointed. I felt I was a failure. So I went to University, back at square one, the first year, to do the same courses again. That time, I shined. The rhythm was just right, and I understood everything. After my 2nd year at University, I was accepted into an engineering school and obtained a Master’s degree in computer science!

The same thing happened with management. For me, management had never been an option because I am an introvert. I am a slow thinker and can’t follow when people talk very fast.

Then I went to work in Madagascar and became a team leader right away because I had a high degree of education compared to the other workers. That’s how I learned leadership. And I’ve done this for 15 years.

As you can see, the environment where you study or work plays a significant role in your development. Sometimes, you can quickly feel like a failure because it is not adapted to your style of learning.

But by switching to an environment that progressively gets more and more challenging, you manage to develop yourself better.

How to do it deliberately?

Many times, I had to change environments to learn a skill in the best conditions. I would find one place too challenging for me. Then I would move somewhere else where the level was just right for me.

It is the same for many skills. For example, let’s take: public speaking, singing, comedy, selling, …

If you try to get in the first league too early, you get beaten and bruised. It’s better to find a non-threatening environment to take your time to learn.

For example, for public speaking, you can attend Toastmaster’s clubs to learn how to deliver professional speeches.

For singing, you can join a choir at the church or simply find an online coach.

Just find the scaffolding environments where you can learn the skill in the best conditions and improve quickly. If you are short of scaffolding ideas, read books, especially biographical books. Study your favorite experts and check how they managed to scaffold their way to the top.

Or hunt for talented people on LinkedIn and ask them for an interview. You then ask them how they managed to pursue their career at the very beginning. That way, you can reverse-engineer their success and find creative ways to scaffold your way to success.

Do you often feel intimidated by tricky goals? Like the trained cat, you might just need some kind of scaffolding to support your learning, a concept related to the academics notion of “instructional scaffolding”.

The Formula 1 career path is a good example. As seen together, F1 champion Lewis Hamilton transitioned from radio-controlled car races to go-karting car races, then Formula 3 races, and finally Formula 1 races.

To complement these examples, I also cited my struggles in mathematics and management when I didn’t have the right supporting environments set in place. Once I had it, I was ready to shine.

You can apply the same concepts to many other fields that might look intimidating to you, like public speaking, comedy, singing, or selling.

And if the goal still looks impossible to you, just study how the masters got into the field and copy their scaffolding strategies.

Yes, you can do it. No more excuses. Let’s get it done!

On February 1st, 2022, I embarked on a 100 days writing challenge. This is post number 92.

Success
Careers
Education
Self Improvement
Business
Recommended from ReadMedium