Tumgik
#IS MLS TRYING TO PROVE A POINT?! WE GET IT. THEY CANT DO IT WITHOUT MESSI
takiki16 · 8 months
Text
Watching Miami sans Messi and Alba playing the other bottom half eastern teams struggling for a playoff spot is like watching two blindfolded fencers dueling with pool noodles. Stoppable force meets moveable object every gotdam week.
7 notes · View notes
gale-gentlepenguin · 4 years
Text
ML fic: The Hunt
(Warning, Contains Blood, and Graphic Violence)
(Happy Birthday @masked-bixch )
(I hope you enjoy the present at the end)
A man in a trench coat carrying a duffel bag walked into the sewers of Paris.
He was of a decent build and average height, not buff, not scrawny. His hair was short and jet black. He had a pencil mustache and kept most of his face hidden by the use of his hat. If needed he could likely slip into a crowd without notice.
He had heard of the bizzare events that have been occurring in Paris, a place were sad people get possessed by evil bugs and fight superheroes. It would sound insane if there wasn’t video proof.
What really was insane was the recent bounty that popped up. One that many would consider a practical joke. In fact, many thought it was done as a way to flush out greedy hitmen.
10 million Euros for Ladybug and Chat noir.
It was such a rediculous idea. Hiring an assassin to kill superheroes.
He didn’t understand why he was even bothering to check out the legitimacy of this insane bounty. Was it boredom? Perhaps hope for a challenge. He had been in this field for 20 years now, and he really wanted a way to prove himself. Not many people know it, but hitmen are arrogant egomaniacs. Reputation is as valuable as gold. If he could pull it off, then his rep would be without question.
He followed the directions to the rendezvous point, and he was shocked to see that this was legit.
In front of him stood a man in a purple suit and a silver mask, a metal briefcase in his hand. Even he knew that this was the villain of Paris, the super terrorist, Hawkmoth.
“So, it was real.” The man in the trench coat stated, an amused smile graced his face.
“I take it you are interested in the assignment.” The masked man questioned, keeping a serious face.
“I was curious about this strange bounty that popped up. Many people in my circle think it’s a set up to a sting operation.”
“Yet you came anyway?”
“I figured a cop wouldn’t be so brazen with their trap.”
Hawkmoth didn’t react to the man’s comments.
“Can I get the name of the man I’m hiring?”
“You can call me Hunter. You of all people should know the importance of a civillain identity being kept secret.” Hunter mused
Hawkmoth nodded.
“Very well. Hunter, your assignment is to get me the Miraculous of Ladybug and Chat noir, whether they are dead or alive is no concern of mine.”
Hunter looked at the villain before chuckling.
“So, your use of gloomy people has been so ineffective you needed to actually hire someone.”
Hawkmoth was not amused.
“So, if I take the job. Do I get some special equipment to deal with these freaks? Or will I be able to put a bullet in their skulls without a problem.
“The miraculous enhances their natural durability to superhuman levels. So long as their wearing the miraculous, normal weapons won’t be able to do much against them. A typical bullet would be a bug bite at worst.”
Hunter scoffed.
“Figured.”
Hawkmoth smiles.
“But, I can give you the edge you need.”
He reveals his Cane and opens the dome on top of it to reveal a black butterfly.
“A butterfly? I hope you are joking.”
“Trust me. This will be more then enough”
“Alright, show the cash. I need to make sure I aint getting stiffed.”
Hawkmoth tosses the suit case to the assassin.
He opens the case and his eyes go wide, a dark grin appears on his face.
“Let me just check to make sure its real.”
Hunter quickly pulls a bundle of bills and examines them, it was real. It was legit.
“And they say crime doesn't pay.” 
“Consider that a down payment. Should you succeed, you will be receiving payments over the course of 5 years.”
Hunter closes the case.
“I want those payments in American bills. Cant exactly stick around here spending this cash.”
“Your demands will be met. Now, shall we begin?”
_______________________________________________________________________
“Another quiet Patrol. Seems that Hawkmoth might have Migrated for the winter.” The cat themed costume quipped.
“I don’t trust this. Don't you find it off Chat noir? Its been over a month since the last akuma attack.” The red clad heroine commented.
“Relax Ladybug, maybe Hawkmoth felt humiliated after the 30th akumatization of Mr.Pigeon and decided to take up stamp collecting.”
Ladybug moved to the edge of the roof they were on to get a better view of the area. The night was quite peaceful, even for the city at night. Something felt very wrong.
Chat noir’s ear twitched as he picked up on something.
“Duck!”
Chat noir tackled Ladybug out of the way just barely avoiding a small incoming projectile.
“What was that?”
Ladybug looked in the direction of where the object came from.
“Roll!”
Ladybug rolled with Chat noir avoiding the next few attacks.
“What in Plagg’s name is going on!?” Chat noir questioned. Confused by the sudden attack.
The two got up.
“We need to move.” 
The two started to move across rooftops.
“Looks like Hawkmoth decided to get his lazy butt up again.”
“Chat noir Focus, this akuma is sniping at us.”
“Yea, its probably wants to capture us like with Desperada. We should avoid getting hit.”
The akuma looked away from his scope.
His clothes took the colors of the environment around him. His eyes blood red and his pupils like those of an eagle. He had a black mask cover his face, which also acted similar to his clothing. He was as stealthy as a chameleon. and as deadly as a Cobra.
“Damn, they are quicker then I expected. I guess that explains the high cost.”
He got up from his spot and stretched.
“I guess this is where the real fun begins.”
He goes into his bag to change his sniper rifle for two sleek  Desert Eagle Pistols.
“Gotta admit Hawky. You really suited me up. I can just think of a weapon and bam, I can pull it right out of my bag. I am pretty damn sure these are illegal here.”
A purple butterfly outline appeared over his eyes.
“Remember Hero Hunter, these aren't just copies. Thanks to the powers I gifted you, those weapons are lethal, even to them. That includes if they are turned on you as well.”
“Yea Yea, I am well aware of the powers. I get their magic trinkets, and take them back to you. And I can kill them if I want to.”
“Just be sure you succeed.”
“Noted.”
Hero hunter Dashed along the roof tops after the two. He was planning on doing two quick shots then clean up. But perhaps he can enjoy an up close kill.
_______________________________________________________________________
“We need to find a place to regroup and think of a way to handle this akuma.”
“Agreed, I hate when the akuma hides like this. It is super annoying.” Chat noir spat.
“Good thing I am not hiding.”
The two heroes stopped to see the akuma appear in front of them.
He was wearing camouflage that seemed to shift to the correct colors of his environment at will. He looked like a mix of a soldier and a game hunter. But what caught the two heroes attention were the two pistols in his hands.
“Are those guns? Like actual guns!?” Chat noir questioned in disbelief.
The akuma smirked.
“Desert Eagle. .44 Magnum. Always buy American.” He said as he pointed his gun at the cat.
“Now, hand over the miraculous, or I turn you both in to Swiss cheese.”
“Hate to tell you this, but those won't do anything to us. Got some impressive Invulnerability. At best those will be an annoy...”
Chat noir heard the click of the barrel but was caught off guard by the bullet the went through his thigh
“AGH!!!!” Chat noir Screamed as blood spilled out of the hole. He grabbed his Thigh as he fell down on one knee, reeling from the pain.
“So much for your durability.” He mocked. “Now last chance, or next shot goes through your skull.”
Ladybug felt a chill go down her spine. This was nothing like the other akuma attacks. This was a true life or death battle. Hawkmoth was playing for keeps!
He lined up his next shot for his head but his arm was snagged by a yo-yo. The sudden movement made him release his gun.
“You get away from him you monster!” Ladybug screamed in rage.
The akuma growled and turned his other hand to her, trying to shoot her.
Ladybug quickly jumped in the air, narrowly avoiding the bullets. He cursed as he realized he needed to reload.
Ladybug took this chance to scoop up Chat noir and get him out of there.
“Sneaky bug.” He muttered angrily. He was done playing nice. He didn't care if they were kids. They were making a mockery of him, and he has a reputation to maintain.
He goes into his bag and pulls out something much bigger.
“This will be perfect for Exterminating that bug.”
______________________________________________________________________
“Ghhh.” Chat noir bit his lip to hold in his pain as Ladybug put pressure on the wound.
“Okay, so we have an akuma with weapons that ignore our durability.”Ladybug stated as she was trying to figure out a plan.
“Figured that one out. Thankfully, I can heal quick. I think the bleeding is stopping.” 
Chat noir managed to stand up. He grunted in pain as he kept himself standing.
“Oh no you don't. You are staying hidden until I solve this.”
“Like hell I am! You expect me to lay back and let the woman I love get shot at?! You're crazy if you think....”
Chat noir noticed Ladybug was in tears.
“Ladybug...”
“I don't want you to die Chatton! You are injured and that wound will slow you down. There is no way you can dodge bullets in your condition!”
“Ladybug... You still have miraculous healing. Once we beat the akuma, all the damage will be undone. That can't happen if you get killed. You need me out there.” Chat noir reasoned.
Ladybug could see his logic. She hated that he was right, she hated that there was a chance they could die. She hugged him. The two managing to calm their nerves after the embrace.
“Okay, but you need to be careful. I don't want you getting hurt anymore.”
“I promise, I will be alright when this is over.”
“Come out Come out Wherever you are!!”
A voice called out from a distance.
“Seems the hunter is getting impatient.” Chat noir rolled his eyes.
“Well maybe I have something to turn the tide and make the hunter the hunted.”
“Lucky Charm.”
_____________________________________________________________________
The Akuma sits on the roof top, his camouflage active to ensure he was hiding.
He was pretending that he was getting cocky in order to draw the two heroes out. They will be expecting an outright fight. But he had something special planned.
The two peer from their hiding place, looking around to see where he was.
‘Just a little further.’
“Where did he go? I could of sworn I heard him.” 
“Keep calm kitty, he might have a trick up his sleeve.”
‘Just pop right out.’
Chat Noir jumped out of the spot.
“Now!”
He presses the button in his hand.
A sting pulls chat noir back just barely avoiding the exploding mine.
“Damn it!” The akuma cursed.
“Nice try, we figured you would try something like that. And now we know where you are. So quit the chameleon act.
The akuma revealed himself and had his arms up.
“Alright. You caught me. I have been outsmarted.”
Ladybug could see that the man was clearly lying through his teeth, he was reaching for something.
“Its a trap.”
The man revealed a massive Gun and aimed it at them.
“Bye bye.”
The akuma let loose a storm of bullets from his automatic machine gun.
Chat noir began spinning his Staff as fast as he could to block the bullets. Ladybug used the opportunity to slick away.
“I never get to use these. They are so much fun!” The akuma roars with laughter. His bullets not as accurate as before with the powerful gun shooting off rapid fire.
Chat noir managed to block a majority of the bullets but he was getting knocked and hit by a few missed ones, He was starting to getting much bloodier and his baton was slowing down. He was biting his lip to avoid screaming in pain. These bullets hurt like hell.
“You’re finished you mangy mongrel.”
He felt something his his hands.
“What the heck.
“He looked up to see Ladybug.
He pointed his gun upward and began firing. A few bullets managed to connect as she was in the air.
“GHH!” She groaned in pain as she rolled from the landing.
“Nice try Bug. But now your going to be exterminated.”
He pointed the gun at her.
“Ladybug!” Chat noir cried out as he tried to move.
Click
“Out of ammo. No matter, I still have ammunition in my pistols and with how weak you two are, it will be easy pickings.” He boasted as he tried to drop his empty gun. But he couldn't.
“Wait... I can't let go of my gun!”
Ladybug smirked as she revealed the super glue she had on her person, she tossed it aside used her Yo-Yo to circle around his legs and tripped him. His pistols and duffel bag flew off of him as he was helpless to get them.
“You got to be kidding me!” He screamed in frustration.
“Chat noir, the bag!”
The cat slowly stumbled to the bag. Ladybug took notice of the dozens of holes in his body, the cat had managed to protect his vital organs, but his body was bloody and he would die from blood loss if the healing didn't happen soon.
“Hurry Chat!”
“Cata...clysm...” Chat noir called out in a weak voice as he fell forward. Touching the bag with his hand, turning it black and causing it to crumble. The black butterfly popped out.
“No!” The akuma shouted.
Ladybug untangled her yo-yo and went to snag the akuma.
“Time to de-evilize.”
She snagged the akuma with her Yo-Yo and purified it. This resulted in the akuma reverting back into his normal form.
“Chat, the akuma is down! Chat?”
She looks to see a large puddle of red liquid pooling around him.
Ladybug looked away, she couldn't freeze up right now. She needed to cast healing.
“Miraculous ladybug!”
She tossed the glue container into the air and she watched as her powers activate.
The damage to the environment vanished, and the pool of blood around chat noir vanished. Ladybug’s leg healed instantly.
“Chat!” She ran to the cat hero, who was still laying face down in the ground.
“Its alright Chat noir. I fixed everything. You are all fixed up.”
The de-akumatized hitman noticed the hero was distracted. He quietly made his way toward his bag. He had some things in there that would not give him plausible deniability over this whole mess.
“Chatton?” Ladybug touched his cheek and noticed he felt cold. She frantically began checking for a pulse.
“No... no no no... We... we won. This shouldn't.”
The assassin slicked away as the hero desperately tried to revive her partner.
“I wonder if hawkmoth will pay for half the job done?”
______________________________________________________________________
Is Chat Noir Alive? Is he dead?
As my birthday gift @masked-bixch is the one that gets the final say!
I will write the ending after I get the response from her.
It is her birthday gift, she should get to decide how it all ends.
272 notes · View notes
Text
Growing Pains  chapter 1 Letting go
Growing up Marinette had always been a shy and anxious child,but she was also raised to be kind, and she was. Every year she would bring treats for her new class when the school year started back up and was always polite and sweet with others. She knew she was a good person, she always did her best to be selfless and apologize when she was wrong and try to grow from her mistakes. She bent over backwards to be there for her friends even if it was inconvenient to her, she was kind, she was good.
But they still trust Lila’s word over yours don't they.
Marinette shut her eyes tight and tried her best to will those thoughts away.
‘Deep breathes. Calm thoughts. You can't get akumatized they are depending on you’
But i'm so tired
‘Deep breathes. Calm thoughts. You can not give in’
Marinette knew she couldn't, She swore to all of paris she would be their protector,not their downfall. She took a deep breathe, calmed her racing heart, and when she opened her eyes again she could hear the flutter of butterfly wings. She sat up in her bed and saw a familiar purple butterfly perched on the railing at the foot of her bed.
Marinette could remember how just a few months ago the sight of a purple butterfly this close to her would make her panic but now she had grown used to Hawkmoth’s attempts to akaumatize her.
This will pass. Tomorrow the sun will rise and time will tick on. All of this will pass.
Marinette reached out with both her hands and scooped up the butterfly. She cupped her hands shut around the butterfly and closed her eyes. She could feel Hawkmoth’s negative energy try and seep into her and give him control. This was always the part she hated the most, holding the Akuma she could feel all of his malicious intent and it felt like poison trying to forcefully inject itself her bloodstream. She could feel the icy shards of his greed slowly traveling through her veins, and she could feel all those emotions halt as she breathed and focused all the love and calm she could muster towards the small bug in her hands.
You have a family who loves you.
Her parents, she thought back on all the love they have given her throughout the years, all the support and hugs and smiles.
You have so many that look up to you.
She thinks about how excited Manon gets whenever she sees new footage of Ladybug saving the day, and that big smile she gave Marinette when she gave her her very own ladybug doll for her birthday.
She thinks of all the smiles she gets from the citizens of paris whenever they see her out on patrol.
You have people who believe in you.
She thinks of how proud and supportive her parents are of her.She thinks of how much they encourage her in everything she does.
She thinks back to when Jagged and Penny contacted her for a new commision and when they had met up to discuss the details they had noticed there was something off with her. She remembered how they sat her down and listened to her vent about Lila and her friends alienating her, how Jagged was outraged and offered to help her prove Lila’s lie about her tinnitus, and how when she turned down the offer they both made it clear they would be here for her if she needed them. She remembered nearly crying when they said she was a talented and kind person and they cared for her very much.
She thinks back to how much both Master Fu and Tikki trust in her.  
You are stronger than this
And with a bright flash of pink she could feel Hawkmoth’s powers wash away. She opened up her hands and released the butterfly now a pure white, she watched it flutter away through her open trapdoor.
“Marinette!” Tikki squeaked as she made her way into Marinette’s line of sight. The small goddess wanted to ask her chosen if she was ok, but she already knew there would be no point to the question.
Tikki knew for the last two months Marinette hadn’t been the same, ever since Lila started turning her friends on her Marinette has been struggling, for the first month she was well enough to simply fight off the akumas with positive thoughts and having to transform in order to purify them. But sometime into the second month she had surprised them both when in a fit of frustration she simply grabbed the akuma and purified it without the help of her spotted yoyo.
Tikki knew she didn't have to tell marinette she was there for her , her chosen had hard time believing people’s word after her “friends” alienating her so soon after claiming their love for her, their supposed everyday ladybug. So instead she flew over and snuggled up to her chosen’s cheek.
“I’m so tired of this Tikki…,” Tikki swore she could feel her heart break a little, her chosen shouldn't sound this tired, she didn’t deserve to sound so beat down dammit.
“We will get past this Marinette,”
“I know, but I cant keep waiting for Lila to slip up in order for this to stop, i’m just sitting here in limbo. I cant keep going like this. What if one of these days I don't catch the akuma on time, what then..,” Marinette didn't realize she was crying until she felt her small friend wipe away a tear from her face. “At this point it’s not just Lila’s lies that hurt me.” She choked back a sob “How could they say they care about me and then turn around and believe a stranger over me Tikki? A-And Adrien can see them all being so cold to me b-but he rather just ‘avoid confrontation’, he’s just being a coward!” At this point Tikki could see Marinette switch from tears of hurt to tears of anger “I’ve tried so hard to be the best friend I could for them and in return I’m left in the dust.”
Marinette wiped away her tears, got up and climbed down from her bed. She turned to the now empty wall by her computer, she thought back to a day about a month into Lila’s return, her lies seemed to had worked its charm because she had come to class to be met with a room full of glares except from Lila and Adrien, Lila wore a look of a kicked puppy and Adrien looked apologetic, apparently Lila had told every one that Marinette had been secretly bullying her since her return and she hadn’t wanted to come forward because everyone seemed so close to Marinette. The entire class had confronted her and said she would be getting the silent treatment until she fessed up and apologized, and with that Lila was given her seat forcing her to the back once again,all the while Adrien never spoke up, not once , he hardly even looked at her.
When she got home that day she tore down Adrien’s schedule and threw it away along with every photo she had of him.
Tikki saw a look of determination come over Marinette’s face and watched her march down stairs to speak with her parents.
       --------------ML------------------
The students at Collège Françoise Dupont were a buzz, today was the last day of school and soon the young teens would be free to enjoy their summer holidays.
Miss Bustier had given her class free time to sit and chat as the day came to a close and as she stepped away to go over some things with the principal. At the back of the class Marinette sat alone watching her classmates sit around Lila as she went on about spending summers on the beaches of Achu with celebrities. Marinette looked around the classroom, a classroom she once thought of fondly, back when it was the classroom she had met Alya, her best friend. She shifted her gaze to Alya sitting by Lila and the rest of the class. She wasn't her best friend anymore, she thought back to the day the class started giving her the silent treatment.
Alya had gave her a angry look and handed her her half of their best friend necklace Marinette had gifted her a while back. Marinette had been stunned, surely Alya didn't believe Lila over her. “I can’t be your best friend if you keep acting this way Marinette.” Her heart had sunk “When you finally see you are being petty and apologize to Lila and to us for acting like a bully, then maybe we can be friends again.” Alya had said that as if she were chastising a miss behaving child, like she hadn’t just shattered Marinette’s heart.
No. Alya hadn’t been her best friend or even a friend for a while now.
She knew what she had to do, she couldn’t risk being Akumatized she had to stop this constant cycle of pain, even if it hurt her.
Marinette glanced at the clock, about 10 minutes till class was over and summer began. “I guess it's time,” She whispered to herself.
“Wow Lila! We should totally all get together this summer for a bonfire, Oh maybe you could get Ladybug to come!” Alya beamed at Lila. Lila was about to respond when her gaze focused on something past Alya. “Oh Marinette, have you finally come to apologize? I knew you wou-”
“No Lila.” Marinette cut her off.
The class turned to marinette and they all gave her very disapproving looks, well all except Chloe and Adrien, Chloe looked like she was curious as to how this would all go, and Adrien looked nervous,He had a feeling this wasn't going to end well.
Alya stood and moved to stand in front of Marinette. She crossed her arms “ You really should be apologizing Marinette, you know no one here is going to forgive you until you do,” The class made noises of agreement.
Marinette didn't respond she simply put a closed hand out, as to hand something to Alya.
Alya raised a brow at her and extended her hand to take whatever it was she was handing to her.
Marinette dropped something that felt like metal, (jewelry?) Into her hand. Alya looked down to  see both halves of the best friend necklace Marinette had gotten for them. She was stunned for a second
“Marinette what the he-”
“I’m Done Alya.” Marinette cut off before she could finish. Her shoulders were squared, and her anger was clear on her face.
“You’re done? Marinette! Are seriously saying you want to end our friendship because I called you out on being a bully!” The class was shocked, they didn’t think Marinette would stoop this low.
“Marinette” Lila said in a sickeningly sweet tone stepping up behind Alya and putting a hand on her shoulder “ I know you only bullied me because you’re jealous, but I told you if you got over that we could totally be friends!”
Alya turned a glare at the bluenette “See Marinette Lila is being  nicer than she has to be to her bully and you seriously need to get over this jealousy.”
“I am so tired of you thinking i'm nothing more than some girl with a goddam crush Alya” Marinette seethed. “But fine, you want proof this isn't over some boy?”
Marinette turned to Adrien. “Adrien.” She looked him in the eye and without hesitation.
“I used to be in love with you.”
To say the class was shocked was a understatement. Even Chloe and Lila were shocked. Not as shocked as Adrien though.
“W-Wha-”
“Yup! I was in love with you, seriously smitten, and everyone but you knew it!” Marinette chuckled “But you see when you looked the other way when Lila was spreading lies about me, even though you knew she was a lair, I got over you pretty quick!”
She saw him flinch, but she wasn't done
‘But hey apparently i'm nothing but a jealous bully, even though I went with you on a double date so you wouldn't be nervous around Kagami!” She turned to Alya “But you guys forgot about that real easey didn't you,”  
“So no Lila, Alya this isn't about me being jealous and hey since i'm confessing things here how about I tell everyone what happened in the bathroom the day you came back Lila?”
Marinette knew everyone was stunned silent, she could see Lila pale, and she knew she was being a bit hysterical, but she didn't care. It felt so good to finally get this off her chest.
“You know, when you cornered me in the bathroom and threatened to take away all my friends if I didn't stop trying to prove you were lying? Or how about after school when you literally declared war on me and swore I would lose all my friends and basically claimed Adrien as yours, as if he was a piece of meat!”
At this point she knew she should reel herself in before an akuma came but god damn it felt like she broke the bottle containing all of her pent up feelings and she was far from done.
“Well you know what Lila, you won.” Marinette gave a mocking applaud.
“Not only did you turn everyone on me, no you turned the one person who ever stood up for me against me.”
Marinette turned her gaze to Alya and stared her in the eyes, Marinette could feel the familiar sting of tears in her eyes and by the look on Alya’s face they both knew Marinette was close to tears. But she continued.
“I suffered the brunt of Chloe’s bullying for years and no one ever stood up for me until y-you.”
She sniffed and swallowed the lump in her throat.
“I don't know if you realized this but I was alone before you showed up, I was alone and constantly afraid but then you came and I wasn't alone anymore, you were my god damn bravery!”
Marinette knew she probably looked like a mess, tears streaming down her face and gesturing wildly. She couldn't find the strength to care though.
“But I guess I didn't matter to you as much as you mattered to me because you believed a stranger over me, and for what? Because she claims to know ladybug? God Alya.”
She wiped her tears on the back of her hand and gave a weak chuckle
“I'm so tired of feeling like this, i'm so tired of crying over people who obviously didn’t care about me as much as I thought they did. None of this had anything to do with jealousy, it had everything to do with the fact that I cared so much-”
“Marinette!” Adrien yelled, the class all gasped
“I know you are upset, but I need you to calm down.” Adrien spoke gently to her, putting his hands out as if ready to tackle her if needed
“Wha-” and then she heard it. The soft flutter of butterfly wings. When ranting she had been genstering wildy and she turned to see the familiar purple butterfly on her outstretched hand.
She was so tired of Hawkmoth.
She brought the butterfly closer to her “This is the 36th time in the last two months that you’ve come for me Hawkmoth.” She glared at the butterfly “And this is the last time.”
Marinette cupped the bug into her hands and felt the familiar poison of Hawkmoth’s  powers try to control her.
This is it, after this i’ll be free of them, i’m done with them, and i’m done with you trying to control me  Hawkmoth.
A flash of pink.
She opened her hands and out flew a white butterfly
The class was deadly silent
The last bell of the school year rung
Marinette picked up her back pack, slung it over her shoulder and turned to everyone.
She knew it was over, she knew these people who once meant so much to her had caused her too much pain to forgive. A part of Marinette wished she could blame this all on Lila, that she could out her as a lair and have her friends back but she knew it wasn’t Lila that turned her back on Marinette, it wasn’t Lila that broke her heart, It wasn’t Lila that made her feel unworthy of friends, that had made her cry herself to bed for weeks wondering what she did wrong to make everyone abandon her so easily, no it hadn’t been her.
“I’m Done.”
And with that she walked out of class without looking back.
Marinette knew this wasn’t actually the end of things with Lila and her old friends, she knew she would still have moments where she would miss them, she knew she wouldn’t trust people like she used to. She would be weary before she gave her heart or friendship to anyone again and her heart felt heavy, she still would no doubt have nights where the loneliness would get to her but with every step away from the school and that classroom, she felt lighter.
She must have made a weird sight, eyes puffy and red, tear stains on her face but the farther she got the more she smiled, she would be okay. She had Tikki, she had her parents, she had uncle Jagged and Aunt Penny, she had herself.
Tomorrow the sun will rise and time will tick on.
And Tomorrow seems a lot brighter.
Hi I decided to post my fic on my more official account. But here is the first chapter to the fic you two inspired! I hope you enjoyed 
@mindfulmagics
@miraculousbuebird
106 notes · View notes
Text
What Happens When SEO and CRO Conflict?
Posted by willcritchlow
Much has been written and spoken about the interplay of SEO and CRO, and there are a lot of reasons why, in theory, both ought to be working towards a shared goal. Whether it's simple pragmatism of the business benefit of increasing total number of conversions, or higher-minded pursuits such as the ideal of Google seeking to reward the best user experiences, we have many things that should bring us together.
In practice, though, it’s rarely that simple or that unified. How much effort do the practitioners of each put in to ensure that they are working towards the true shared common goal of the greatest number of conversions?
In asking around, I've found that many SEOs do worry about their changes hurting conversion rates, but few actively mitigate that risk. Interestingly, my conversations with CRO experts show that they also often worry about SEOs’ work impacting negatively on conversion rates.
Neither side weights as highly the risks that conversion-oriented changes could hurt organic search performance, but our experiences show that both are real risks.
So how should we mitigate these risks? How should we work together?
But first, some evidence
There are certainly some SEO-centric changes that have a very low risk of having a negative impact on conversion rates for visitors from other channels. If you think about changing meta information, for example, much of that is invisible to users on the page—- maybe that is pure SEO:
And then on the flip side, there are clearly CRO changes that don’t have any impact on your organic search performance. Anything you do on non-indexed pages, for example, can’t change your rankings. Think about work done within a checkout process or within a login area. Google simply isn’t seeing those changes:
But everything else has a potential impact on both, and our experience has been showing us that the theoretical risk is absolutely real. We have definitely seen SEO changes that have changed conversion rates, and have experience of major CRO-centered changes that have had dramatic impacts on search performance (but more on that later). The point is, there’s a ton of stuff in the intersection of both SEO and CRO:
So throughout this post, I’ve talked about our experiences, and work we have done that has shown various impacts in different directions, from conversion rate-centric changes that change search performance and vice versa. How are we seeing all this?
Well, testing has been a central part of conversion rate work essentially since the field began, and we've been doing a lot of work in recent years on SEO A/B testing as well. At our recent London conference, we announced that we have been building out new features in our testing platform to enable what we are calling full funnel testing which looks simultaneously at the impact of a single change on conversion rates, and on search performance:
If you’re interested in the technical details of how we do the testing, you can read more about the setup of a full funnel test here. (Thanks to my colleagues Craig Bradford and Tom Anthony for concepts and diagrams that appear throughout this post).
But what I really want to talk about today is the mixed objectives of CRO and SEO, and what happens if you fail to look closely at the impact of both together. First: some pure CRO.
An example CRO scenario: The business impact of conversion rate testing
In the example that follows, we look at the impact on an example business of a series of conversion rate tests conducted throughout a year, and see the revenue uplift we might expect as a result of rolling out winning tests, and turning off null and negative ones. We compare the revenue we might achieve with the revenue we would have expected without testing. The example is a little simplified but it serves to prove our point.
We start on a high with a winning test in our first month:
After starting on a high, our example continues through a bad strong — a null test (no confident result in either direction) followed by three losers. We turn off each of these four so none of them have an actual impact on future months’ revenue:
Let’s continue something similar out through the end of the year. Over the course of this example year, we see 3 months with winning tests, and of course we only roll out those ones that come with uplifts:
By the end of this year, even though more tests have failed than have succeeded, you have proved some serious value to this small business, and have moved monthly revenue up significantly, taking annual revenue for the year up to over £1.1m (from a £900k starting point):
Is this the full picture, though?
What happens when we add in the impact on organic search performance of these changes we are rolling out, though? Well, let’s look at the same example financials with a couple more lines showing the SEO impact. That first positive CRO test? Negative for search performance:
If you weren’t testing the SEO impact, and only focused on the conversion uplift, you’d have rolled this one out. Carrying on, we see that the next (null) conversion rate test should have been rolled out because it was a win for search performance:
Continuing on through the rest of the year, we see that the actual picture (if we make decisions of whether or not to roll out changes based on the CRO testing) looks like this when we add in all the impacts:
So you remember how we thought we had turned an expected £900k of revenue into over £1.1m? Well, it turns out we've added less than £18k in reality and the revenue chart looks like the red line:
Let’s make some more sensible decisions, considering the SEO impact
Back to the beginning of the year once more, but this time, imagine that we actually tested both the conversion rate and search performance impact and rolled out our tests when they were net winners. This time we see that while a conversion-focused team would have rolled out the first test:
We would not:
Conversely, we would have rolled out the second test because it was a net positive even though the pure CRO view had it neutral / inconclusive:
When we zoom out on that approach to the full year, we see a very different picture to either of the previous views. By rolling out only the changes that are net positive considering their impact on search and conversion rate, we avoid some significant drops in performance, and get the chance to roll out a couple of additional uplifts that would have been missed by conversion rate changes alone:
The upshot being a +45% uplift for the year, ending the year with monthly revenue up 73%, avoiding the false hope of the pure conversion-centric view, and real business impact:
Now of course these are simplified examples, and in the real world we would need to look at impacts per channel and might consider rolling out tests that appeared not to be negative rather than waiting for statistical significance as positive. I asked CRO expert Stephen Pavlovich from conversion.com for his view on this and he said:
Most of the time, we want to see if making a change will improve performance. If we change our product page layout, will the order conversion rate increase? If we show more relevant product recommendations, will the Average Order Value go up? But it's also possible that we will run an AB test not to improve performance, but instead to minimize risk. Before we launch our website redesign, will it lower the order conversion rate? Before we put our prices up, what will the impact be on sales? In either case, there may be a desire to deploy the new variation — even if the AB test wasn't significant. If the business supports the website redesign, it can still be launched even without a significant impact on orders — it may have had significant financial and emotional investment from the business, be a better fit for the brand, or get better traction with partners (even if it doesn't move the needle in on-site conversion rate). Likewise, if the price increase didn't have a positive/negative effect on sales, it can still be launched.
Most importantly, we wouldn’t just throw away a winning SEO test that reduced conversion rate or a winning conversion rate test that negatively impacted search performance. Both of these tests would have come from underlying hypotheses, and by reaching significance, would have taught us something. We would take that knowledge and take it back as input into the next test in order to try to capture the good part without the associated downside.
All of those details, though, don’t change the underlying calculus that this is an important process, and one that I believe we are going to need to do more and more.
The future for effective, accountable SEO
There are two big reasons that I believe that the kind of approach I have outlined above is going to be increasingly important for the future of effective, accountable SEO:
1. We’re going to need to do more testing generally
I talked in a recent Whiteboard Friday about the surprising results we are seeing from testing, and the increasing need to test against the Google black box:
I don’t see this trend reversing any time soon. The more ML there is in the algorithm, and the more non-linear it all becomes, the less effective best practices will be, and the more common it will be to see surprising effects. My colleague Dom Woodman talked about this at our recent SearchLove London conference in his talk A Year of SEO Split Testing Changed How I Thought SEO Worked:
2. User signals are going to grow in importance
The trend towards Google using more and more real and implied user satisfaction and task completion metrics means that conversion-centric tests and hypotheses are going to have an increasing impact on search performance (if you haven’t yet read this fascinating CNBC article that goes behind the scenes on the search quality process at Google, I highly recommend it). Hopefully there will be an additional opportunity in the fact that theoretically the winning tests will sync up more and more — what’s good for users will actually be what’s good for search — but the methodology I’ve outlined above is the only way I can come up with to tell for sure.
I love talking about all of this, so if you have any questions, feel free to drop into the comments.
Sign up for The Moz Top 10, a semimonthly mailer updating you on the top ten hottest pieces of SEO news, tips, and rad links uncovered by the Moz team. Think of it as your exclusive digest of stuff you don't have time to hunt down but want to read!
0 notes
Text
What Happens When SEO and CRO Conflict?
Posted by willcritchlow
Much has been written and spoken about the interplay of SEO and CRO, and there are a lot of reasons why, in theory, both ought to be working towards a shared goal. Whether it's simple pragmatism of the business benefit of increasing total number of conversions, or higher-minded pursuits such as the ideal of Google seeking to reward the best user experiences, we have many things that should bring us together.
In practice, though, it’s rarely that simple or that unified. How much effort do the practitioners of each put in to ensure that they are working towards the true shared common goal of the greatest number of conversions?
In asking around, I've found that many SEOs do worry about their changes hurting conversion rates, but few actively mitigate that risk. Interestingly, my conversations with CRO experts show that they also often worry about SEOs’ work impacting negatively on conversion rates.
Neither side weights as highly the risks that conversion-oriented changes could hurt organic search performance, but our experiences show that both are real risks.
So how should we mitigate these risks? How should we work together?
But first, some evidence
There are certainly some SEO-centric changes that have a very low risk of having a negative impact on conversion rates for visitors from other channels. If you think about changing meta information, for example, much of that is invisible to users on the page—- maybe that is pure SEO:
And then on the flip side, there are clearly CRO changes that don’t have any impact on your organic search performance. Anything you do on non-indexed pages, for example, can’t change your rankings. Think about work done within a checkout process or within a login area. Google simply isn’t seeing those changes:
But everything else has a potential impact on both, and our experience has been showing us that the theoretical risk is absolutely real. We have definitely seen SEO changes that have changed conversion rates, and have experience of major CRO-centered changes that have had dramatic impacts on search performance (but more on that later). The point is, there’s a ton of stuff in the intersection of both SEO and CRO:
So throughout this post, I’ve talked about our experiences, and work we have done that has shown various impacts in different directions, from conversion rate-centric changes that change search performance and vice versa. How are we seeing all this?
Well, testing has been a central part of conversion rate work essentially since the field began, and we've been doing a lot of work in recent years on SEO A/B testing as well. At our recent London conference, we announced that we have been building out new features in our testing platform to enable what we are calling full funnel testing which looks simultaneously at the impact of a single change on conversion rates, and on search performance:
If you’re interested in the technical details of how we do the testing, you can read more about the setup of a full funnel test here. (Thanks to my colleagues Craig Bradford and Tom Anthony for concepts and diagrams that appear throughout this post).
But what I really want to talk about today is the mixed objectives of CRO and SEO, and what happens if you fail to look closely at the impact of both together. First: some pure CRO.
An example CRO scenario: The business impact of conversion rate testing
In the example that follows, we look at the impact on an example business of a series of conversion rate tests conducted throughout a year, and see the revenue uplift we might expect as a result of rolling out winning tests, and turning off null and negative ones. We compare the revenue we might achieve with the revenue we would have expected without testing. The example is a little simplified but it serves to prove our point.
We start on a high with a winning test in our first month:
After starting on a high, our example continues through a bad strong — a null test (no confident result in either direction) followed by three losers. We turn off each of these four so none of them have an actual impact on future months’ revenue:
Let’s continue something similar out through the end of the year. Over the course of this example year, we see 3 months with winning tests, and of course we only roll out those ones that come with uplifts:
By the end of this year, even though more tests have failed than have succeeded, you have proved some serious value to this small business, and have moved monthly revenue up significantly, taking annual revenue for the year up to over £1.1m (from a £900k starting point):
Is this the full picture, though?
What happens when we add in the impact on organic search performance of these changes we are rolling out, though? Well, let’s look at the same example financials with a couple more lines showing the SEO impact. That first positive CRO test? Negative for search performance:
If you weren’t testing the SEO impact, and only focused on the conversion uplift, you’d have rolled this one out. Carrying on, we see that the next (null) conversion rate test should have been rolled out because it was a win for search performance:
Continuing on through the rest of the year, we see that the actual picture (if we make decisions of whether or not to roll out changes based on the CRO testing) looks like this when we add in all the impacts:
So you remember how we thought we had turned an expected £900k of revenue into over £1.1m? Well, it turns out we've added less than £18k in reality and the revenue chart looks like the red line:
Let’s make some more sensible decisions, considering the SEO impact
Back to the beginning of the year once more, but this time, imagine that we actually tested both the conversion rate and search performance impact and rolled out our tests when they were net winners. This time we see that while a conversion-focused team would have rolled out the first test:
We would not:
Conversely, we would have rolled out the second test because it was a net positive even though the pure CRO view had it neutral / inconclusive:
When we zoom out on that approach to the full year, we see a very different picture to either of the previous views. By rolling out only the changes that are net positive considering their impact on search and conversion rate, we avoid some significant drops in performance, and get the chance to roll out a couple of additional uplifts that would have been missed by conversion rate changes alone:
The upshot being a +45% uplift for the year, ending the year with monthly revenue up 73%, avoiding the false hope of the pure conversion-centric view, and real business impact:
Now of course these are simplified examples, and in the real world we would need to look at impacts per channel and might consider rolling out tests that appeared not to be negative rather than waiting for statistical significance as positive. I asked CRO expert Stephen Pavlovich from conversion.com for his view on this and he said:
Most of the time, we want to see if making a change will improve performance. If we change our product page layout, will the order conversion rate increase? If we show more relevant product recommendations, will the Average Order Value go up? But it's also possible that we will run an AB test not to improve performance, but instead to minimize risk. Before we launch our website redesign, will it lower the order conversion rate? Before we put our prices up, what will the impact be on sales? In either case, there may be a desire to deploy the new variation — even if the AB test wasn't significant. If the business supports the website redesign, it can still be launched even without a significant impact on orders — it may have had significant financial and emotional investment from the business, be a better fit for the brand, or get better traction with partners (even if it doesn't move the needle in on-site conversion rate). Likewise, if the price increase didn't have a positive/negative effect on sales, it can still be launched.
Most importantly, we wouldn’t just throw away a winning SEO test that reduced conversion rate or a winning conversion rate test that negatively impacted search performance. Both of these tests would have come from underlying hypotheses, and by reaching significance, would have taught us something. We would take that knowledge and take it back as input into the next test in order to try to capture the good part without the associated downside.
All of those details, though, don’t change the underlying calculus that this is an important process, and one that I believe we are going to need to do more and more.
The future for effective, accountable SEO
There are two big reasons that I believe that the kind of approach I have outlined above is going to be increasingly important for the future of effective, accountable SEO:
1. We’re going to need to do more testing generally
I talked in a recent Whiteboard Friday about the surprising results we are seeing from testing, and the increasing need to test against the Google black box:
I don’t see this trend reversing any time soon. The more ML there is in the algorithm, and the more non-linear it all becomes, the less effective best practices will be, and the more common it will be to see surprising effects. My colleague Dom Woodman talked about this at our recent SearchLove London conference in his talk A Year of SEO Split Testing Changed How I Thought SEO Worked:
2. User signals are going to grow in importance
The trend towards Google using more and more real and implied user satisfaction and task completion metrics means that conversion-centric tests and hypotheses are going to have an increasing impact on search performance (if you haven’t yet read this fascinating CNBC article that goes behind the scenes on the search quality process at Google, I highly recommend it). Hopefully there will be an additional opportunity in the fact that theoretically the winning tests will sync up more and more — what’s good for users will actually be what’s good for search — but the methodology I’ve outlined above is the only way I can come up with to tell for sure.
I love talking about all of this, so if you have any questions, feel free to drop into the comments.
Sign up for The Moz Top 10, a semimonthly mailer updating you on the top ten hottest pieces of SEO news, tips, and rad links uncovered by the Moz team. Think of it as your exclusive digest of stuff you don't have time to hunt down but want to read!
0 notes
Text
What Happens When SEO and CRO Conflict?
Posted by willcritchlow
Much has been written and spoken about the interplay of SEO and CRO, and there are a lot of reasons why, in theory, both ought to be working towards a shared goal. Whether it's simple pragmatism of the business benefit of increasing total number of conversions, or higher-minded pursuits such as the ideal of Google seeking to reward the best user experiences, we have many things that should bring us together.
In practice, though, it’s rarely that simple or that unified. How much effort do the practitioners of each put in to ensure that they are working towards the true shared common goal of the greatest number of conversions?
In asking around, I've found that many SEOs do worry about their changes hurting conversion rates, but few actively mitigate that risk. Interestingly, my conversations with CRO experts show that they also often worry about SEOs’ work impacting negatively on conversion rates.
Neither side weights as highly the risks that conversion-oriented changes could hurt organic search performance, but our experiences show that both are real risks.
So how should we mitigate these risks? How should we work together?
But first, some evidence
There are certainly some SEO-centric changes that have a very low risk of having a negative impact on conversion rates for visitors from other channels. If you think about changing meta information, for example, much of that is invisible to users on the page—- maybe that is pure SEO:
And then on the flip side, there are clearly CRO changes that don’t have any impact on your organic search performance. Anything you do on non-indexed pages, for example, can’t change your rankings. Think about work done within a checkout process or within a login area. Google simply isn’t seeing those changes:
But everything else has a potential impact on both, and our experience has been showing us that the theoretical risk is absolutely real. We have definitely seen SEO changes that have changed conversion rates, and have experience of major CRO-centered changes that have had dramatic impacts on search performance (but more on that later). The point is, there’s a ton of stuff in the intersection of both SEO and CRO:
So throughout this post, I’ve talked about our experiences, and work we have done that has shown various impacts in different directions, from conversion rate-centric changes that change search performance and vice versa. How are we seeing all this?
Well, testing has been a central part of conversion rate work essentially since the field began, and we've been doing a lot of work in recent years on SEO A/B testing as well. At our recent London conference, we announced that we have been building out new features in our testing platform to enable what we are calling full funnel testing which looks simultaneously at the impact of a single change on conversion rates, and on search performance:
If you’re interested in the technical details of how we do the testing, you can read more about the setup of a full funnel test here. (Thanks to my colleagues Craig Bradford and Tom Anthony for concepts and diagrams that appear throughout this post).
But what I really want to talk about today is the mixed objectives of CRO and SEO, and what happens if you fail to look closely at the impact of both together. First: some pure CRO.
An example CRO scenario: The business impact of conversion rate testing
In the example that follows, we look at the impact on an example business of a series of conversion rate tests conducted throughout a year, and see the revenue uplift we might expect as a result of rolling out winning tests, and turning off null and negative ones. We compare the revenue we might achieve with the revenue we would have expected without testing. The example is a little simplified but it serves to prove our point.
We start on a high with a winning test in our first month:
After starting on a high, our example continues through a bad strong — a null test (no confident result in either direction) followed by three losers. We turn off each of these four so none of them have an actual impact on future months’ revenue:
Let’s continue something similar out through the end of the year. Over the course of this example year, we see 3 months with winning tests, and of course we only roll out those ones that come with uplifts:
By the end of this year, even though more tests have failed than have succeeded, you have proved some serious value to this small business, and have moved monthly revenue up significantly, taking annual revenue for the year up to over £1.1m (from a £900k starting point):
Is this the full picture, though?
What happens when we add in the impact on organic search performance of these changes we are rolling out, though? Well, let’s look at the same example financials with a couple more lines showing the SEO impact. That first positive CRO test? Negative for search performance:
If you weren’t testing the SEO impact, and only focused on the conversion uplift, you’d have rolled this one out. Carrying on, we see that the next (null) conversion rate test should have been rolled out because it was a win for search performance:
Continuing on through the rest of the year, we see that the actual picture (if we make decisions of whether or not to roll out changes based on the CRO testing) looks like this when we add in all the impacts:
So you remember how we thought we had turned an expected £900k of revenue into over £1.1m? Well, it turns out we've added less than £18k in reality and the revenue chart looks like the red line:
Let’s make some more sensible decisions, considering the SEO impact
Back to the beginning of the year once more, but this time, imagine that we actually tested both the conversion rate and search performance impact and rolled out our tests when they were net winners. This time we see that while a conversion-focused team would have rolled out the first test:
We would not:
Conversely, we would have rolled out the second test because it was a net positive even though the pure CRO view had it neutral / inconclusive:
When we zoom out on that approach to the full year, we see a very different picture to either of the previous views. By rolling out only the changes that are net positive considering their impact on search and conversion rate, we avoid some significant drops in performance, and get the chance to roll out a couple of additional uplifts that would have been missed by conversion rate changes alone:
The upshot being a +45% uplift for the year, ending the year with monthly revenue up 73%, avoiding the false hope of the pure conversion-centric view, and real business impact:
Now of course these are simplified examples, and in the real world we would need to look at impacts per channel and might consider rolling out tests that appeared not to be negative rather than waiting for statistical significance as positive. I asked CRO expert Stephen Pavlovich from conversion.com for his view on this and he said:
Most of the time, we want to see if making a change will improve performance. If we change our product page layout, will the order conversion rate increase? If we show more relevant product recommendations, will the Average Order Value go up? But it's also possible that we will run an AB test not to improve performance, but instead to minimize risk. Before we launch our website redesign, will it lower the order conversion rate? Before we put our prices up, what will the impact be on sales? In either case, there may be a desire to deploy the new variation — even if the AB test wasn't significant. If the business supports the website redesign, it can still be launched even without a significant impact on orders — it may have had significant financial and emotional investment from the business, be a better fit for the brand, or get better traction with partners (even if it doesn't move the needle in on-site conversion rate). Likewise, if the price increase didn't have a positive/negative effect on sales, it can still be launched.
Most importantly, we wouldn’t just throw away a winning SEO test that reduced conversion rate or a winning conversion rate test that negatively impacted search performance. Both of these tests would have come from underlying hypotheses, and by reaching significance, would have taught us something. We would take that knowledge and take it back as input into the next test in order to try to capture the good part without the associated downside.
All of those details, though, don’t change the underlying calculus that this is an important process, and one that I believe we are going to need to do more and more.
The future for effective, accountable SEO
There are two big reasons that I believe that the kind of approach I have outlined above is going to be increasingly important for the future of effective, accountable SEO:
1. We’re going to need to do more testing generally
I talked in a recent Whiteboard Friday about the surprising results we are seeing from testing, and the increasing need to test against the Google black box:
I don’t see this trend reversing any time soon. The more ML there is in the algorithm, and the more non-linear it all becomes, the less effective best practices will be, and the more common it will be to see surprising effects. My colleague Dom Woodman talked about this at our recent SearchLove London conference in his talk A Year of SEO Split Testing Changed How I Thought SEO Worked:
2. User signals are going to grow in importance
The trend towards Google using more and more real and implied user satisfaction and task completion metrics means that conversion-centric tests and hypotheses are going to have an increasing impact on search performance (if you haven’t yet read this fascinating CNBC article that goes behind the scenes on the search quality process at Google, I highly recommend it). Hopefully there will be an additional opportunity in the fact that theoretically the winning tests will sync up more and more — what’s good for users will actually be what’s good for search — but the methodology I’ve outlined above is the only way I can come up with to tell for sure.
I love talking about all of this, so if you have any questions, feel free to drop into the comments.
Sign up for The Moz Top 10, a semimonthly mailer updating you on the top ten hottest pieces of SEO news, tips, and rad links uncovered by the Moz team. Think of it as your exclusive digest of stuff you don't have time to hunt down but want to read!
0 notes
Text
What Happens When SEO and CRO Conflict?
Posted by willcritchlow
Much has been written and spoken about the interplay of SEO and CRO, and there are a lot of reasons why, in theory, both ought to be working towards a shared goal. Whether it's simple pragmatism of the business benefit of increasing total number of conversions, or higher-minded pursuits such as the ideal of Google seeking to reward the best user experiences, we have many things that should bring us together.
In practice, though, it’s rarely that simple or that unified. How much effort do the practitioners of each put in to ensure that they are working towards the true shared common goal of the greatest number of conversions?
In asking around, I've found that many SEOs do worry about their changes hurting conversion rates, but few actively mitigate that risk. Interestingly, my conversations with CRO experts show that they also often worry about SEOs’ work impacting negatively on conversion rates.
Neither side weights as highly the risks that conversion-oriented changes could hurt organic search performance, but our experiences show that both are real risks.
So how should we mitigate these risks? How should we work together?
But first, some evidence
There are certainly some SEO-centric changes that have a very low risk of having a negative impact on conversion rates for visitors from other channels. If you think about changing meta information, for example, much of that is invisible to users on the page—- maybe that is pure SEO:
And then on the flip side, there are clearly CRO changes that don’t have any impact on your organic search performance. Anything you do on non-indexed pages, for example, can’t change your rankings. Think about work done within a checkout process or within a login area. Google simply isn’t seeing those changes:
But everything else has a potential impact on both, and our experience has been showing us that the theoretical risk is absolutely real. We have definitely seen SEO changes that have changed conversion rates, and have experience of major CRO-centered changes that have had dramatic impacts on search performance (but more on that later). The point is, there’s a ton of stuff in the intersection of both SEO and CRO:
So throughout this post, I’ve talked about our experiences, and work we have done that has shown various impacts in different directions, from conversion rate-centric changes that change search performance and vice versa. How are we seeing all this?
Well, testing has been a central part of conversion rate work essentially since the field began, and we've been doing a lot of work in recent years on SEO A/B testing as well. At our recent London conference, we announced that we have been building out new features in our testing platform to enable what we are calling full funnel testing which looks simultaneously at the impact of a single change on conversion rates, and on search performance:
If you’re interested in the technical details of how we do the testing, you can read more about the setup of a full funnel test here. (Thanks to my colleagues Craig Bradford and Tom Anthony for concepts and diagrams that appear throughout this post).
But what I really want to talk about today is the mixed objectives of CRO and SEO, and what happens if you fail to look closely at the impact of both together. First: some pure CRO.
An example CRO scenario: The business impact of conversion rate testing
In the example that follows, we look at the impact on an example business of a series of conversion rate tests conducted throughout a year, and see the revenue uplift we might expect as a result of rolling out winning tests, and turning off null and negative ones. We compare the revenue we might achieve with the revenue we would have expected without testing. The example is a little simplified but it serves to prove our point.
We start on a high with a winning test in our first month:
After starting on a high, our example continues through a bad strong — a null test (no confident result in either direction) followed by three losers. We turn off each of these four so none of them have an actual impact on future months’ revenue:
Let’s continue something similar out through the end of the year. Over the course of this example year, we see 3 months with winning tests, and of course we only roll out those ones that come with uplifts:
By the end of this year, even though more tests have failed than have succeeded, you have proved some serious value to this small business, and have moved monthly revenue up significantly, taking annual revenue for the year up to over £1.1m (from a £900k starting point):
Is this the full picture, though?
What happens when we add in the impact on organic search performance of these changes we are rolling out, though? Well, let’s look at the same example financials with a couple more lines showing the SEO impact. That first positive CRO test? Negative for search performance:
If you weren’t testing the SEO impact, and only focused on the conversion uplift, you’d have rolled this one out. Carrying on, we see that the next (null) conversion rate test should have been rolled out because it was a win for search performance:
Continuing on through the rest of the year, we see that the actual picture (if we make decisions of whether or not to roll out changes based on the CRO testing) looks like this when we add in all the impacts:
So you remember how we thought we had turned an expected £900k of revenue into over £1.1m? Well, it turns out we've added less than £18k in reality and the revenue chart looks like the red line:
Let’s make some more sensible decisions, considering the SEO impact
Back to the beginning of the year once more, but this time, imagine that we actually tested both the conversion rate and search performance impact and rolled out our tests when they were net winners. This time we see that while a conversion-focused team would have rolled out the first test:
We would not:
Conversely, we would have rolled out the second test because it was a net positive even though the pure CRO view had it neutral / inconclusive:
When we zoom out on that approach to the full year, we see a very different picture to either of the previous views. By rolling out only the changes that are net positive considering their impact on search and conversion rate, we avoid some significant drops in performance, and get the chance to roll out a couple of additional uplifts that would have been missed by conversion rate changes alone:
The upshot being a +45% uplift for the year, ending the year with monthly revenue up 73%, avoiding the false hope of the pure conversion-centric view, and real business impact:
Now of course these are simplified examples, and in the real world we would need to look at impacts per channel and might consider rolling out tests that appeared not to be negative rather than waiting for statistical significance as positive. I asked CRO expert Stephen Pavlovich from conversion.com for his view on this and he said:
Most of the time, we want to see if making a change will improve performance. If we change our product page layout, will the order conversion rate increase? If we show more relevant product recommendations, will the Average Order Value go up? But it's also possible that we will run an AB test not to improve performance, but instead to minimize risk. Before we launch our website redesign, will it lower the order conversion rate? Before we put our prices up, what will the impact be on sales? In either case, there may be a desire to deploy the new variation — even if the AB test wasn't significant. If the business supports the website redesign, it can still be launched even without a significant impact on orders — it may have had significant financial and emotional investment from the business, be a better fit for the brand, or get better traction with partners (even if it doesn't move the needle in on-site conversion rate). Likewise, if the price increase didn't have a positive/negative effect on sales, it can still be launched.
Most importantly, we wouldn’t just throw away a winning SEO test that reduced conversion rate or a winning conversion rate test that negatively impacted search performance. Both of these tests would have come from underlying hypotheses, and by reaching significance, would have taught us something. We would take that knowledge and take it back as input into the next test in order to try to capture the good part without the associated downside.
All of those details, though, don’t change the underlying calculus that this is an important process, and one that I believe we are going to need to do more and more.
The future for effective, accountable SEO
There are two big reasons that I believe that the kind of approach I have outlined above is going to be increasingly important for the future of effective, accountable SEO:
1. We’re going to need to do more testing generally
I talked in a recent Whiteboard Friday about the surprising results we are seeing from testing, and the increasing need to test against the Google black box:
I don’t see this trend reversing any time soon. The more ML there is in the algorithm, and the more non-linear it all becomes, the less effective best practices will be, and the more common it will be to see surprising effects. My colleague Dom Woodman talked about this at our recent SearchLove London conference in his talk A Year of SEO Split Testing Changed How I Thought SEO Worked:
2. User signals are going to grow in importance
The trend towards Google using more and more real and implied user satisfaction and task completion metrics means that conversion-centric tests and hypotheses are going to have an increasing impact on search performance (if you haven’t yet read this fascinating CNBC article that goes behind the scenes on the search quality process at Google, I highly recommend it). Hopefully there will be an additional opportunity in the fact that theoretically the winning tests will sync up more and more — what’s good for users will actually be what’s good for search — but the methodology I’ve outlined above is the only way I can come up with to tell for sure.
I love talking about all of this, so if you have any questions, feel free to drop into the comments.
Sign up for The Moz Top 10, a semimonthly mailer updating you on the top ten hottest pieces of SEO news, tips, and rad links uncovered by the Moz team. Think of it as your exclusive digest of stuff you don't have time to hunt down but want to read!
0 notes
Text
What Happens When SEO and CRO Conflict?
Posted by willcritchlow
Much has been written and spoken about the interplay of SEO and CRO, and there are a lot of reasons why, in theory, both ought to be working towards a shared goal. Whether it's simple pragmatism of the business benefit of increasing total number of conversions, or higher-minded pursuits such as the ideal of Google seeking to reward the best user experiences, we have many things that should bring us together.
In practice, though, it’s rarely that simple or that unified. How much effort do the practitioners of each put in to ensure that they are working towards the true shared common goal of the greatest number of conversions?
In asking around, I've found that many SEOs do worry about their changes hurting conversion rates, but few actively mitigate that risk. Interestingly, my conversations with CRO experts show that they also often worry about SEOs’ work impacting negatively on conversion rates.
Neither side weights as highly the risks that conversion-oriented changes could hurt organic search performance, but our experiences show that both are real risks.
So how should we mitigate these risks? How should we work together?
But first, some evidence
There are certainly some SEO-centric changes that have a very low risk of having a negative impact on conversion rates for visitors from other channels. If you think about changing meta information, for example, much of that is invisible to users on the page—- maybe that is pure SEO:
And then on the flip side, there are clearly CRO changes that don’t have any impact on your organic search performance. Anything you do on non-indexed pages, for example, can’t change your rankings. Think about work done within a checkout process or within a login area. Google simply isn’t seeing those changes:
But everything else has a potential impact on both, and our experience has been showing us that the theoretical risk is absolutely real. We have definitely seen SEO changes that have changed conversion rates, and have experience of major CRO-centered changes that have had dramatic impacts on search performance (but more on that later). The point is, there’s a ton of stuff in the intersection of both SEO and CRO:
So throughout this post, I’ve talked about our experiences, and work we have done that has shown various impacts in different directions, from conversion rate-centric changes that change search performance and vice versa. How are we seeing all this?
Well, testing has been a central part of conversion rate work essentially since the field began, and we've been doing a lot of work in recent years on SEO A/B testing as well. At our recent London conference, we announced that we have been building out new features in our testing platform to enable what we are calling full funnel testing which looks simultaneously at the impact of a single change on conversion rates, and on search performance:
If you’re interested in the technical details of how we do the testing, you can read more about the setup of a full funnel test here. (Thanks to my colleagues Craig Bradford and Tom Anthony for concepts and diagrams that appear throughout this post).
But what I really want to talk about today is the mixed objectives of CRO and SEO, and what happens if you fail to look closely at the impact of both together. First: some pure CRO.
An example CRO scenario: The business impact of conversion rate testing
In the example that follows, we look at the impact on an example business of a series of conversion rate tests conducted throughout a year, and see the revenue uplift we might expect as a result of rolling out winning tests, and turning off null and negative ones. We compare the revenue we might achieve with the revenue we would have expected without testing. The example is a little simplified but it serves to prove our point.
We start on a high with a winning test in our first month:
After starting on a high, our example continues through a bad strong — a null test (no confident result in either direction) followed by three losers. We turn off each of these four so none of them have an actual impact on future months’ revenue:
Let’s continue something similar out through the end of the year. Over the course of this example year, we see 3 months with winning tests, and of course we only roll out those ones that come with uplifts:
By the end of this year, even though more tests have failed than have succeeded, you have proved some serious value to this small business, and have moved monthly revenue up significantly, taking annual revenue for the year up to over £1.1m (from a £900k starting point):
Is this the full picture, though?
What happens when we add in the impact on organic search performance of these changes we are rolling out, though? Well, let’s look at the same example financials with a couple more lines showing the SEO impact. That first positive CRO test? Negative for search performance:
If you weren’t testing the SEO impact, and only focused on the conversion uplift, you’d have rolled this one out. Carrying on, we see that the next (null) conversion rate test should have been rolled out because it was a win for search performance:
Continuing on through the rest of the year, we see that the actual picture (if we make decisions of whether or not to roll out changes based on the CRO testing) looks like this when we add in all the impacts:
So you remember how we thought we had turned an expected £900k of revenue into over £1.1m? Well, it turns out we've added less than £18k in reality and the revenue chart looks like the red line:
Let’s make some more sensible decisions, considering the SEO impact
Back to the beginning of the year once more, but this time, imagine that we actually tested both the conversion rate and search performance impact and rolled out our tests when they were net winners. This time we see that while a conversion-focused team would have rolled out the first test:
We would not:
Conversely, we would have rolled out the second test because it was a net positive even though the pure CRO view had it neutral / inconclusive:
When we zoom out on that approach to the full year, we see a very different picture to either of the previous views. By rolling out only the changes that are net positive considering their impact on search and conversion rate, we avoid some significant drops in performance, and get the chance to roll out a couple of additional uplifts that would have been missed by conversion rate changes alone:
The upshot being a +45% uplift for the year, ending the year with monthly revenue up 73%, avoiding the false hope of the pure conversion-centric view, and real business impact:
Now of course these are simplified examples, and in the real world we would need to look at impacts per channel and might consider rolling out tests that appeared not to be negative rather than waiting for statistical significance as positive. I asked CRO expert Stephen Pavlovich from conversion.com for his view on this and he said:
Most of the time, we want to see if making a change will improve performance. If we change our product page layout, will the order conversion rate increase? If we show more relevant product recommendations, will the Average Order Value go up? But it's also possible that we will run an AB test not to improve performance, but instead to minimize risk. Before we launch our website redesign, will it lower the order conversion rate? Before we put our prices up, what will the impact be on sales? In either case, there may be a desire to deploy the new variation — even if the AB test wasn't significant. If the business supports the website redesign, it can still be launched even without a significant impact on orders — it may have had significant financial and emotional investment from the business, be a better fit for the brand, or get better traction with partners (even if it doesn't move the needle in on-site conversion rate). Likewise, if the price increase didn't have a positive/negative effect on sales, it can still be launched.
Most importantly, we wouldn’t just throw away a winning SEO test that reduced conversion rate or a winning conversion rate test that negatively impacted search performance. Both of these tests would have come from underlying hypotheses, and by reaching significance, would have taught us something. We would take that knowledge and take it back as input into the next test in order to try to capture the good part without the associated downside.
All of those details, though, don’t change the underlying calculus that this is an important process, and one that I believe we are going to need to do more and more.
The future for effective, accountable SEO
There are two big reasons that I believe that the kind of approach I have outlined above is going to be increasingly important for the future of effective, accountable SEO:
1. We’re going to need to do more testing generally
I talked in a recent Whiteboard Friday about the surprising results we are seeing from testing, and the increasing need to test against the Google black box:
I don’t see this trend reversing any time soon. The more ML there is in the algorithm, and the more non-linear it all becomes, the less effective best practices will be, and the more common it will be to see surprising effects. My colleague Dom Woodman talked about this at our recent SearchLove London conference in his talk A Year of SEO Split Testing Changed How I Thought SEO Worked:
2. User signals are going to grow in importance
The trend towards Google using more and more real and implied user satisfaction and task completion metrics means that conversion-centric tests and hypotheses are going to have an increasing impact on search performance (if you haven’t yet read this fascinating CNBC article that goes behind the scenes on the search quality process at Google, I highly recommend it). Hopefully there will be an additional opportunity in the fact that theoretically the winning tests will sync up more and more — what’s good for users will actually be what’s good for search — but the methodology I’ve outlined above is the only way I can come up with to tell for sure.
I love talking about all of this, so if you have any questions, feel free to drop into the comments.
Sign up for The Moz Top 10, a semimonthly mailer updating you on the top ten hottest pieces of SEO news, tips, and rad links uncovered by the Moz team. Think of it as your exclusive digest of stuff you don't have time to hunt down but want to read!
0 notes
Text
What Happens When SEO and CRO Conflict?
Posted by willcritchlow
Much has been written and spoken about the interplay of SEO and CRO, and there are a lot of reasons why, in theory, both ought to be working towards a shared goal. Whether it's simple pragmatism of the business benefit of increasing total number of conversions, or higher-minded pursuits such as the ideal of Google seeking to reward the best user experiences, we have many things that should bring us together.
In practice, though, it’s rarely that simple or that unified. How much effort do the practitioners of each put in to ensure that they are working towards the true shared common goal of the greatest number of conversions?
In asking around, I've found that many SEOs do worry about their changes hurting conversion rates, but few actively mitigate that risk. Interestingly, my conversations with CRO experts show that they also often worry about SEOs’ work impacting negatively on conversion rates.
Neither side weights as highly the risks that conversion-oriented changes could hurt organic search performance, but our experiences show that both are real risks.
So how should we mitigate these risks? How should we work together?
But first, some evidence
There are certainly some SEO-centric changes that have a very low risk of having a negative impact on conversion rates for visitors from other channels. If you think about changing meta information, for example, much of that is invisible to users on the page—- maybe that is pure SEO:
And then on the flip side, there are clearly CRO changes that don’t have any impact on your organic search performance. Anything you do on non-indexed pages, for example, can’t change your rankings. Think about work done within a checkout process or within a login area. Google simply isn’t seeing those changes:
But everything else has a potential impact on both, and our experience has been showing us that the theoretical risk is absolutely real. We have definitely seen SEO changes that have changed conversion rates, and have experience of major CRO-centered changes that have had dramatic impacts on search performance (but more on that later). The point is, there’s a ton of stuff in the intersection of both SEO and CRO:
So throughout this post, I’ve talked about our experiences, and work we have done that has shown various impacts in different directions, from conversion rate-centric changes that change search performance and vice versa. How are we seeing all this?
Well, testing has been a central part of conversion rate work essentially since the field began, and we've been doing a lot of work in recent years on SEO A/B testing as well. At our recent London conference, we announced that we have been building out new features in our testing platform to enable what we are calling full funnel testing which looks simultaneously at the impact of a single change on conversion rates, and on search performance:
If you’re interested in the technical details of how we do the testing, you can read more about the setup of a full funnel test here. (Thanks to my colleagues Craig Bradford and Tom Anthony for concepts and diagrams that appear throughout this post).
But what I really want to talk about today is the mixed objectives of CRO and SEO, and what happens if you fail to look closely at the impact of both together. First: some pure CRO.
An example CRO scenario: The business impact of conversion rate testing
In the example that follows, we look at the impact on an example business of a series of conversion rate tests conducted throughout a year, and see the revenue uplift we might expect as a result of rolling out winning tests, and turning off null and negative ones. We compare the revenue we might achieve with the revenue we would have expected without testing. The example is a little simplified but it serves to prove our point.
We start on a high with a winning test in our first month:
After starting on a high, our example continues through a bad strong — a null test (no confident result in either direction) followed by three losers. We turn off each of these four so none of them have an actual impact on future months’ revenue:
Let’s continue something similar out through the end of the year. Over the course of this example year, we see 3 months with winning tests, and of course we only roll out those ones that come with uplifts:
By the end of this year, even though more tests have failed than have succeeded, you have proved some serious value to this small business, and have moved monthly revenue up significantly, taking annual revenue for the year up to over £1.1m (from a £900k starting point):
Is this the full picture, though?
What happens when we add in the impact on organic search performance of these changes we are rolling out, though? Well, let’s look at the same example financials with a couple more lines showing the SEO impact. That first positive CRO test? Negative for search performance:
If you weren’t testing the SEO impact, and only focused on the conversion uplift, you’d have rolled this one out. Carrying on, we see that the next (null) conversion rate test should have been rolled out because it was a win for search performance:
Continuing on through the rest of the year, we see that the actual picture (if we make decisions of whether or not to roll out changes based on the CRO testing) looks like this when we add in all the impacts:
So you remember how we thought we had turned an expected £900k of revenue into over £1.1m? Well, it turns out we've added less than £18k in reality and the revenue chart looks like the red line:
Let’s make some more sensible decisions, considering the SEO impact
Back to the beginning of the year once more, but this time, imagine that we actually tested both the conversion rate and search performance impact and rolled out our tests when they were net winners. This time we see that while a conversion-focused team would have rolled out the first test:
We would not:
Conversely, we would have rolled out the second test because it was a net positive even though the pure CRO view had it neutral / inconclusive:
When we zoom out on that approach to the full year, we see a very different picture to either of the previous views. By rolling out only the changes that are net positive considering their impact on search and conversion rate, we avoid some significant drops in performance, and get the chance to roll out a couple of additional uplifts that would have been missed by conversion rate changes alone:
The upshot being a +45% uplift for the year, ending the year with monthly revenue up 73%, avoiding the false hope of the pure conversion-centric view, and real business impact:
Now of course these are simplified examples, and in the real world we would need to look at impacts per channel and might consider rolling out tests that appeared not to be negative rather than waiting for statistical significance as positive. I asked CRO expert Stephen Pavlovich from conversion.com for his view on this and he said:
Most of the time, we want to see if making a change will improve performance. If we change our product page layout, will the order conversion rate increase? If we show more relevant product recommendations, will the Average Order Value go up? But it's also possible that we will run an AB test not to improve performance, but instead to minimize risk. Before we launch our website redesign, will it lower the order conversion rate? Before we put our prices up, what will the impact be on sales? In either case, there may be a desire to deploy the new variation — even if the AB test wasn't significant. If the business supports the website redesign, it can still be launched even without a significant impact on orders — it may have had significant financial and emotional investment from the business, be a better fit for the brand, or get better traction with partners (even if it doesn't move the needle in on-site conversion rate). Likewise, if the price increase didn't have a positive/negative effect on sales, it can still be launched.
Most importantly, we wouldn’t just throw away a winning SEO test that reduced conversion rate or a winning conversion rate test that negatively impacted search performance. Both of these tests would have come from underlying hypotheses, and by reaching significance, would have taught us something. We would take that knowledge and take it back as input into the next test in order to try to capture the good part without the associated downside.
All of those details, though, don’t change the underlying calculus that this is an important process, and one that I believe we are going to need to do more and more.
The future for effective, accountable SEO
There are two big reasons that I believe that the kind of approach I have outlined above is going to be increasingly important for the future of effective, accountable SEO:
1. We’re going to need to do more testing generally
I talked in a recent Whiteboard Friday about the surprising results we are seeing from testing, and the increasing need to test against the Google black box:
I don’t see this trend reversing any time soon. The more ML there is in the algorithm, and the more non-linear it all becomes, the less effective best practices will be, and the more common it will be to see surprising effects. My colleague Dom Woodman talked about this at our recent SearchLove London conference in his talk A Year of SEO Split Testing Changed How I Thought SEO Worked:
2. User signals are going to grow in importance
The trend towards Google using more and more real and implied user satisfaction and task completion metrics means that conversion-centric tests and hypotheses are going to have an increasing impact on search performance (if you haven’t yet read this fascinating CNBC article that goes behind the scenes on the search quality process at Google, I highly recommend it). Hopefully there will be an additional opportunity in the fact that theoretically the winning tests will sync up more and more — what’s good for users will actually be what’s good for search — but the methodology I’ve outlined above is the only way I can come up with to tell for sure.
I love talking about all of this, so if you have any questions, feel free to drop into the comments.
Sign up for The Moz Top 10, a semimonthly mailer updating you on the top ten hottest pieces of SEO news, tips, and rad links uncovered by the Moz team. Think of it as your exclusive digest of stuff you don't have time to hunt down but want to read!
0 notes
Text
What Happens When SEO and CRO Conflict?
Posted by willcritchlow
Much has been written and spoken about the interplay of SEO and CRO, and there are a lot of reasons why, in theory, both ought to be working towards a shared goal. Whether it's simple pragmatism of the business benefit of increasing total number of conversions, or higher-minded pursuits such as the ideal of Google seeking to reward the best user experiences, we have many things that should bring us together.
In practice, though, it’s rarely that simple or that unified. How much effort do the practitioners of each put in to ensure that they are working towards the true shared common goal of the greatest number of conversions?
In asking around, I've found that many SEOs do worry about their changes hurting conversion rates, but few actively mitigate that risk. Interestingly, my conversations with CRO experts show that they also often worry about SEOs’ work impacting negatively on conversion rates.
Neither side weights as highly the risks that conversion-oriented changes could hurt organic search performance, but our experiences show that both are real risks.
So how should we mitigate these risks? How should we work together?
But first, some evidence
There are certainly some SEO-centric changes that have a very low risk of having a negative impact on conversion rates for visitors from other channels. If you think about changing meta information, for example, much of that is invisible to users on the page—- maybe that is pure SEO:
And then on the flip side, there are clearly CRO changes that don’t have any impact on your organic search performance. Anything you do on non-indexed pages, for example, can’t change your rankings. Think about work done within a checkout process or within a login area. Google simply isn’t seeing those changes:
But everything else has a potential impact on both, and our experience has been showing us that the theoretical risk is absolutely real. We have definitely seen SEO changes that have changed conversion rates, and have experience of major CRO-centered changes that have had dramatic impacts on search performance (but more on that later). The point is, there’s a ton of stuff in the intersection of both SEO and CRO:
So throughout this post, I’ve talked about our experiences, and work we have done that has shown various impacts in different directions, from conversion rate-centric changes that change search performance and vice versa. How are we seeing all this?
Well, testing has been a central part of conversion rate work essentially since the field began, and we've been doing a lot of work in recent years on SEO A/B testing as well. At our recent London conference, we announced that we have been building out new features in our testing platform to enable what we are calling full funnel testing which looks simultaneously at the impact of a single change on conversion rates, and on search performance:
If you’re interested in the technical details of how we do the testing, you can read more about the setup of a full funnel test here. (Thanks to my colleagues Craig Bradford and Tom Anthony for concepts and diagrams that appear throughout this post).
But what I really want to talk about today is the mixed objectives of CRO and SEO, and what happens if you fail to look closely at the impact of both together. First: some pure CRO.
An example CRO scenario: The business impact of conversion rate testing
In the example that follows, we look at the impact on an example business of a series of conversion rate tests conducted throughout a year, and see the revenue uplift we might expect as a result of rolling out winning tests, and turning off null and negative ones. We compare the revenue we might achieve with the revenue we would have expected without testing. The example is a little simplified but it serves to prove our point.
We start on a high with a winning test in our first month:
After starting on a high, our example continues through a bad strong — a null test (no confident result in either direction) followed by three losers. We turn off each of these four so none of them have an actual impact on future months’ revenue:
Let’s continue something similar out through the end of the year. Over the course of this example year, we see 3 months with winning tests, and of course we only roll out those ones that come with uplifts:
By the end of this year, even though more tests have failed than have succeeded, you have proved some serious value to this small business, and have moved monthly revenue up significantly, taking annual revenue for the year up to over £1.1m (from a £900k starting point):
Is this the full picture, though?
What happens when we add in the impact on organic search performance of these changes we are rolling out, though? Well, let’s look at the same example financials with a couple more lines showing the SEO impact. That first positive CRO test? Negative for search performance:
If you weren’t testing the SEO impact, and only focused on the conversion uplift, you’d have rolled this one out. Carrying on, we see that the next (null) conversion rate test should have been rolled out because it was a win for search performance:
Continuing on through the rest of the year, we see that the actual picture (if we make decisions of whether or not to roll out changes based on the CRO testing) looks like this when we add in all the impacts:
So you remember how we thought we had turned an expected £900k of revenue into over £1.1m? Well, it turns out we've added less than £18k in reality and the revenue chart looks like the red line:
Let’s make some more sensible decisions, considering the SEO impact
Back to the beginning of the year once more, but this time, imagine that we actually tested both the conversion rate and search performance impact and rolled out our tests when they were net winners. This time we see that while a conversion-focused team would have rolled out the first test:
We would not:
Conversely, we would have rolled out the second test because it was a net positive even though the pure CRO view had it neutral / inconclusive:
When we zoom out on that approach to the full year, we see a very different picture to either of the previous views. By rolling out only the changes that are net positive considering their impact on search and conversion rate, we avoid some significant drops in performance, and get the chance to roll out a couple of additional uplifts that would have been missed by conversion rate changes alone:
The upshot being a +45% uplift for the year, ending the year with monthly revenue up 73%, avoiding the false hope of the pure conversion-centric view, and real business impact:
Now of course these are simplified examples, and in the real world we would need to look at impacts per channel and might consider rolling out tests that appeared not to be negative rather than waiting for statistical significance as positive. I asked CRO expert Stephen Pavlovich from conversion.com for his view on this and he said:
Most of the time, we want to see if making a change will improve performance. If we change our product page layout, will the order conversion rate increase? If we show more relevant product recommendations, will the Average Order Value go up? But it's also possible that we will run an AB test not to improve performance, but instead to minimize risk. Before we launch our website redesign, will it lower the order conversion rate? Before we put our prices up, what will the impact be on sales? In either case, there may be a desire to deploy the new variation — even if the AB test wasn't significant. If the business supports the website redesign, it can still be launched even without a significant impact on orders — it may have had significant financial and emotional investment from the business, be a better fit for the brand, or get better traction with partners (even if it doesn't move the needle in on-site conversion rate). Likewise, if the price increase didn't have a positive/negative effect on sales, it can still be launched.
Most importantly, we wouldn’t just throw away a winning SEO test that reduced conversion rate or a winning conversion rate test that negatively impacted search performance. Both of these tests would have come from underlying hypotheses, and by reaching significance, would have taught us something. We would take that knowledge and take it back as input into the next test in order to try to capture the good part without the associated downside.
All of those details, though, don’t change the underlying calculus that this is an important process, and one that I believe we are going to need to do more and more.
The future for effective, accountable SEO
There are two big reasons that I believe that the kind of approach I have outlined above is going to be increasingly important for the future of effective, accountable SEO:
1. We’re going to need to do more testing generally
I talked in a recent Whiteboard Friday about the surprising results we are seeing from testing, and the increasing need to test against the Google black box:
I don’t see this trend reversing any time soon. The more ML there is in the algorithm, and the more non-linear it all becomes, the less effective best practices will be, and the more common it will be to see surprising effects. My colleague Dom Woodman talked about this at our recent SearchLove London conference in his talk A Year of SEO Split Testing Changed How I Thought SEO Worked:
2. User signals are going to grow in importance
The trend towards Google using more and more real and implied user satisfaction and task completion metrics means that conversion-centric tests and hypotheses are going to have an increasing impact on search performance (if you haven’t yet read this fascinating CNBC article that goes behind the scenes on the search quality process at Google, I highly recommend it). Hopefully there will be an additional opportunity in the fact that theoretically the winning tests will sync up more and more — what’s good for users will actually be what���s good for search — but the methodology I’ve outlined above is the only way I can come up with to tell for sure.
I love talking about all of this, so if you have any questions, feel free to drop into the comments.
Sign up for The Moz Top 10, a semimonthly mailer updating you on the top ten hottest pieces of SEO news, tips, and rad links uncovered by the Moz team. Think of it as your exclusive digest of stuff you don't have time to hunt down but want to read!
0 notes
Text
What Happens When SEO and CRO Conflict?
Posted by willcritchlow
Much has been written and spoken about the interplay of SEO and CRO, and there are a lot of reasons why, in theory, both ought to be working towards a shared goal. Whether it's simple pragmatism of the business benefit of increasing total number of conversions, or higher-minded pursuits such as the ideal of Google seeking to reward the best user experiences, we have many things that should bring us together.
In practice, though, it’s rarely that simple or that unified. How much effort do the practitioners of each put in to ensure that they are working towards the true shared common goal of the greatest number of conversions?
In asking around, I've found that many SEOs do worry about their changes hurting conversion rates, but few actively mitigate that risk. Interestingly, my conversations with CRO experts show that they also often worry about SEOs’ work impacting negatively on conversion rates.
Neither side weights as highly the risks that conversion-oriented changes could hurt organic search performance, but our experiences show that both are real risks.
So how should we mitigate these risks? How should we work together?
But first, some evidence
There are certainly some SEO-centric changes that have a very low risk of having a negative impact on conversion rates for visitors from other channels. If you think about changing meta information, for example, much of that is invisible to users on the page—- maybe that is pure SEO:
And then on the flip side, there are clearly CRO changes that don’t have any impact on your organic search performance. Anything you do on non-indexed pages, for example, can’t change your rankings. Think about work done within a checkout process or within a login area. Google simply isn’t seeing those changes:
But everything else has a potential impact on both, and our experience has been showing us that the theoretical risk is absolutely real. We have definitely seen SEO changes that have changed conversion rates, and have experience of major CRO-centered changes that have had dramatic impacts on search performance (but more on that later). The point is, there’s a ton of stuff in the intersection of both SEO and CRO:
So throughout this post, I’ve talked about our experiences, and work we have done that has shown various impacts in different directions, from conversion rate-centric changes that change search performance and vice versa. How are we seeing all this?
Well, testing has been a central part of conversion rate work essentially since the field began, and we've been doing a lot of work in recent years on SEO A/B testing as well. At our recent London conference, we announced that we have been building out new features in our testing platform to enable what we are calling full funnel testing which looks simultaneously at the impact of a single change on conversion rates, and on search performance:
If you’re interested in the technical details of how we do the testing, you can read more about the setup of a full funnel test here. (Thanks to my colleagues Craig Bradford and Tom Anthony for concepts and diagrams that appear throughout this post).
But what I really want to talk about today is the mixed objectives of CRO and SEO, and what happens if you fail to look closely at the impact of both together. First: some pure CRO.
An example CRO scenario: The business impact of conversion rate testing
In the example that follows, we look at the impact on an example business of a series of conversion rate tests conducted throughout a year, and see the revenue uplift we might expect as a result of rolling out winning tests, and turning off null and negative ones. We compare the revenue we might achieve with the revenue we would have expected without testing. The example is a little simplified but it serves to prove our point.
We start on a high with a winning test in our first month:
After starting on a high, our example continues through a bad strong — a null test (no confident result in either direction) followed by three losers. We turn off each of these four so none of them have an actual impact on future months’ revenue:
Let’s continue something similar out through the end of the year. Over the course of this example year, we see 3 months with winning tests, and of course we only roll out those ones that come with uplifts:
By the end of this year, even though more tests have failed than have succeeded, you have proved some serious value to this small business, and have moved monthly revenue up significantly, taking annual revenue for the year up to over £1.1m (from a £900k starting point):
Is this the full picture, though?
What happens when we add in the impact on organic search performance of these changes we are rolling out, though? Well, let’s look at the same example financials with a couple more lines showing the SEO impact. That first positive CRO test? Negative for search performance:
If you weren’t testing the SEO impact, and only focused on the conversion uplift, you’d have rolled this one out. Carrying on, we see that the next (null) conversion rate test should have been rolled out because it was a win for search performance:
Continuing on through the rest of the year, we see that the actual picture (if we make decisions of whether or not to roll out changes based on the CRO testing) looks like this when we add in all the impacts:
So you remember how we thought we had turned an expected £900k of revenue into over £1.1m? Well, it turns out we've added less than £18k in reality and the revenue chart looks like the red line:
Let’s make some more sensible decisions, considering the SEO impact
Back to the beginning of the year once more, but this time, imagine that we actually tested both the conversion rate and search performance impact and rolled out our tests when they were net winners. This time we see that while a conversion-focused team would have rolled out the first test:
We would not:
Conversely, we would have rolled out the second test because it was a net positive even though the pure CRO view had it neutral / inconclusive:
When we zoom out on that approach to the full year, we see a very different picture to either of the previous views. By rolling out only the changes that are net positive considering their impact on search and conversion rate, we avoid some significant drops in performance, and get the chance to roll out a couple of additional uplifts that would have been missed by conversion rate changes alone:
The upshot being a +45% uplift for the year, ending the year with monthly revenue up 73%, avoiding the false hope of the pure conversion-centric view, and real business impact:
Now of course these are simplified examples, and in the real world we would need to look at impacts per channel and might consider rolling out tests that appeared not to be negative rather than waiting for statistical significance as positive. I asked CRO expert Stephen Pavlovich from conversion.com for his view on this and he said:
Most of the time, we want to see if making a change will improve performance. If we change our product page layout, will the order conversion rate increase? If we show more relevant product recommendations, will the Average Order Value go up? But it's also possible that we will run an AB test not to improve performance, but instead to minimize risk. Before we launch our website redesign, will it lower the order conversion rate? Before we put our prices up, what will the impact be on sales? In either case, there may be a desire to deploy the new variation — even if the AB test wasn't significant. If the business supports the website redesign, it can still be launched even without a significant impact on orders — it may have had significant financial and emotional investment from the business, be a better fit for the brand, or get better traction with partners (even if it doesn't move the needle in on-site conversion rate). Likewise, if the price increase didn't have a positive/negative effect on sales, it can still be launched.
Most importantly, we wouldn’t just throw away a winning SEO test that reduced conversion rate or a winning conversion rate test that negatively impacted search performance. Both of these tests would have come from underlying hypotheses, and by reaching significance, would have taught us something. We would take that knowledge and take it back as input into the next test in order to try to capture the good part without the associated downside.
All of those details, though, don’t change the underlying calculus that this is an important process, and one that I believe we are going to need to do more and more.
The future for effective, accountable SEO
There are two big reasons that I believe that the kind of approach I have outlined above is going to be increasingly important for the future of effective, accountable SEO:
1. We’re going to need to do more testing generally
I talked in a recent Whiteboard Friday about the surprising results we are seeing from testing, and the increasing need to test against the Google black box:
I don’t see this trend reversing any time soon. The more ML there is in the algorithm, and the more non-linear it all becomes, the less effective best practices will be, and the more common it will be to see surprising effects. My colleague Dom Woodman talked about this at our recent SearchLove London conference in his talk A Year of SEO Split Testing Changed How I Thought SEO Worked:
2. User signals are going to grow in importance
The trend towards Google using more and more real and implied user satisfaction and task completion metrics means that conversion-centric tests and hypotheses are going to have an increasing impact on search performance (if you haven’t yet read this fascinating CNBC article that goes behind the scenes on the search quality process at Google, I highly recommend it). Hopefully there will be an additional opportunity in the fact that theoretically the winning tests will sync up more and more — what’s good for users will actually be what’s good for search — but the methodology I’ve outlined above is the only way I can come up with to tell for sure.
I love talking about all of this, so if you have any questions, feel free to drop into the comments.
Sign up for The Moz Top 10, a semimonthly mailer updating you on the top ten hottest pieces of SEO news, tips, and rad links uncovered by the Moz team. Think of it as your exclusive digest of stuff you don't have time to hunt down but want to read!
0 notes
Text
What Happens When SEO and CRO Conflict?
Posted by willcritchlow
Much has been written and spoken about the interplay of SEO and CRO, and there are a lot of reasons why, in theory, both ought to be working towards a shared goal. Whether it's simple pragmatism of the business benefit of increasing total number of conversions, or higher-minded pursuits such as the ideal of Google seeking to reward the best user experiences, we have many things that should bring us together.
In practice, though, it’s rarely that simple or that unified. How much effort do the practitioners of each put in to ensure that they are working towards the true shared common goal of the greatest number of conversions?
In asking around, I've found that many SEOs do worry about their changes hurting conversion rates, but few actively mitigate that risk. Interestingly, my conversations with CRO experts show that they also often worry about SEOs’ work impacting negatively on conversion rates.
Neither side weights as highly the risks that conversion-oriented changes could hurt organic search performance, but our experiences show that both are real risks.
So how should we mitigate these risks? How should we work together?
But first, some evidence
There are certainly some SEO-centric changes that have a very low risk of having a negative impact on conversion rates for visitors from other channels. If you think about changing meta information, for example, much of that is invisible to users on the page—- maybe that is pure SEO:
And then on the flip side, there are clearly CRO changes that don’t have any impact on your organic search performance. Anything you do on non-indexed pages, for example, can’t change your rankings. Think about work done within a checkout process or within a login area. Google simply isn’t seeing those changes:
But everything else has a potential impact on both, and our experience has been showing us that the theoretical risk is absolutely real. We have definitely seen SEO changes that have changed conversion rates, and have experience of major CRO-centered changes that have had dramatic impacts on search performance (but more on that later). The point is, there’s a ton of stuff in the intersection of both SEO and CRO:
So throughout this post, I’ve talked about our experiences, and work we have done that has shown various impacts in different directions, from conversion rate-centric changes that change search performance and vice versa. How are we seeing all this?
Well, testing has been a central part of conversion rate work essentially since the field began, and we've been doing a lot of work in recent years on SEO A/B testing as well. At our recent London conference, we announced that we have been building out new features in our testing platform to enable what we are calling full funnel testing which looks simultaneously at the impact of a single change on conversion rates, and on search performance:
If you’re interested in the technical details of how we do the testing, you can read more about the setup of a full funnel test here. (Thanks to my colleagues Craig Bradford and Tom Anthony for concepts and diagrams that appear throughout this post).
But what I really want to talk about today is the mixed objectives of CRO and SEO, and what happens if you fail to look closely at the impact of both together. First: some pure CRO.
An example CRO scenario: The business impact of conversion rate testing
In the example that follows, we look at the impact on an example business of a series of conversion rate tests conducted throughout a year, and see the revenue uplift we might expect as a result of rolling out winning tests, and turning off null and negative ones. We compare the revenue we might achieve with the revenue we would have expected without testing. The example is a little simplified but it serves to prove our point.
We start on a high with a winning test in our first month:
After starting on a high, our example continues through a bad strong — a null test (no confident result in either direction) followed by three losers. We turn off each of these four so none of them have an actual impact on future months’ revenue:
Let’s continue something similar out through the end of the year. Over the course of this example year, we see 3 months with winning tests, and of course we only roll out those ones that come with uplifts:
By the end of this year, even though more tests have failed than have succeeded, you have proved some serious value to this small business, and have moved monthly revenue up significantly, taking annual revenue for the year up to over £1.1m (from a £900k starting point):
Is this the full picture, though?
What happens when we add in the impact on organic search performance of these changes we are rolling out, though? Well, let’s look at the same example financials with a couple more lines showing the SEO impact. That first positive CRO test? Negative for search performance:
If you weren’t testing the SEO impact, and only focused on the conversion uplift, you’d have rolled this one out. Carrying on, we see that the next (null) conversion rate test should have been rolled out because it was a win for search performance:
Continuing on through the rest of the year, we see that the actual picture (if we make decisions of whether or not to roll out changes based on the CRO testing) looks like this when we add in all the impacts:
So you remember how we thought we had turned an expected £900k of revenue into over £1.1m? Well, it turns out we've added less than £18k in reality and the revenue chart looks like the red line:
Let’s make some more sensible decisions, considering the SEO impact
Back to the beginning of the year once more, but this time, imagine that we actually tested both the conversion rate and search performance impact and rolled out our tests when they were net winners. This time we see that while a conversion-focused team would have rolled out the first test:
We would not:
Conversely, we would have rolled out the second test because it was a net positive even though the pure CRO view had it neutral / inconclusive:
When we zoom out on that approach to the full year, we see a very different picture to either of the previous views. By rolling out only the changes that are net positive considering their impact on search and conversion rate, we avoid some significant drops in performance, and get the chance to roll out a couple of additional uplifts that would have been missed by conversion rate changes alone:
The upshot being a +45% uplift for the year, ending the year with monthly revenue up 73%, avoiding the false hope of the pure conversion-centric view, and real business impact:
Now of course these are simplified examples, and in the real world we would need to look at impacts per channel and might consider rolling out tests that appeared not to be negative rather than waiting for statistical significance as positive. I asked CRO expert Stephen Pavlovich from conversion.com for his view on this and he said:
Most of the time, we want to see if making a change will improve performance. If we change our product page layout, will the order conversion rate increase? If we show more relevant product recommendations, will the Average Order Value go up? But it's also possible that we will run an AB test not to improve performance, but instead to minimize risk. Before we launch our website redesign, will it lower the order conversion rate? Before we put our prices up, what will the impact be on sales? In either case, there may be a desire to deploy the new variation — even if the AB test wasn't significant. If the business supports the website redesign, it can still be launched even without a significant impact on orders — it may have had significant financial and emotional investment from the business, be a better fit for the brand, or get better traction with partners (even if it doesn't move the needle in on-site conversion rate). Likewise, if the price increase didn't have a positive/negative effect on sales, it can still be launched.
Most importantly, we wouldn’t just throw away a winning SEO test that reduced conversion rate or a winning conversion rate test that negatively impacted search performance. Both of these tests would have come from underlying hypotheses, and by reaching significance, would have taught us something. We would take that knowledge and take it back as input into the next test in order to try to capture the good part without the associated downside.
All of those details, though, don’t change the underlying calculus that this is an important process, and one that I believe we are going to need to do more and more.
The future for effective, accountable SEO
There are two big reasons that I believe that the kind of approach I have outlined above is going to be increasingly important for the future of effective, accountable SEO:
1. We’re going to need to do more testing generally
I talked in a recent Whiteboard Friday about the surprising results we are seeing from testing, and the increasing need to test against the Google black box:
I don’t see this trend reversing any time soon. The more ML there is in the algorithm, and the more non-linear it all becomes, the less effective best practices will be, and the more common it will be to see surprising effects. My colleague Dom Woodman talked about this at our recent SearchLove London conference in his talk A Year of SEO Split Testing Changed How I Thought SEO Worked:
2. User signals are going to grow in importance
The trend towards Google using more and more real and implied user satisfaction and task completion metrics means that conversion-centric tests and hypotheses are going to have an increasing impact on search performance (if you haven’t yet read this fascinating CNBC article that goes behind the scenes on the search quality process at Google, I highly recommend it). Hopefully there will be an additional opportunity in the fact that theoretically the winning tests will sync up more and more — what’s good for users will actually be what’s good for search — but the methodology I’ve outlined above is the only way I can come up with to tell for sure.
I love talking about all of this, so if you have any questions, feel free to drop into the comments.
Sign up for The Moz Top 10, a semimonthly mailer updating you on the top ten hottest pieces of SEO news, tips, and rad links uncovered by the Moz team. Think of it as your exclusive digest of stuff you don't have time to hunt down but want to read!
0 notes
Text
What Happens When SEO and CRO Conflict?
Posted by willcritchlow
Much has been written and spoken about the interplay of SEO and CRO, and there are a lot of reasons why, in theory, both ought to be working towards a shared goal. Whether it's simple pragmatism of the business benefit of increasing total number of conversions, or higher-minded pursuits such as the ideal of Google seeking to reward the best user experiences, we have many things that should bring us together.
In practice, though, it’s rarely that simple or that unified. How much effort do the practitioners of each put in to ensure that they are working towards the true shared common goal of the greatest number of conversions?
In asking around, I've found that many SEOs do worry about their changes hurting conversion rates, but few actively mitigate that risk. Interestingly, my conversations with CRO experts show that they also often worry about SEOs’ work impacting negatively on conversion rates.
Neither side weights as highly the risks that conversion-oriented changes could hurt organic search performance, but our experiences show that both are real risks.
So how should we mitigate these risks? How should we work together?
But first, some evidence
There are certainly some SEO-centric changes that have a very low risk of having a negative impact on conversion rates for visitors from other channels. If you think about changing meta information, for example, much of that is invisible to users on the page—- maybe that is pure SEO:
And then on the flip side, there are clearly CRO changes that don’t have any impact on your organic search performance. Anything you do on non-indexed pages, for example, can’t change your rankings. Think about work done within a checkout process or within a login area. Google simply isn’t seeing those changes:
But everything else has a potential impact on both, and our experience has been showing us that the theoretical risk is absolutely real. We have definitely seen SEO changes that have changed conversion rates, and have experience of major CRO-centered changes that have had dramatic impacts on search performance (but more on that later). The point is, there’s a ton of stuff in the intersection of both SEO and CRO:
So throughout this post, I’ve talked about our experiences, and work we have done that has shown various impacts in different directions, from conversion rate-centric changes that change search performance and vice versa. How are we seeing all this?
Well, testing has been a central part of conversion rate work essentially since the field began, and we've been doing a lot of work in recent years on SEO A/B testing as well. At our recent London conference, we announced that we have been building out new features in our testing platform to enable what we are calling full funnel testing which looks simultaneously at the impact of a single change on conversion rates, and on search performance:
If you’re interested in the technical details of how we do the testing, you can read more about the setup of a full funnel test here. (Thanks to my colleagues Craig Bradford and Tom Anthony for concepts and diagrams that appear throughout this post).
But what I really want to talk about today is the mixed objectives of CRO and SEO, and what happens if you fail to look closely at the impact of both together. First: some pure CRO.
An example CRO scenario: The business impact of conversion rate testing
In the example that follows, we look at the impact on an example business of a series of conversion rate tests conducted throughout a year, and see the revenue uplift we might expect as a result of rolling out winning tests, and turning off null and negative ones. We compare the revenue we might achieve with the revenue we would have expected without testing. The example is a little simplified but it serves to prove our point.
We start on a high with a winning test in our first month:
After starting on a high, our example continues through a bad strong — a null test (no confident result in either direction) followed by three losers. We turn off each of these four so none of them have an actual impact on future months’ revenue:
Let’s continue something similar out through the end of the year. Over the course of this example year, we see 3 months with winning tests, and of course we only roll out those ones that come with uplifts:
By the end of this year, even though more tests have failed than have succeeded, you have proved some serious value to this small business, and have moved monthly revenue up significantly, taking annual revenue for the year up to over £1.1m (from a £900k starting point):
Is this the full picture, though?
What happens when we add in the impact on organic search performance of these changes we are rolling out, though? Well, let’s look at the same example financials with a couple more lines showing the SEO impact. That first positive CRO test? Negative for search performance:
If you weren’t testing the SEO impact, and only focused on the conversion uplift, you’d have rolled this one out. Carrying on, we see that the next (null) conversion rate test should have been rolled out because it was a win for search performance:
Continuing on through the rest of the year, we see that the actual picture (if we make decisions of whether or not to roll out changes based on the CRO testing) looks like this when we add in all the impacts:
So you remember how we thought we had turned an expected £900k of revenue into over £1.1m? Well, it turns out we've added less than £18k in reality and the revenue chart looks like the red line:
Let’s make some more sensible decisions, considering the SEO impact
Back to the beginning of the year once more, but this time, imagine that we actually tested both the conversion rate and search performance impact and rolled out our tests when they were net winners. This time we see that while a conversion-focused team would have rolled out the first test:
We would not:
Conversely, we would have rolled out the second test because it was a net positive even though the pure CRO view had it neutral / inconclusive:
When we zoom out on that approach to the full year, we see a very different picture to either of the previous views. By rolling out only the changes that are net positive considering their impact on search and conversion rate, we avoid some significant drops in performance, and get the chance to roll out a couple of additional uplifts that would have been missed by conversion rate changes alone:
The upshot being a +45% uplift for the year, ending the year with monthly revenue up 73%, avoiding the false hope of the pure conversion-centric view, and real business impact:
Now of course these are simplified examples, and in the real world we would need to look at impacts per channel and might consider rolling out tests that appeared not to be negative rather than waiting for statistical significance as positive. I asked CRO expert Stephen Pavlovich from conversion.com for his view on this and he said:
Most of the time, we want to see if making a change will improve performance. If we change our product page layout, will the order conversion rate increase? If we show more relevant product recommendations, will the Average Order Value go up? But it's also possible that we will run an AB test not to improve performance, but instead to minimize risk. Before we launch our website redesign, will it lower the order conversion rate? Before we put our prices up, what will the impact be on sales? In either case, there may be a desire to deploy the new variation — even if the AB test wasn't significant. If the business supports the website redesign, it can still be launched even without a significant impact on orders — it may have had significant financial and emotional investment from the business, be a better fit for the brand, or get better traction with partners (even if it doesn't move the needle in on-site conversion rate). Likewise, if the price increase didn't have a positive/negative effect on sales, it can still be launched.
Most importantly, we wouldn’t just throw away a winning SEO test that reduced conversion rate or a winning conversion rate test that negatively impacted search performance. Both of these tests would have come from underlying hypotheses, and by reaching significance, would have taught us something. We would take that knowledge and take it back as input into the next test in order to try to capture the good part without the associated downside.
All of those details, though, don’t change the underlying calculus that this is an important process, and one that I believe we are going to need to do more and more.
The future for effective, accountable SEO
There are two big reasons that I believe that the kind of approach I have outlined above is going to be increasingly important for the future of effective, accountable SEO:
1. We’re going to need to do more testing generally
I talked in a recent Whiteboard Friday about the surprising results we are seeing from testing, and the increasing need to test against the Google black box:
I don’t see this trend reversing any time soon. The more ML there is in the algorithm, and the more non-linear it all becomes, the less effective best practices will be, and the more common it will be to see surprising effects. My colleague Dom Woodman talked about this at our recent SearchLove London conference in his talk A Year of SEO Split Testing Changed How I Thought SEO Worked:
2. User signals are going to grow in importance
The trend towards Google using more and more real and implied user satisfaction and task completion metrics means that conversion-centric tests and hypotheses are going to have an increasing impact on search performance (if you haven’t yet read this fascinating CNBC article that goes behind the scenes on the search quality process at Google, I highly recommend it). Hopefully there will be an additional opportunity in the fact that theoretically the winning tests will sync up more and more — what’s good for users will actually be what’s good for search — but the methodology I’ve outlined above is the only way I can come up with to tell for sure.
I love talking about all of this, so if you have any questions, feel free to drop into the comments.
Sign up for The Moz Top 10, a semimonthly mailer updating you on the top ten hottest pieces of SEO news, tips, and rad links uncovered by the Moz team. Think of it as your exclusive digest of stuff you don't have time to hunt down but want to read!
0 notes
Text
What Happens When SEO and CRO Conflict?
Posted by willcritchlow
Much has been written and spoken about the interplay of SEO and CRO, and there are a lot of reasons why, in theory, both ought to be working towards a shared goal. Whether it's simple pragmatism of the business benefit of increasing total number of conversions, or higher-minded pursuits such as the ideal of Google seeking to reward the best user experiences, we have many things that should bring us together.
In practice, though, it’s rarely that simple or that unified. How much effort do the practitioners of each put in to ensure that they are working towards the true shared common goal of the greatest number of conversions?
In asking around, I've found that many SEOs do worry about their changes hurting conversion rates, but few actively mitigate that risk. Interestingly, my conversations with CRO experts show that they also often worry about SEOs’ work impacting negatively on conversion rates.
Neither side weights as highly the risks that conversion-oriented changes could hurt organic search performance, but our experiences show that both are real risks.
So how should we mitigate these risks? How should we work together?
But first, some evidence
There are certainly some SEO-centric changes that have a very low risk of having a negative impact on conversion rates for visitors from other channels. If you think about changing meta information, for example, much of that is invisible to users on the page—- maybe that is pure SEO:
And then on the flip side, there are clearly CRO changes that don’t have any impact on your organic search performance. Anything you do on non-indexed pages, for example, can’t change your rankings. Think about work done within a checkout process or within a login area. Google simply isn’t seeing those changes:
But everything else has a potential impact on both, and our experience has been showing us that the theoretical risk is absolutely real. We have definitely seen SEO changes that have changed conversion rates, and have experience of major CRO-centered changes that have had dramatic impacts on search performance (but more on that later). The point is, there’s a ton of stuff in the intersection of both SEO and CRO:
So throughout this post, I’ve talked about our experiences, and work we have done that has shown various impacts in different directions, from conversion rate-centric changes that change search performance and vice versa. How are we seeing all this?
Well, testing has been a central part of conversion rate work essentially since the field began, and we've been doing a lot of work in recent years on SEO A/B testing as well. At our recent London conference, we announced that we have been building out new features in our testing platform to enable what we are calling full funnel testing which looks simultaneously at the impact of a single change on conversion rates, and on search performance:
If you’re interested in the technical details of how we do the testing, you can read more about the setup of a full funnel test here. (Thanks to my colleagues Craig Bradford and Tom Anthony for concepts and diagrams that appear throughout this post).
But what I really want to talk about today is the mixed objectives of CRO and SEO, and what happens if you fail to look closely at the impact of both together. First: some pure CRO.
An example CRO scenario: The business impact of conversion rate testing
In the example that follows, we look at the impact on an example business of a series of conversion rate tests conducted throughout a year, and see the revenue uplift we might expect as a result of rolling out winning tests, and turning off null and negative ones. We compare the revenue we might achieve with the revenue we would have expected without testing. The example is a little simplified but it serves to prove our point.
We start on a high with a winning test in our first month:
After starting on a high, our example continues through a bad strong — a null test (no confident result in either direction) followed by three losers. We turn off each of these four so none of them have an actual impact on future months’ revenue:
Let’s continue something similar out through the end of the year. Over the course of this example year, we see 3 months with winning tests, and of course we only roll out those ones that come with uplifts:
By the end of this year, even though more tests have failed than have succeeded, you have proved some serious value to this small business, and have moved monthly revenue up significantly, taking annual revenue for the year up to over £1.1m (from a £900k starting point):
Is this the full picture, though?
What happens when we add in the impact on organic search performance of these changes we are rolling out, though? Well, let’s look at the same example financials with a couple more lines showing the SEO impact. That first positive CRO test? Negative for search performance:
If you weren’t testing the SEO impact, and only focused on the conversion uplift, you’d have rolled this one out. Carrying on, we see that the next (null) conversion rate test should have been rolled out because it was a win for search performance:
Continuing on through the rest of the year, we see that the actual picture (if we make decisions of whether or not to roll out changes based on the CRO testing) looks like this when we add in all the impacts:
So you remember how we thought we had turned an expected £900k of revenue into over £1.1m? Well, it turns out we've added less than £18k in reality and the revenue chart looks like the red line:
Let’s make some more sensible decisions, considering the SEO impact
Back to the beginning of the year once more, but this time, imagine that we actually tested both the conversion rate and search performance impact and rolled out our tests when they were net winners. This time we see that while a conversion-focused team would have rolled out the first test:
We would not:
Conversely, we would have rolled out the second test because it was a net positive even though the pure CRO view had it neutral / inconclusive:
When we zoom out on that approach to the full year, we see a very different picture to either of the previous views. By rolling out only the changes that are net positive considering their impact on search and conversion rate, we avoid some significant drops in performance, and get the chance to roll out a couple of additional uplifts that would have been missed by conversion rate changes alone:
The upshot being a +45% uplift for the year, ending the year with monthly revenue up 73%, avoiding the false hope of the pure conversion-centric view, and real business impact:
Now of course these are simplified examples, and in the real world we would need to look at impacts per channel and might consider rolling out tests that appeared not to be negative rather than waiting for statistical significance as positive. I asked CRO expert Stephen Pavlovich from conversion.com for his view on this and he said:
Most of the time, we want to see if making a change will improve performance. If we change our product page layout, will the order conversion rate increase? If we show more relevant product recommendations, will the Average Order Value go up? But it's also possible that we will run an AB test not to improve performance, but instead to minimize risk. Before we launch our website redesign, will it lower the order conversion rate? Before we put our prices up, what will the impact be on sales? In either case, there may be a desire to deploy the new variation — even if the AB test wasn't significant. If the business supports the website redesign, it can still be launched even without a significant impact on orders — it may have had significant financial and emotional investment from the business, be a better fit for the brand, or get better traction with partners (even if it doesn't move the needle in on-site conversion rate). Likewise, if the price increase didn't have a positive/negative effect on sales, it can still be launched.
Most importantly, we wouldn’t just throw away a winning SEO test that reduced conversion rate or a winning conversion rate test that negatively impacted search performance. Both of these tests would have come from underlying hypotheses, and by reaching significance, would have taught us something. We would take that knowledge and take it back as input into the next test in order to try to capture the good part without the associated downside.
All of those details, though, don’t change the underlying calculus that this is an important process, and one that I believe we are going to need to do more and more.
The future for effective, accountable SEO
There are two big reasons that I believe that the kind of approach I have outlined above is going to be increasingly important for the future of effective, accountable SEO:
1. We’re going to need to do more testing generally
I talked in a recent Whiteboard Friday about the surprising results we are seeing from testing, and the increasing need to test against the Google black box:
I don’t see this trend reversing any time soon. The more ML there is in the algorithm, and the more non-linear it all becomes, the less effective best practices will be, and the more common it will be to see surprising effects. My colleague Dom Woodman talked about this at our recent SearchLove London conference in his talk A Year of SEO Split Testing Changed How I Thought SEO Worked:
2. User signals are going to grow in importance
The trend towards Google using more and more real and implied user satisfaction and task completion metrics means that conversion-centric tests and hypotheses are going to have an increasing impact on search performance (if you haven’t yet read this fascinating CNBC article that goes behind the scenes on the search quality process at Google, I highly recommend it). Hopefully there will be an additional opportunity in the fact that theoretically the winning tests will sync up more and more — what’s good for users will actually be what’s good for search — but the methodology I’ve outlined above is the only way I can come up with to tell for sure.
I love talking about all of this, so if you have any questions, feel free to drop into the comments.
Sign up for The Moz Top 10, a semimonthly mailer updating you on the top ten hottest pieces of SEO news, tips, and rad links uncovered by the Moz team. Think of it as your exclusive digest of stuff you don't have time to hunt down but want to read!
0 notes
Text
What Happens When SEO and CRO Conflict?
Posted by willcritchlow
Much has been written and spoken about the interplay of SEO and CRO, and there are a lot of reasons why, in theory, both ought to be working towards a shared goal. Whether it's simple pragmatism of the business benefit of increasing total number of conversions, or higher-minded pursuits such as the ideal of Google seeking to reward the best user experiences, we have many things that should bring us together.
In practice, though, it’s rarely that simple or that unified. How much effort do the practitioners of each put in to ensure that they are working towards the true shared common goal of the greatest number of conversions?
In asking around, I've found that many SEOs do worry about their changes hurting conversion rates, but few actively mitigate that risk. Interestingly, my conversations with CRO experts show that they also often worry about SEOs’ work impacting negatively on conversion rates.
Neither side weights as highly the risks that conversion-oriented changes could hurt organic search performance, but our experiences show that both are real risks.
So how should we mitigate these risks? How should we work together?
But first, some evidence
There are certainly some SEO-centric changes that have a very low risk of having a negative impact on conversion rates for visitors from other channels. If you think about changing meta information, for example, much of that is invisible to users on the page—- maybe that is pure SEO:
And then on the flip side, there are clearly CRO changes that don’t have any impact on your organic search performance. Anything you do on non-indexed pages, for example, can’t change your rankings. Think about work done within a checkout process or within a login area. Google simply isn’t seeing those changes:
But everything else has a potential impact on both, and our experience has been showing us that the theoretical risk is absolutely real. We have definitely seen SEO changes that have changed conversion rates, and have experience of major CRO-centered changes that have had dramatic impacts on search performance (but more on that later). The point is, there’s a ton of stuff in the intersection of both SEO and CRO:
So throughout this post, I’ve talked about our experiences, and work we have done that has shown various impacts in different directions, from conversion rate-centric changes that change search performance and vice versa. How are we seeing all this?
Well, testing has been a central part of conversion rate work essentially since the field began, and we've been doing a lot of work in recent years on SEO A/B testing as well. At our recent London conference, we announced that we have been building out new features in our testing platform to enable what we are calling full funnel testing which looks simultaneously at the impact of a single change on conversion rates, and on search performance:
If you’re interested in the technical details of how we do the testing, you can read more about the setup of a full funnel test here. (Thanks to my colleagues Craig Bradford and Tom Anthony for concepts and diagrams that appear throughout this post).
But what I really want to talk about today is the mixed objectives of CRO and SEO, and what happens if you fail to look closely at the impact of both together. First: some pure CRO.
An example CRO scenario: The business impact of conversion rate testing
In the example that follows, we look at the impact on an example business of a series of conversion rate tests conducted throughout a year, and see the revenue uplift we might expect as a result of rolling out winning tests, and turning off null and negative ones. We compare the revenue we might achieve with the revenue we would have expected without testing. The example is a little simplified but it serves to prove our point.
We start on a high with a winning test in our first month:
After starting on a high, our example continues through a bad strong — a null test (no confident result in either direction) followed by three losers. We turn off each of these four so none of them have an actual impact on future months’ revenue:
Let’s continue something similar out through the end of the year. Over the course of this example year, we see 3 months with winning tests, and of course we only roll out those ones that come with uplifts:
By the end of this year, even though more tests have failed than have succeeded, you have proved some serious value to this small business, and have moved monthly revenue up significantly, taking annual revenue for the year up to over £1.1m (from a £900k starting point):
Is this the full picture, though?
What happens when we add in the impact on organic search performance of these changes we are rolling out, though? Well, let’s look at the same example financials with a couple more lines showing the SEO impact. That first positive CRO test? Negative for search performance:
If you weren’t testing the SEO impact, and only focused on the conversion uplift, you’d have rolled this one out. Carrying on, we see that the next (null) conversion rate test should have been rolled out because it was a win for search performance:
Continuing on through the rest of the year, we see that the actual picture (if we make decisions of whether or not to roll out changes based on the CRO testing) looks like this when we add in all the impacts:
So you remember how we thought we had turned an expected £900k of revenue into over £1.1m? Well, it turns out we've added less than £18k in reality and the revenue chart looks like the red line:
Let’s make some more sensible decisions, considering the SEO impact
Back to the beginning of the year once more, but this time, imagine that we actually tested both the conversion rate and search performance impact and rolled out our tests when they were net winners. This time we see that while a conversion-focused team would have rolled out the first test:
We would not:
Conversely, we would have rolled out the second test because it was a net positive even though the pure CRO view had it neutral / inconclusive:
When we zoom out on that approach to the full year, we see a very different picture to either of the previous views. By rolling out only the changes that are net positive considering their impact on search and conversion rate, we avoid some significant drops in performance, and get the chance to roll out a couple of additional uplifts that would have been missed by conversion rate changes alone:
The upshot being a +45% uplift for the year, ending the year with monthly revenue up 73%, avoiding the false hope of the pure conversion-centric view, and real business impact:
Now of course these are simplified examples, and in the real world we would need to look at impacts per channel and might consider rolling out tests that appeared not to be negative rather than waiting for statistical significance as positive. I asked CRO expert Stephen Pavlovich from conversion.com for his view on this and he said:
Most of the time, we want to see if making a change will improve performance. If we change our product page layout, will the order conversion rate increase? If we show more relevant product recommendations, will the Average Order Value go up? But it's also possible that we will run an AB test not to improve performance, but instead to minimize risk. Before we launch our website redesign, will it lower the order conversion rate? Before we put our prices up, what will the impact be on sales? In either case, there may be a desire to deploy the new variation — even if the AB test wasn't significant. If the business supports the website redesign, it can still be launched even without a significant impact on orders — it may have had significant financial and emotional investment from the business, be a better fit for the brand, or get better traction with partners (even if it doesn't move the needle in on-site conversion rate). Likewise, if the price increase didn't have a positive/negative effect on sales, it can still be launched.
Most importantly, we wouldn’t just throw away a winning SEO test that reduced conversion rate or a winning conversion rate test that negatively impacted search performance. Both of these tests would have come from underlying hypotheses, and by reaching significance, would have taught us something. We would take that knowledge and take it back as input into the next test in order to try to capture the good part without the associated downside.
All of those details, though, don’t change the underlying calculus that this is an important process, and one that I believe we are going to need to do more and more.
The future for effective, accountable SEO
There are two big reasons that I believe that the kind of approach I have outlined above is going to be increasingly important for the future of effective, accountable SEO:
1. We’re going to need to do more testing generally
I talked in a recent Whiteboard Friday about the surprising results we are seeing from testing, and the increasing need to test against the Google black box:
I don’t see this trend reversing any time soon. The more ML there is in the algorithm, and the more non-linear it all becomes, the less effective best practices will be, and the more common it will be to see surprising effects. My colleague Dom Woodman talked about this at our recent SearchLove London conference in his talk A Year of SEO Split Testing Changed How I Thought SEO Worked:
2. User signals are going to grow in importance
The trend towards Google using more and more real and implied user satisfaction and task completion metrics means that conversion-centric tests and hypotheses are going to have an increasing impact on search performance (if you haven’t yet read this fascinating CNBC article that goes behind the scenes on the search quality process at Google, I highly recommend it). Hopefully there will be an additional opportunity in the fact that theoretically the winning tests will sync up more and more — what’s good for users will actually be what’s good for search — but the methodology I’ve outlined above is the only way I can come up with to tell for sure.
I love talking about all of this, so if you have any questions, feel free to drop into the comments.
Sign up for The Moz Top 10, a semimonthly mailer updating you on the top ten hottest pieces of SEO news, tips, and rad links uncovered by the Moz team. Think of it as your exclusive digest of stuff you don't have time to hunt down but want to read!
0 notes
Text
What Happens When SEO and CRO Conflict?
Posted by willcritchlow
Much has been written and spoken about the interplay of SEO and CRO, and there are a lot of reasons why, in theory, both ought to be working towards a shared goal. Whether it's simple pragmatism of the business benefit of increasing total number of conversions, or higher-minded pursuits such as the ideal of Google seeking to reward the best user experiences, we have many things that should bring us together.
In practice, though, it’s rarely that simple or that unified. How much effort do the practitioners of each put in to ensure that they are working towards the true shared common goal of the greatest number of conversions?
In asking around, I've found that many SEOs do worry about their changes hurting conversion rates, but few actively mitigate that risk. Interestingly, my conversations with CRO experts show that they also often worry about SEOs’ work impacting negatively on conversion rates.
Neither side weights as highly the risks that conversion-oriented changes could hurt organic search performance, but our experiences show that both are real risks.
So how should we mitigate these risks? How should we work together?
But first, some evidence
There are certainly some SEO-centric changes that have a very low risk of having a negative impact on conversion rates for visitors from other channels. If you think about changing meta information, for example, much of that is invisible to users on the page—- maybe that is pure SEO:
And then on the flip side, there are clearly CRO changes that don’t have any impact on your organic search performance. Anything you do on non-indexed pages, for example, can’t change your rankings. Think about work done within a checkout process or within a login area. Google simply isn’t seeing those changes:
But everything else has a potential impact on both, and our experience has been showing us that the theoretical risk is absolutely real. We have definitely seen SEO changes that have changed conversion rates, and have experience of major CRO-centered changes that have had dramatic impacts on search performance (but more on that later). The point is, there’s a ton of stuff in the intersection of both SEO and CRO:
So throughout this post, I’ve talked about our experiences, and work we have done that has shown various impacts in different directions, from conversion rate-centric changes that change search performance and vice versa. How are we seeing all this?
Well, testing has been a central part of conversion rate work essentially since the field began, and we've been doing a lot of work in recent years on SEO A/B testing as well. At our recent London conference, we announced that we have been building out new features in our testing platform to enable what we are calling full funnel testing which looks simultaneously at the impact of a single change on conversion rates, and on search performance:
If you’re interested in the technical details of how we do the testing, you can read more about the setup of a full funnel test here. (Thanks to my colleagues Craig Bradford and Tom Anthony for concepts and diagrams that appear throughout this post).
But what I really want to talk about today is the mixed objectives of CRO and SEO, and what happens if you fail to look closely at the impact of both together. First: some pure CRO.
An example CRO scenario: The business impact of conversion rate testing
In the example that follows, we look at the impact on an example business of a series of conversion rate tests conducted throughout a year, and see the revenue uplift we might expect as a result of rolling out winning tests, and turning off null and negative ones. We compare the revenue we might achieve with the revenue we would have expected without testing. The example is a little simplified but it serves to prove our point.
We start on a high with a winning test in our first month:
After starting on a high, our example continues through a bad strong — a null test (no confident result in either direction) followed by three losers. We turn off each of these four so none of them have an actual impact on future months’ revenue:
Let’s continue something similar out through the end of the year. Over the course of this example year, we see 3 months with winning tests, and of course we only roll out those ones that come with uplifts:
By the end of this year, even though more tests have failed than have succeeded, you have proved some serious value to this small business, and have moved monthly revenue up significantly, taking annual revenue for the year up to over £1.1m (from a £900k starting point):
Is this the full picture, though?
What happens when we add in the impact on organic search performance of these changes we are rolling out, though? Well, let’s look at the same example financials with a couple more lines showing the SEO impact. That first positive CRO test? Negative for search performance:
If you weren’t testing the SEO impact, and only focused on the conversion uplift, you’d have rolled this one out. Carrying on, we see that the next (null) conversion rate test should have been rolled out because it was a win for search performance:
Continuing on through the rest of the year, we see that the actual picture (if we make decisions of whether or not to roll out changes based on the CRO testing) looks like this when we add in all the impacts:
So you remember how we thought we had turned an expected £900k of revenue into over £1.1m? Well, it turns out we've added less than £18k in reality and the revenue chart looks like the red line:
Let’s make some more sensible decisions, considering the SEO impact
Back to the beginning of the year once more, but this time, imagine that we actually tested both the conversion rate and search performance impact and rolled out our tests when they were net winners. This time we see that while a conversion-focused team would have rolled out the first test:
We would not:
Conversely, we would have rolled out the second test because it was a net positive even though the pure CRO view had it neutral / inconclusive:
When we zoom out on that approach to the full year, we see a very different picture to either of the previous views. By rolling out only the changes that are net positive considering their impact on search and conversion rate, we avoid some significant drops in performance, and get the chance to roll out a couple of additional uplifts that would have been missed by conversion rate changes alone:
The upshot being a +45% uplift for the year, ending the year with monthly revenue up 73%, avoiding the false hope of the pure conversion-centric view, and real business impact:
Now of course these are simplified examples, and in the real world we would need to look at impacts per channel and might consider rolling out tests that appeared not to be negative rather than waiting for statistical significance as positive. I asked CRO expert Stephen Pavlovich from conversion.com for his view on this and he said:
Most of the time, we want to see if making a change will improve performance. If we change our product page layout, will the order conversion rate increase? If we show more relevant product recommendations, will the Average Order Value go up? But it's also possible that we will run an AB test not to improve performance, but instead to minimize risk. Before we launch our website redesign, will it lower the order conversion rate? Before we put our prices up, what will the impact be on sales? In either case, there may be a desire to deploy the new variation — even if the AB test wasn't significant. If the business supports the website redesign, it can still be launched even without a significant impact on orders — it may have had significant financial and emotional investment from the business, be a better fit for the brand, or get better traction with partners (even if it doesn't move the needle in on-site conversion rate). Likewise, if the price increase didn't have a positive/negative effect on sales, it can still be launched.
Most importantly, we wouldn’t just throw away a winning SEO test that reduced conversion rate or a winning conversion rate test that negatively impacted search performance. Both of these tests would have come from underlying hypotheses, and by reaching significance, would have taught us something. We would take that knowledge and take it back as input into the next test in order to try to capture the good part without the associated downside.
All of those details, though, don’t change the underlying calculus that this is an important process, and one that I believe we are going to need to do more and more.
The future for effective, accountable SEO
There are two big reasons that I believe that the kind of approach I have outlined above is going to be increasingly important for the future of effective, accountable SEO:
1. We’re going to need to do more testing generally
I talked in a recent Whiteboard Friday about the surprising results we are seeing from testing, and the increasing need to test against the Google black box:
I don’t see this trend reversing any time soon. The more ML there is in the algorithm, and the more non-linear it all becomes, the less effective best practices will be, and the more common it will be to see surprising effects. My colleague Dom Woodman talked about this at our recent SearchLove London conference in his talk A Year of SEO Split Testing Changed How I Thought SEO Worked:
2. User signals are going to grow in importance
The trend towards Google using more and more real and implied user satisfaction and task completion metrics means that conversion-centric tests and hypotheses are going to have an increasing impact on search performance (if you haven’t yet read this fascinating CNBC article that goes behind the scenes on the search quality process at Google, I highly recommend it). Hopefully there will be an additional opportunity in the fact that theoretically the winning tests will sync up more and more — what’s good for users will actually be what’s good for search — but the methodology I’ve outlined above is the only way I can come up with to tell for sure.
I love talking about all of this, so if you have any questions, feel free to drop into the comments.
Sign up for The Moz Top 10, a semimonthly mailer updating you on the top ten hottest pieces of SEO news, tips, and rad links uncovered by the Moz team. Think of it as your exclusive digest of stuff you don't have time to hunt down but want to read!
0 notes