Skip to content
Artwork for Inside DuckDuckGo
TechnologyBusiness

Inside DuckDuckGo

DuckDuckGo

Behind the scenes with the DuckDuckGo team — sharing insights on product, engineering, leadership, and AI.

insideduckduckgo.substack.com
Play
  • 26 episodes
  • Avg 17 min
  • English
Counted on this page — what you have heard stays on this device, so it is not something the list can be paged by.
  • October 7 · 13 min

    Duck Tales: The performance review process at DuckDuckGo (Ep.47)

    In this episode, Jeffrey (Operations) and Anne (People Ops) discuss how performance reviews work in a distributed leadership model, and how the process has scaled as we’ve grown. If you have feedback on Duck Tales, or episode ideas, email us at podcast@duckduckgo.com. Disclaimers: (1) The audio, video (above), and transcript (below) are only lightly edited and may contain minor inaccuracies or transcription errors. (2) This website is operated by Substack. This is their privacy policy. Jeffrey: Hello everyone, and welcome to Duck Tales, where we go behind the scenes at DuckDuckGo. We discuss the stories, technology, and the people that help build privacy tools for everyone. In each of these episodes you’ll hear from the employees about our vision, product updates, engineering, or things like approaches to AI. Anne: There’s a lot of Jeffrey: My name is Jeffrey and I’m on the internal efficiency team at DuckDuckGo. Anne: Yeah, Jeffrey: And today I’m joined with my colleague Anne. Anne, do you want to introduce yourself? Anne: Hi, I’m Anne. I’m on the People Ops team at DuckDuckGo. It’s been about five years now, which I can’t believe, but lots of exciting stuff over that time. Jeffrey: Great. Today we’re gonna be talking about our internal performance reviews and how we run them. And how would you describe our performance review process to someone who’s never heard of DuckDuckGo? Anne: Well, I think the important thing to start with is sort of describing DuckDuckGo’s distributed leadership model, because with distributed leadership, that’s going to feed into performance reviews. And so the short answer I would give with that is that there’s no one decider of performance. There’s multiple different ways, multiple different people that give input, as well as a really strict requirement that it be evidence-based. And we’ll get into this a bit later, I’m sure. But we’ve done a lot of work on the evidence-based piece and being an asynchronous organization really helps with that because mostly everything is written down. So that’s that’s the high level that I would give. Jeffrey: Who do we how do we decide what collaborators get involved with each person’s reviews? Anne: Yeah, this has been a really interesting question over the years. And I would I would just love to brag a bit about how we used to do it when it was, you know, we were a smaller organization and then talk about how we’ve evolved that because well, I think way long ago it was the organization was small enough to just kind of know. You knew who should be giving input for who. And then the organization grew to the point where we needed help figuring out, right? You can’t one person couldn’t hold it all in their head. And so you very generously helped us create an algorithm that put out a spreadsheet that basically it ingested information about people’s leadership relationships to one another, their work overlap with one another, and their experience giving feedback, among other things, calculated all of those relationships, also taking into account load. Because you know, maybe one person should review 50 people, but that’s just too many, right? So balancing those trade-offs and then making a suggestion, which was really cool. And then those suggestions obviously had to be reviewed by humans and still, you know, load adjusted and everything. And there were several rounds of human review. So that was great. And then that also came to the point where we outgrew that because even those suggestions were gonna start fraying at a point, and the human review was cumbersome. And so we’ve moved, I think quite naturally toward leaning on functional calibrators who are closer to the functional work and then pulling in the objective side of the house, which is sort of like where work is getting executed and having those be the default inputs for people. But yeah, that’s kind of how that’s changed over time. And it’s really, it’s been a really exciting problem, fun problem to be a part of. Jeffrey: For the most part it’s scaled with as the company has grown and we’ve just had to make small changes here and there. Anne: Yeah, I it’s as a people person, I also say, you know, people say how do we keep our culture as we grow? And this is similar to that where you say we don’t keep something, right? We s how do we scale something in accordance with our values as we grow? And then this I think would be a really good example of that in a really unique one too. Jeffrey: Cool. What makes evaluating performance here different from a typical company? Anne: Well, similar to what I said before, right? Distributed leadership means you have to figure out who it’s not like a managerial chain where the manager writes a performance review with peer feedback and then that gets approved by their manager and that gets approved. You know, it’s not a chain of approvals, it’s a collaborative process, which is also why that was one of the main reasons. There were several, but one of the bigger but bigger blockers for us purchasing performance review software from a company was that none of them had the functionality to have the level of collaboration that we have, like back and forth collaboration. And so there’s that. And then the real just like I said earlier, reliance on data. We are an asynchronous organization that really leverages processes in our project management tool, Asana, to fill the gaps of what a lot of live meetings would be. And I would imagine other Duck Tales have talked about no meeting Wednesdays, which is like for real. At other companies, it’s kind of in air quotes, but I would say here, not all of their companies to be clear, but oftentimes that can slip. But here it’s pretty, pretty legit. And so yeah, we’re generally meeting light, and so everything is in Asana, and you can pull that in to work summaries. And that’s also something you’ve been involved with, is really having a set of validated summary of work over the period of the year with links, right? So you can actually go and dig into the work over the course of the year as needed. And yeah, that’s the other thing I would really be I would say is is unique that the reliance on evidence and links and things you can actually see and look at and review is pretty high. Jeffrey: Right. You touched on this a little bit, but can you go into how the process has scaled as we’ve grown? Or evolved. Anne: Yeah, so yeah, that was one of the things is obviously sw figuring out how to fill those collaborative evaluator roles. Another is automation. We’ve really, you know, built our own system that integrates with where work gets done for us, which is Asana. And as a people operator, I feel blessed that I’m just given IT resources to be like, hey, you need this system to work. Here’s some really awesome skilled IT folks to help you make it a reality. And we have some really cool people on the team working to build our own performance review system that integrates exactly with where work happens for us. And so I’d say that is one that we’ve built that system and it’s evolved over time alongside other systems, right? So we have things like our daily asynchronous personal stand-up. Right. So everybody does a stand-up for themselves every day and that gets recorded. And so then that can filter back into this whole performance review process because you have a record of what you were focused on every day. You have a record of the project you were focused on every week. You we have a whole summary of the relationships of your project advisory, career advisory, everything. You know, we’ve basically been automating more of these things to be centralized in a way that’s digestible for users. And those two things have really evolved together in in a way that’s pretty cool. Jeffrey: I’m really proud of the our daily stand up we call our daily one must, but it’s been with us for a while now and it’s all asynchronous where people can fill it in in the morning and then everybody who needs to know ca… This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit insideduckduckgo.substack.com

    • Transcript
  • September 30 · 17 min

    Duck Tales: The team and process behind DuckDuckGo’s customer support (Ep.46)

    In this episode, Beah (Chief Product Officer) and John (Support) discuss our customer support process, why we read all tickets (good or bad), and how we actually use them to improve all aspects of the user experience. If you have feedback on Duck Tales, or episode ideas, email us at podcast@duckduckgo.com. Disclaimers: (1) The audio, video (above), and transcript (below) are only lightly edited and may contain minor inaccuracies or transcription errors. (2) This website is operated by Substack. This is their privacy policy. Beah: Hello, and welcome to Duck Tales, where we go behind the scenes at DuckDuckGo and discuss the stories, technology, and people that help build privacy tools for everyone. In each episode, you’ll hear from employees about our vision, product updates, engineering, or approach to AI. Today you’re gonna hear about how we do support at DuckDuckGo, and my guest is John. John, do you wanna introduce yourself briefly? John: Yeah, for sure. Yep, I’m John. I work within our marketing and communications team. And for the past few years, my main goal has been managing and improving how our support operates for the DuckDuckGo subscription and beyond. Beah: Sweet. So if you’ve used DuckDuckGo support, perhaps you’ve gotten a message from John or one of the other teammates who we’ll learn more about in this call or in this pod. So I’m Beah. If you haven’t met me, I’m on the product team at DuckDuckGo. All right, let’s jump in. I’m gonna ask John some questions and we’ll go from there. So tell me John, just to kind of set the scene, what sort of things do we provide customer support for? John: A lot. The bulk of the support that we offer is through the DuckDuckGo subscription. So for us who handle support, it means handling things like billing questions, assisting with activation across multiple devices, questions about the plans that we offer, and more technical troubleshooting related things. The subscription can be bought a few different ways, each with its own different path to activation. So a good bit of the support that we offer is helping our users navigate these paths to get more comfortable with our subscription and its features. So some of our great front-end team members built a support form where most of our tickets run through. It was built to be kind of as self-service as possible, but a category is picked and depending on what the selection is, a potential solution gets surfaced. This way, plenty of users can get an answer without really needing to submit anything or wait for us to respond to them. But basically, our help pages kind of sit behind this and there’s links to that support form on every one of our subscription help pages. It’s the first stop for most of these tickets. We’ve been piloting an AI agent on a few help pages and I’m sure we’ll get into that as well. Beah: So like if we don’t, if we can answer, if we can get people an article right then and there that answers their questions, that’s the best case scenario for everybody because they get an immediate answer, but if not, then we have a process to kind of hand it off to a human or an in-between, which is like AI assisted answers. John: Exactly. That’s right. Beah: And maybe I should say like before we had the subscription, which is the first paid product that DuckDuckGo offered, and the only one we offer, we didn’t really have a support team or support process. I mean, we had emails for different things, but like effectively we didn’t have to worry about customer support. And it was the introduction of the paid subscription that sort of like brought this problem to our doorstep and to you. Is that fair to say? Yeah, yeah. John: Yes. Absolutely. Yeah. Yeah. Perfect. Beah: Okay, cool. So tell me a little bit more about like how this all works like team-wise, who’s working on this, how have we structured that? John: Absolutely. We have a small but mighty team. So when that subscription first launched, there were a few of us that kind of rotated handling these support tickets. After a few months, we streamlined it significantly to where I was the only one who was handling things, which probably seemed like it was unfeasible and it really was. Early last year, we brought on an awesome specialist as... Beah: It, I mean it, it worked, you just didn’t sleep great. John: Yes, yeah, it worked. It worked. But there was a lot that was dependent on me and it caused a lot of lead time for some people to get responses. It was a lot to manage basically. So we brought on an awesome specialist as we continued to grow. She’s been awesome in the organization and the optimization of our entire end-to-end process. She’s got more support experience than I do by far and is a great Swiss Army knife of skill sets. So with her help, we, along with dozens of other teammates throughout the organization, we kind of overhauled the whole support structure at DuckDuckGo. And then recently, earlier this year, we brought on two more support rockstars to kind of help shoulder the ticket load to ensure that our users aren’t waiting too long before getting a real human response. So they’ve been a great addition. They’ve been working fantastically. And they’ve added an additional support layer to the mix. But yeah. Beah: Got it. And you, you, you mentioned like lots of other people. I mean, so there’s like the people who are actually writing the emails back. And then I think part of what you’re getting at, tell me if this is right, is like, you know, they are likely in many, not in all cases, but in some cases, like need to go talk to an engineer to understand what’s going on, or like a product manager or somebody else who’s been working on the product directly day in and day out and like they’re just kind of interfacing between like this huge, you know, pool of resources who know different things about DuckDuckGo. John: Yes, yeah, and that, the whole concept of working out in the open really helps make that a lot easier. So we have engineers and developers that really plug in whenever a support signal points to the need to escalate for a better response that we don’t know or we can’t handle. Beah: It has been for you. John: So that direct line to the actual builders that are behind the scenes ensures that we go straight to the source and we don’t have to wade through multiple layers of people to get an answer that’s accurate. Beah: Gotcha. Cool. So tell me, like, kind of riffing off of that, how does this fit into like our broader approach to customer feedback loops? Like we have this email support system, but we also like interface with users or get feedback from users like on social media or, you know, all these various ways, which I would say for context for listeners, like we really, we like really read that stuff and really pay attention to it. Like we’re pretty, I’d say we’re pretty obsessed in fact with understanding. Like if you’re sending us, if you’re a user and you’re sending us signals about your experience, like we are pretty hungry for that. So yeah, tell me about like the boundary, the interface boundary between like that kind of feed, those customer feedback loops and the support that you’re talking about. John: Yeah, so it’s a big circle. So essentially, the support piece to me, from what I’ve seen, I feel like I’ve been in every aspect of support, internal and external, that we offer. And this support for the subscription that we do is truly one of the most honest and raw feedback channels that we have. Most of the time, people write in when there’s a problem. Like, you’re not going to be contacting support to be like, hey, great job. Each ticket gets categorized in those categories. Beah: Though feel free to. John: Yeah, you’re more than welcome to, yes. Beah: Yeah. John: But we don’t even, we don’t handle things that are just a subscription, we handle any and all questions that come in, which I might get, we might get a deluge of tickets with me saying that. But, that said, we get a really wide r… This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit insideduckduckgo.substack.com

    • Transcript
  • September 23 · 16 min

    Duck Tales: How we use AI at DuckDuckGo while staying true to our principles (Ep.45)

    In this episode, Marc (Engineering) and Zach (Data Science) discuss how we use AI internally: our most common uses, how we use it privately, and why our principles matter more when using AI, not less. If you have feedback on Duck Tales, or episode ideas, email us at podcast@duckduckgo.com. Disclaimers: (1) The audio, video (above), and transcript (below) are only lightly edited and may contain minor inaccuracies or transcription errors. (2) This website is operated by Substack. This is their privacy policy. Marc: Hi, and welcome to Duck Tales, where we go behind the scenes at DuckDuckGo and discuss the stories, technology, and people that help build privacy tools for everyone. In each episode, you’ll hear from employees about our vision, product updates, engineering, or approach to AI. My name is Marc and I’m on the engineering team. I have with me Zach. Zach, you want to introduce yourself? Zach: hi, yeah. I’m Zach Deane-Mayer on our data science team here at DuckDuckGo. I am still a Duckling, so I’ve been here for about ten months. and I work on building our internal AI systems. Marc: Great. yeah, so today we’re gonna talk even more about AI, which is Zach’s specialty. I think today we’re gonna talk specifically about how we use Duck or sorry, how we use AI internally at DuckDuckGo. so yeah, I guess to start out, as a company, you know, we’ve adopted AI pretty pretty heavily internally as a tool to help us move faster. can you talk a little bit, Zach, about the the approach that we’ve taken here? Given that I think this you were in on the ground floor with this, right? Zach: Yeah, yeah. So DuckDuckGo as a company takes I I think a somewhat unique approach to AI as we take a unique approach to everything we do. We very much have a culture of of things like first principles thinking and and you know our own spin on things. Marc: Right. Zach: And a very important part of what we do are our privacy and security. so before we rolled out many of these tools, we spent quite a bit of time internally getting comfortable with their failure modes and the blast radius potential for for those failures. One of the first places we started using AI a lot was with coding tools. So right off the bat with Cursor and then Claude Code. And you know, one, the models are very, very good at writing code. But then two, if you are effectively using tools like git and GitHub, an agent that’s limited to writing code can only do so much damage if your code base is backed up in GitHub and you don’t let, for example, people force push to main or whatever like that. Like if your GitHub is properly configured. And so we had a lot of questions like that early on. And then, you know, once once we were confident, we really were able to kind of let open the floodgates and let people really start start using both Cursor, Claude Code and now to a lesser degree Codex to to write code and automate as much of engineering as they can. Marc: Yeah, yeah, that’s great. you mentioned privacy, right? Like that is obviously it’s a core tenet of our products. It’s also a core tenet of how we operate here. and yeah, to your point, we do tend to do things a little bit differently. so I’m curious how the privacy kind of shaped our internal workflows with respect to AI, given that, you know, w we even though we don’t collect user data, we do still have things that we obviously don’t want to to share more broadly. Zach: Yeah. Yeah, absolutely. so our privacy engineers very much think of like a an information hierarchy of stuff that is you know very I don’t know what the word is I want to use for the scale, but there’s a there’s a high to low scale. and so there’s certain information that we don’t even save to disk in our production servers. There’s certain information that is stored in memory and is never retained anywhere in our systems. Marc: Right. Zach: and that is fundamentally the safest form of data. If you don’t if you don’t store a piece of information, it’s it’s very hard to accidentally store it in the wrong place and in a way that you don’t you don’t want to do. and and that kind of principle thinking applies to AI too. Like if if an AI system doesn’t have access to certain data, it It can’t do the wrong thing with that data. and one of those ways to prevent access is just by by fundamentally not not storing the data in the first place. As you go through that hierarchy, you know, there there’s information that we’re more and more comfortable with working on internally, like for example, you know, time series traffic of you know how many users are on our various websites, like that sort of aggregated data that can’t be tied to an individual person. That’s a lot safer to start saying, hey, I’m gonna, you know, I’m on the data science team, I’m gonna do some data science work and look at, you know, whatever, whatever it is that the set of questions I have. and then I think the kind of the bottom piece that is incredibly important is we pay a lot of attention to our data processing agreements that we have with all of our vendors, but especially our AI vendors. and the contractual agreements you have with people about what they are and aren’t allowed to do with your data are are also very important. so so yeah, there’s there’s a spectrum of things and you go talk to any privacy engineer, I mean you can very quickly learn how just how deep the problem goes. Marc: Yeah, yeah, it’s interesting you mentioned principled thinking, right? Like I I think that’s something that is a core part of the culture here. And I I think it’s fair to say that we have, you know, spent a lot of time talking about how to adapt AI to our principles as opposed to adapting our principles to AI, right? which I feel like you see a lot in the industry right now. Zach: Yeah, yeah. Yeah. Yeah. And and and and that’s I mean that’s a that’s a great point. Like two of our principles that matter a lot to me personally are questioning assumptions and validating direction. Marc: Absolutely, yeah. Zach: and you know, I’m I’m like the the AI, you know, waving, you know, the flag and the the pom-poms and saying, let’s go AI internally. Marc: Right. Zach: but like I I find I have to like, you know, remind people, just because we’re using AI doesn’t mean we throw our principles out the window. Like, Marc: Absolutely. Zach: I am you know, again again as a leader here, I am more interested in like like I want to validate direction too. And so I am very interested to hear from people places where AI isn’t working. Like, like I want to see, you know, the PR that’s a 7,000 line of code wall of text where a team’s going, whoa, like we can’t we can’t review this, let alone ship it. Marc: Right. Zach: And those those kinds of failure modes, like AI is rife with them. And we don’t, you know, we don’t just look at an AI’s output and say, well, an AI made it, so let’s ship it. Like you you should use AI as as you know, a lever against, you know, with your principles, not not as a as a reason to throw your your principles out the window. But like again, like just questioning assumptions and validating direction, like you know, AIs are notoriously bad at questioning assumptions. Marc: Right. Zach: Like this will happen all the time, even with the latest models, where you’ll be like, hang on a sec. Like you said X and then you said Y, which implies not X, like, but you never connected the pieces together in in in in the chain of logic. Marc: Sure, sure. Zach: and so I I think I think your principles matter more when you’re using AI. Marc: that’s interesting. Yeah. Yeah, that I think that’s really well put. actually leads us into our next question to a degree. there’s yeah there’s a lot of hype right now, obviously with AI. I mean to put it mildly, right? the hype cycle is has been super interesting. there’s a lot of concern about AI in the workforce today, right? And we’re certainly not immune to that, although we don’t really see it that way. as a company. So maybe can you… This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit insideduckduckgo.substack.com

    • Transcript
  • September 9 · 19 min

    Duck Tales: DuckDuckGo will find and remove your personal information — like your name and email — from sites that store and sell it (Ep.44)

    In this episode, Konrad (Engineering) and Shilpa (Engineering) discuss Personal Information Removal: what is a data broker, how we remove your records without ever sending your data to our servers, and the ‘whack-a-mole’ of constantly changing data broker sites. If you have feedback on Duck Tales, or episode ideas, email us at podcast@duckduckgo.com. Learn more about the DuckDuckGo Subscription here. Disclaimers: (1) The audio, video (above), and transcript (below) are only lightly edited and may contain minor inaccuracies or transcription errors. (2) This website is operated by Substack. This is their privacy policy. Konrad: Hello everyone and welcome to Duck Tales. We will look under the hood of DuckDuckGo, talk about stories, technology, and people who are building the privacy tools that you all use. And in each of the episodes, you’ll hear from different employees about our vision, updates to our products, how we do engineering, or how we approach AI. So today I’m your host. My name is Konrad Zwinell. And I’m working at DuckDuckGo for seven years now. I work on the front end team at the very beginning. Then I run privacy engineering team. And now I’m back on the front end team working with Shilpa, who is my guest today. And Shilpa is running a personal information removal tool team. And she will tell us more about it today. Shilpa, why don’t you introduce yourself? Shilpa: Yeah, hi. I’m Shilpa. I have been in DuckDuckGo for, I think, a year and a half now. I joined in on the Apple team working on iOS and macOS. And for the last few months, I’ve been driving the team that does works on the personal information and mobile product. Konrad: Nice. OK, so first question that people may have after hearing this intro is, what exactly is personal information removal? Could you tell us, high level Shilpa, what’s the product and what it does? What’s the idea behind it? Shilpa: Yeah, so in the US, this is predominantly a US-based product. In the US, there’s entities called data brokers that basically harvest your personal information from various different sources, your online activity, social media, what have you. And they collect that information, and they basically buy and sell it as a commodity for advertisers and different entities. And our product basically goes and looks at all of these data brokers, looks for your personal information. If it’s there, then it submits a request to remove it. And if the data broker is complying, they will go ahead and remove it and we will be able to verify the removals for you as well. Konrad: Nice. So basically reducing your footprint on the web, reducing availability to your personal information, such as address, phone number in some cases, relatives, if I remember correctly. Shilpa: Yeah. Konrad: So they collect quite a bit of information about you and make it really easy for advertisers, but also other people to look it up. For FV, Shilpa: Yeah. Konrad: yeah, so that’s a bit scary. How does it work from the user perspective? Let’s say you want to use PIR. You want to try it out. How is the experience looking? Could you share with folks how it looks UI-wise and what you have to do to try it out? Shilpa: Yeah, so today, actually in some platforms, you can even go try it out for free, part of the experience on macOS or Windows, where you can go ahead and put in your personal information, some basic stuff, like your name and date of birth and city and you will be able to go see, we will go ahead and do a search on the various different data brokers that we support. And it should be able to show you all of the different brokers that have your information, the information that they do have. And the first time, if you see this actually, it’s a little bit, it’s actually quite a bit scary to see how much of your information is out there. And literally anyone can do a search and pull up a lot of your information about you, your family and stuff. So yeah, once we do the search and then we’ll go ahead and go to those, once we know that your records are there on those specific brokers, we go ahead and submit requests to opt you out. Konrad: Thank Shilpa: And then there may or may not be some steps in between all of which we will take care of for you. And then usually there’s a delay from a couple of days to a few weeks maybe. Then if the record is removed, we will go ahead and do a scan again and make sure that your record is removed. And then we’ll report to you that that record’s been flagged as removed. And not just that, we also do periodic scans to make sure we do like maintenance scans to make sure that your record is removed and it continues to be removed. Because the way that data brokers work is once they remove it, they’re not very intentional or deliberate about these records. They’re just collecting and gathering from whatever sources they’re getting. So if it’s removed, doesn’t mean it stays removed. Sometimes it goes, sometimes it comes, sometimes it’s merged from other sources. So it’s important to continue to keep, keep removing it. Konrad: Yeah. And we keep on adding new brokers, right? Meaning, you keep the PIR running, we will add new brokers and we will opt you out out of those brokers. So it’s not only like insurance that your records don’t pop up on the same brokers, but as we find new brokers starting business and appearing on the web, we will try to opt you out from those too, right? Shilpa: Yeah, yeah. It’s the whole world of data brokers is very fluid. There’s new ones coming up. There’s mergers happening. There’s some of them are going defunct. Some of them are temporarily defunct. They come back. So we’re all constantly keeping an eye out for how things are changing, fixing it and adjusting for the changes they’re making, as well as constantly looking out for new ones that are coming up, seeing how we can support removals on those sites. Konrad: That’s right. And I guess that’s our biggest challenge, right? Like fighting with this ever-changing websites and brokers kind of even fighting back on purpose, trying to kind of avoid our product, like make it not work. Would you say it’s the main challenge? Do we have like some other challenges? Shilpa: I would say that is pretty much the main challenge. They are deliberately or not constantly changing things on their side. And since they don’t have a very clean, clear request that we can make to them, just to say, here’s my record, go remove it. But it involves usually going through and scraping the website. It’s not a very clean process, which means that we have any minor changes on their end leads to us breaking things on our side. So we have to constantly keep an eye out and monitor, make changes, fix. So this constant whack-a-mole, I think, is one of the biggest challenges. It’s also a good engineering challenge. So we are always thinking of various different ways to innovate and try to be as flexible as possible and see how we can actually get ahead of them. That actually is like the main engineering challenge related to this product for us. Konrad: Yeah, we both like a challenge. That’s why we are on this team, right? OK, let’s see. So we are both engineers. Shilpa: Absolutely. Konrad: So maybe let’s do some shop talk and talk how this work under the hood. So yeah, can you tell us a bit about that? Shilpa: Yeah, so doing a little bit of engineering talk, normally you would imagine that, you know, like we take the personal information from the users and then we go and make a nice clean API call directly to data brokers and they give us a response and we can say either success or failure. But that is actually not the case. Data brokers do not make our lives easy. What we actually have to do is basically what you would do if you were to manually go ahead and remove it. You would go to their website, type in your information, do a search, see if the record is found, and then go to another form. Again, type in an opt out request, and in between there may be various differen… This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit insideduckduckgo.substack.com

    • Transcript
  • September 2 · 19 min

    Duck Tales: The 3Ds of DuckDuckGo. Delight, discovery, and dependability (Ep.43)

    In this episode, Gabriel (Founder) and Beah (Chief Product Officer) discuss our focus on delight, discovery, and dependability (the 3Ds), what they are, and how they shape our day-to-day work. If you have feedback on Duck Tales, or episode ideas, email us at podcast@duckduckgo.com. Show notes: Listen to our episode on Hack Days here. Disclaimers: (1) The audio, video (above), and transcript (below) are unedited and may contain minor inaccuracies or transcription errors. (2) This website is operated by Substack. This is their privacy policy. Beah: Hello and welcome to Duck Tales, where we go behind the scenes at DuckDuckGo and discuss the stories, technology, and people that help build privacy tools for everyone. In this episode, we are going to be talking about what we internally call the 3Ds: discoverability, dependability, and delight. And if we If you haven’t met me, I’m Beah. I’m on the product team and I’m here today with Gabriel, founder and CEO of DuckDuckGo. Anything anything you want to add to your introduction, Gabriel? Gabriel: No, I do not. If you’ve watched this at all, you’ve already seen me a bunch. So and they’ve seen you as well, so Beah: Yes. Cool. Okay. So yeah, let’s just jump in. 3Ds. What what’s the deal? What I mean, I said what each D stood for, but like contextualize this whole thing. Gabriel: Yeah, so part of the way we run DuckDuckGo as a company, just like internally, like how we operate, is we have a what we call our top priority, which is like the main thing that we think we need to focus on as a company. And that’s changed every few years. But like right now we’re in the middle of and we’ve been doing it for I think around 18 months, something like that, this 3Ds focus on discovery, dependability, and delight as you pointed out. And those are product things. So it’s really a focus on making our product better in those kind of three areas. And just to walk through them briefly, discovery is we actually have a lot of stuff in our product that people do not know about. So there’s the basic thing that a lot of people still don’t even know DuckDuckGo exists and we have a product and we’re a privacy company. But when you get a little beyond that, you know, we’re a search engine, we’re a browser, we have a subscription now. In our browser, you can sync your passwords and bookmarks. There’s all sorts of features, and like the holistic product is a lot bigger than even most of our users realize. And so it’s kind of discovery of those features. Dependability is a little more straightforward. That’s like, okay, you’re a user, the product should be very dependable. But I mean that means like reliable. You can switch to it easily. All the workflows work well. There’s no rough edges in it. Obviously, that’s a tall order when you run a search engine and a browser and a VPN and all these other things we do. But we’ve been nail we’ve been working down the list of all the little issues that people you know complain about, rightly so, that might have been issues with their bugs in our product and we’re trying to fix them. And then the third one is delight, which is, you know. I think most intuitive, I guess, but even harder to actually articulate how we get there. Beah: Yeah. Gabriel: But it’s like you have a delightful product experience. It’s those products and experiences that you are unexpected, really bring you joy, like you really want to share with your friends and family. Like we want to bring that delight into using DuckDuckGo. Beah: Yeah. Gabriel: So the focus has been on all three of those, because we think we need to do all three to make a great product. And so we have projects and people working on, you know, basically all three at all at all times at the moment under our top priority. Beah: Yeah, just to add to the discovery point, I mean we get feature requests and feedback. Feature requests for features we have. Like people just straight up asking for features that exist. Yeah. Private browsing. Yeah. Yeah. Gabriel: Yes. I would argue that might be our top request. Things like, yeah. Yeah. This is a core discovery issue. Yeah, and even more fundamental than that is like a lot of a lot of search engine users, because that was our first product, and we have the most search engine users, don’t even know we have a browser. And our most browser users on mobile don’t realize we have a desktop browser. Beah: Yeah. Gabriel: So regardless of features within all those things, like just at the very basic level, people don’t even know we offer a browser. And they should. Yeah. Beah: Yeah. And like sometimes it’s as simple as like changing like making something more visible and then other times I think it’s about the language we use or like the way we characterize something so that people know that it’s what they’re looking for. So yeah, there’s like that one’s yeah. Gabriel: Yeah, one more point on that too. Like that one’s subtly hard as well, because like you don’t discovery means that you have to get people to know about it to your point. And you maybe think of something, which is that you have to get in front of people then with a message, but that can be annoying. Like it look can look like an ad, right? Beah: Mm. Gabriel: And so that’s a delicate balance. It’s like, yeah, you’re a cer you’re a private search user, you probably want our private browser because it’ll actually make the benefit of privacy much more you know, better in your life if you have them paired together. However, you don’t want a thousand messages of, hey, we have a browser downloaded now. So there’s there’s like this delicate balance of like trying to get awareness to get the people who will who want it who want it to get it without annoying people who don’t want it. Beah: Mm. Totally. Yeah. And there’s just like it’s the competition of many things. Like you probably want our browser. When in our browser, you probably want your passwords and your bookmarks. And then you probably want those synced across devices. And you probably want this thing that’s opt in turned on. And like, yeah, you can just we have to I think we spend a lot of time trying to make sure that we’re not like bombarding people with too much messaging or promos and it’s but then but then again we get feedback requests for things that are sitting there somewhere behind the scenes. So yeah. Gabriel: So just before we move on to that one practically, then what that means is we’re constantly running experiments basically of like how best to do these in product kind of promos. And and and I think to your point, like it’s better to do them. The naive approach is to shove them all in onboarding, which people then whiz by. But the better approach is like very contextual, like maybe like when you do a bookmark for the first time, ask people if they want to sync. And then the other part of discovery, just to end that part, is is just our external marketing. So like not in talking a lot of in-product stuff, but we also spend a lot of time just doing general marketing, especially in the US, about educating people about our different experiences. Beah: Yeah. Yep. So we ended up talking a lot about discovery, but just another like zooming out question. How how did we land on these besides the fact that they all share a D, why did we pick why did we pick these three things? Gabriel: That’s that’s clearly part of it. Yeah. Yeah. Yeah, I mean if you think about the whole product kind of marketing funnel, which is you need awareness in a product, then you need to know a little bit more about its benefits and value proposition to consider using it. They call that consideration. Then if you kind of are interested in that, like in our case, like privacy benefits, you may trial and then that initial trial point on like is kind of an activation in the funnel. And then you want to retain users and then ultimately a referral. You want users to be happy enough that they’re referring you. So that’s the traditional like marketing funne… This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit insideduckduckgo.substack.com

    • Transcript
  • August 26 · 30 min

    Duck Tales: 32% of AI users tell AI things they've kept from other people. Our new study on AI's privacy problem (Ep.42)

    In this episode, Zac (SVP, User Insights) and Mario (Marketing) discuss our study on the AI privacy problem: from stats and surprises, to AI hot takes, and how DuckDuckGo can help. Show notes: Learn more about the study and our findings here If you have feedback on Duck Tales, or episode ideas, email us at podcast@duckduckgo.com. Disclaimers: (1) The audio, video (above), and transcript (below) are unedited and may contain minor inaccuracies or transcription errors. (2) This website is operated by Substack. This is their privacy policy. Mario: Okay, there we go. Hey everyone. Welcome to Duck Tales, where we go behind the scenes at DuckDuckGo and discuss the stories, the technology, and the people that help build the privacy tools for everyone. In each episode, you will hear from employees about our vision, product updates, engineering, marketing, but also our approach to AI. Today you’re going to hear about some brand new research, very fresh, that we ran about what Americans actually think about privacy and AI. And I’m here today with someone who happens to have the exact same haircut as me. And that means luscious locks, of course. Zac, do you want to introduce yourself? Zac: Yeah, hey everybody, I’m Zac Pappas, SVP of User Insights. I’ve been at DuckDuckGo for 14 wonderful years, and I’ll be talking to you about this study today. Mario: Wow, fourteen years. Yeah, we’re we’re very lucky to to have you here. you’ve been, you know, working in Insights for a long time. You’re one of the first, very first DuckDuckGo employees, is this correct? Yeah. Zac: Yeah, I think it was technically the second employee back when we were just a few people around the Paoli office here in Pennsylvania. So it’s yeah, it’s been a long fourteen years. but I think it’s been really exciting and things changed so so frequently that it doesn’t really feel like we’re doing the, you know, same insights or kind of same research over and over again. Mario: Yeah. Well that’s that that’s pretty good. But it’s also useful because it means you also have about as long as a view as anyone on how people feel and think about privacy, you know, what they want protected, what they say versus what they do. So I think this is gonna be an interesting conversation. And yeah, by the way, you’ve introduced yourself. I’ve been talking, I have been rude, I haven’t introduced myself. My name is Mario, I’m in the on the marketing team. I’ve been here for almost four years now. a fun fact about myself is that I like to tell people I once came in fourth in the Eurovision Song Contest. For those who don’t know, it’s like it’s big music kind of song festival and competition in Europe. So yeah, I like to say I once came in fourth, but kind of. So not exactly. And I’ll just leave it at that. what about you, Zac? Do you have any fun facts you want to share? Or obnoxious facts? Also loud. Zac: nothing that interesting or stand out. I guess y like most people, when I have the time I will go out to my garage, fire up the forge, and do a bit of blacksmithing. so pretty standard stuff. Mario: Wow, okay, that’s that’s quite cool. I mean, this is this is Duck Tales, not Zac Tales. If it was Zac Tales, I would ask you a lot more questions, maybe put in a request. So Zac: Next episode, yeah. Mario: yeah, next time. Okay, let’s let’s jump in. So we as a company and you particularly, since you’ve been here for so long, we’ve been studying how people think about privacy for close to, I know, in this case like 15 years or more. You know, what’s what’s new is doing that specifically for AI. in June, our user insights team surveyed 1944 US adults, all quota balanced to census on age, gender, region, et cetera, about their AI privacy concerns, what they know, what they don’t know, what they actually do about it. you’ll find the methodology on the show notes if you’re interested. And this is this is what we want to talk about today. So, Zac, let’s let’s start with the juicy stuff. To you, what was the most surprising thing in this study? Zac: I think given the fact that AI has been so pervasive and around for so long, most surprising thing was that I think forty-three percent of everyone knew none of six basic facts about how how AI chats are handled. So that includes a third of active AI users who can’t, you know, recall or kind of signal what basic data privacy and data handling practices that the AI services that they’re using are actually adherent to. Mario: Well— well, can you tell us a little more like what facts you’re talking about? Zac: Yeah, I actually wrote them down so I can get them correct for you. So the facts we asked people about were AI chats can be subpoenaed by courts and law enforcement. AI chats can be made public in a lawsuit. Employers can access work or enterprise AI accounts. Settings to delete or stop storage vary by provider. Free accounts often have weaker privacy than paid accounts, and humans can review your chats. Some of these maybe you would expect most people who haven’t dug too far into AI or privacy policies, they maybe wouldn’t think of those things first, but certainly human employees. Employees can review your chats. We’ve seen instances of this in the past with other companies in data collection when there’s a breach or when there’s a mishandling of data. Those are some pretty basic things that I would have assumed people at least had some suspicions about, but it’s surprising that they didn’t. Mario: Yeah, this is this is a little yeah, it was a little unexpected the the level of of at least to me, you know, listening to this. I I was looking like looking a little bit here at the at the details. Like I saw, for example, on the that the AI chats can be subpoenaed by the government, for example, which means they could then made accessible in public because there were a lot of news about this, about some cases about AI companies. It was about only twenty five percent of people knew this. So why do you think people don’t know these facts given it has been you know, so much on the news. I know this isn’t in the study, but just curious about what you would you Zac: Yeah, I I mean i it it’s definitely a different technology. I think it’s been a lot more opaque, the way that it’s been integrated and with the speed that it’s been rolled out, and the kind of the breadth that it’s been rolled out to most products that people are using. I think they get a different flavor and a different version of AI everywhere that they look with, you know, incomplete data practices, meaning they haven’t, you know, execute at the executive level, most companies haven’t really figured out how to deploy AI safely. So what they’re getting is say a rushed experience, but something that probably wasn’t built in the best interests of data privacy or kind of long-term sustainability in that regard. so here, yeah, it’s a it’s a maybe a combination of it being kind of a pervasive, like broad applic broad applied technology as well as how fast it has risen. and maybe my own personal experiences, there isn’t that that much useful information for a mainstream person, maybe who’s not a developer or a coder who’s you know gonna be really in the weeds of the technology. It’s kind of hard to find some of the better, you know, more mainstream or general approaches than how to use it safely. Mario: Yeah, yeah, I can s I can see that. Thanks for that. So yeah, we know what’s the most surprising thing about the study for you, but like asking the bigger question, like, are people worried about privacy in AI in the AI context? Zac: Yeah, absolutely. Seventy-five percent of people are worried about privacy when using AI. And that has been consistent for years as we’ve been running these studies. And we’ve seen this with external research as well. invasion of privacy, just the discomfort and uneasiness of using it and not knowing how the data’s being handled, and surveillance are usually around like 50% of what worries people the most when it co… This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit insideduckduckgo.substack.com

    • Transcript
  • August 5 · 22 min

    Duck Tales: The DuckDuckGo Subscription Pro-tier — private AI for AI power users (Ep.41)

    In this episode, Beah (Chief Product Officer) and Chris (Partnerships) discuss the DuckDuckGo Subscription: the core protections, private AI, and how the new Pro-tier serves AI power users. If you have feedback on Duck Tales, or episode ideas, email us at podcast@duckduckgo.com. Disclaimers: (1) The audio, video (above), and transcript (below) are unedited and may contain minor inaccuracies or transcription errors. (2) This website is operated by Substack. This is their privacy policy. Beah: Hello and welcome to Duck Tales, where we go behind the scenes at DuckDuckGo to discuss the stories, technology, and people that help build privacy tools for everyone. In this episode, you are going to hear about our Pro subscription plan. And my guest today is Chris Calvi. Chris, do you wanna briefly introduce yourself before we jump in? Chris: I— I would love to. Thank you for having me back. I was on— a quick ad for people who have not listened to the original subscription overview Duck Tales episode. Gabriel and I did that six months— I don’t know, actually probably nine months ago at this point. So go find that. But I’m coming to you from sunny New Jersey. And I’m a member of the partnerships team here at DuckDuckGo. And I’ve been at DuckDuckGo for about five years. I love it here. And most recently helped run efforts to add this new Pro plan to the subscription, which we’ll be talking about on this episode. Beah: Nice. I’d like to think of this episode as the Pro edition of the previous podcast episode that you recorded with Gabriel. Chris: Okay, that’s fair enough. Beah: Just to set the bar. Chris: Yeah. Beah: All right, and I’m Beah, I’m on the product team, if this is your first time meeting me. And yeah, I think we can kind of jump in. Like, let’s start with— can you just explain, Chris, what even is the subscription, what we’re talking about? Chris: Yeah, and I always like to start with, like, why the subscription first, and then I’ll say what the subscription is. So the why: you know, DuckDuckGo has a ton of fully featured, excellent, free-to-use, no-login-required functionality. And we’ve had that for, like, what, fifth— 17 years? How— how long has DuckDuckGo been on? We’ve had it for a very long time. And— and so we, though, realize that there are— there’s extra functionality and features and protections that we would like to offer to— to our users, that you can’t offer— either can offer free, for free, because they have a material c—, like, a substantial cost to us, or it can’t be, like, ad-supported like the search. So— so two years, a little over two years ago, we launched the DuckDuckGo subscription. And— and that includes four protections— that are aligned with what I just mentioned, things that we sort of, like, can offer for free. And so there’s the identity theft restoration, which internally we call IDTR. And that is essentially, if you— Beah: Not me. I call it identity theft restoration because I try to avoid— Chris: You— you don’t like to use acronyms. Beah: I’m anti-acronym, yes. Chris: As a culture, we typically are. Though I like to break the rules. I break the rules. Beah: I continue. Chris: So in the event that your identity is ever— is ever compromised, your n—, your identity stolen and is used, for instance, to open up another credit card— for— that’s not— that you didn’t open, we have a phone number that you can dial into. Actually, let me share my screen and I can show you what I’m talking about. Beah: You can do a live demo of calling a phone number and see what happens. Just don’t do that. Chris: That would be risky. No, I’m just kidding. It would be good, but it would also be boring. So let me know— does this work? Do you see? Beah: I see. Chris: All right, so to get here— after— this is kind of like jumping ahead, but let’s say you have a subscription to DuckDuckGo already, you would log in, you’d— you’d come to your— if you have the app installed, you’d come in and you would select DuckDuckGo subscription. And in subscription settings, if you didn’t already have this device connected to your subscription, you would have to do that as a first step. But once it’s connected, then you have it and you can just come in here and go to the element of the subscription that you want. So let me walk you through those pieces of the subscription. The first one I was mentioning was identity theft restoration. And so what you would do is— in this example I mentioned where somebody opened a credit card in your name, and you’d want to re—, you wanna deal with that, you’d come in here and you would call our— this has some information for you about how it’s gonna go. You will click “talk to an advisor” and then you would make a simple phone call and they would help you make things right with your— your credit card companies, your banks, your credit bureaus, things like that. So that’s identity theft restoration. The— the subscription, as I mentioned, has four key pieces of functionality— we call it four protections in one. The second one is personal information removal. So this would also be available from your— your settings screen. You’d click on here and you’d click “open personal information removal.” And similar to the identity theft restoration, this would bring you to a page where it shows you what— what it’s going to do, what it is and how it’s going to help you and how you get started. And what personal information removal is: in the US, we have this insidious issue where data brokers essentially aggregate personal information about you, about everyone in the country, and they put it on the internet or they— they’ll sell it. Sorry, they’ll put part of it on— on the public web and then sell part of it. And this includes things like your name, your address, your phone number, your date of birth. And even relatives, like— that, like, lived in the household with you. I’m sure you’ve probably seen this if you’ve ever searched for yourself. And so with personal information removal, we go through and we opt you out of the listings on over 60 of those sites. And we’re adding more all the time. And so you would just come in here, you’d click “get started,” and this would ask you a few things, a few pieces of information which stays on your device and does not go to our servers. That’s important to mention here. And then goes through a process that’s run locally from your machine and takes some time. It takes, like, anywhere from a few hours to a few weeks or longer to get you fully removed from all of these sites. So some of the sites can act quicker than others, but this will go through and— and opt you out from being listed on those data broker websites. The— the— and interrupt me with any questions you have about this, any of these functionality, but we went through— Beah: No, this is good, this good. Chris: We went through the identity theft restoration, the second one being personal information removal, and then the third one is the VPN. And the VPN is— stands for, since we don’t like acronyms, virtual private network. And what it— yeah. Beah: I guess I do allow VPN. I’m gonna allow it. Chris: I mean, but— what it— what a VPN is, is it— is it, we set up a— anonymous secure server, and we have them in 30, or over 30, countries around the world. So wherever you’re at, you can connect to the closest one. And— and what it will do is securely— it encrypts your traffic and securely and privately tunnels it through these anonymous servers and then out to the resource that you’re requesting on the other end on the internet. So, like, all of your internet traffic is basically being tunneled through this— this private secure server and then out the other end. And so this— why— what, like, what this does is it protects you in— in— in two— two, like, key ways. One is your ISP, the internet service provider that you’re connected to, won’t be able to see the sites that you are accessing, like what sites you’re visiting. And that helps you because they’re not then able to—… This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit insideduckduckgo.substack.com

    • Transcript
  • July 29 · 24 min

    Duck Tales: How we're making it easier to use Duck.ai, our private AI chat. (Ep.40)

    In this episode, Beah (Chief Product Officer) and Mihai (Design) discuss how the Duck.ai team prioritizes what to build, how we use research and user feedback, and a demo of recent UX updates. If you have feedback on Duck Tales, or episode ideas, email us at podcast@duckduckgo.com. Disclaimers: (1) The audio, video (above), and transcript (below) are unedited and may contain minor inaccuracies or transcription errors. (2) This website is operated by Substack. This is their privacy policy. Beah: Hello, and welcome to Duck Tales, where we go behind the scenes at DuckDuckGo and discuss the stories, technology, and people that help build privacy tools for everyone. In each episode, you’ll hear from employees about our vision, product updates, engineering approach. And in this particular episode, you’re going to hear from Mihai, who is here to talk about the various UX improvements that we’ve made to Duck.ai recently. Mihai is on the design team. And do you want to just give your give a quick introduction of yourself, Mihai? Mihai: Sure, thank thanks for having me. My name is Mihai. Originally from Moldova, lived across the world in many places, now based in Switzerland, joined DuckDuckGo maybe around three years ago, and I’ve been on the Duck.ai team almost from the very beginning, so I’ve seen the product evolve since then dramatically. So so yeah, we’ll talk about it today. Beah: Nice. Well thanks for joining. For anyone who hasn’t met me, I’m Beah. I’m on the product team here. I’ve been around for a while. So yeah, I’m gonna go ahead and ask Mihai some questions about his work on Duck.ai and we’ll just dive on in. So I think I said we’re talking about improving Duck.ai UX, and I’m not sure I said that if you’re not familiar, UX is just a fancy abbreviation for user experience, even though we all know experience doesn’t start with an X. So this means like, you know, making the features that we have and the functionality that we have more usable, tweaking the functionality to better like suit people’s needs and desires, and just make the product more delightful and easier to use. You feel free to amend that definition. But just to kind of like set Mihai: Feel free to amend definition. Beah: the set the tone a little bit, Mihai, tell me a little bit about like how we even decide to work on something. Like how do we prioritize UX user experience changes in Duck.ai land? Mihai: Yeah, as designers, we’re basically I I tend to think of myself as the diplomats that we we try to talk to as many people to get our work done. But we use various signals to inform these decisions. Some of some of them are more perfect, some of them are imperfect. There’s no There’s no reality where we’re working with perfect information. So sometimes we form assumptions, sometimes we rely on research. User feedback, internal feedback. Sometimes we have strategic bets that we place as an organization. We have dashboards with metrics. We have just no we know the competitive gaps that we have, and sometimes we just rely on instinct. So we Beah: That’s good. Mihai: we bundle all of these together in our decision-making process. Some of these signals they surface a problem, Beah: Yeah. Mihai: others validate the direction and it’s on us to use our own human judgment to determine the right trade-off for for these things. And in the end it narrows down to to looking at where the biggest overlap is with the user problems that we have and where we’re taking the product. Beah: Yeah, or do all the hand and just then follow it. Mihai: Yeah, maybe this is more kind of like general response, but no one decision was the same. Beah: Yeah, right once. Yeah, yeah. Mihai: So it’s it’s it’s all based on experienced people in the room making the the calls based on the information that we have. Beah: Yeah, I mean one thing that I’m guessing people I I bet a lot of people would underestimate the degree to which we’re obsessed with user feedback. Like you can’t completely rely on user feedback to tell you how to build a product because, you know, hopefully the people building the product have additional insights about what’s possible and what good looks like that users can’t articulate or shouldn’t take the time to articulate. It’s not on them. But that aside, like we obsess pretty hard on feedback. Like we read an insane amount of feedback. We have systems for categorizing it and making sense of it. I mean, I’ve been caught up in like long discussions where we are really deeply trying to interpret a comment somebody made on Reddit or in the app store and like try to figure out the best way to address it. And so I’m just pointing that out because I think that might not be obvious. Like I think there’s probably a lot of, you know, for a tech company that serves millions and millions of users, I’m not sure that’s I’m guessing that’s not the norm. So that is a big part of it. But then like beyond that, you know, there’s a bunch of other signals we use, like Mihai said, and I know in Duck.ai on that team, like you guys have a rubric, right, that you’re using to actually like evaluate in a structured way a bunch of project ideas and feedback is one of the inputs to that rubric, but there are others as well. So also very maybe distinctive of DuckDuckGo is I think it’s a hyper structured and rational decision making process. Would you agree with that, Mihai? Mihai: Yeah. It’s it’s quite unique and I think the the great thing is that a bunch of us, everyone here, they’re scoping their own projects, they have their own ideas, they uncover different things that they’re pitching in and that goes into that rubric. And at certain times we those categories of how how we score the rubric, they’re weighted. So sometimes certain elements are more important than the others. And that help us kind of look at what what’s important to us right now and what we’re getting from the users and all the projects that are strong candidates for us to tackle tackle in the next roadmap, for example. Beah: Cool. Yeah, so let’s talk about something that did bubble to the top recently. Like, can you give me an example of an a UX improvement that you’ve worked on? Mihai: Yes, so the first example is dictation. I’ll share my screen real quick. Cool, so this is our interface here. So users keep asking for dictation features, so it’s this microphone in the input field. There’s certain people that for them is they would use the input field. They’ll rather talk than type. It’s either a prompt is really long, or you they just want to do it hands free. And shipping this was actually great because it it got us in line with the competitors as well. But internally we we were kind of i it it was the group was split in terms of like if we wanna do it until that user feedback kept coming back, kept coming back. And we decided to to pull the trigger. For from the UX standpoint, what was exciting for me personally is voice interfaces, they have a big affordance problem. That it’s really hard sometimes to know what’s the system status for that and to avoid the jargon is basically you need to know what the what the app is doing at any point in time. And that was an interesting challenge on top of just delivering the feature. And if I if I trigger it, we we do three things here. We label things clearly for people to know what’s going on. You also get a visual cue, this waveform that provides feedback, and as you see me pause, that waveform reacts to my voice, but also the input field has changed its its shape not the height or anything but what’s inside it now is geared toward towards a different input which is not text and we’ve added this nice glow animation to it which is which is really cool so and then it’s trust transcribing and giving back the the text. Another one should should I should I give a few more? Alright. Beah: Nice. Beah: Yeah, yeah. Give me another example, please. That’s good. Mihai: Alright. Another one is batch deletion, which is another feature that was … This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit insideduckduckgo.substack.com

    • Transcript
  • July 22 · 17 min

    Duck Tales: How we use mental models and operational defaults to improve decision making (Ep.39)

    In this episode, Beah (Chief Product Officer) and Marc (VP, Engineering) discuss how we create, communicate, and challenge operational defaults to make better decisions at speed. If you have feedback on Duck Tales, or episode ideas, email us at podcast@duckduckgo.com. Disclaimers: (1) The audio, video (above), and transcript (below) are unedited and may contain minor inaccuracies or transcription errors. (2) This website is operated by Substack. This is their privacy policy. Beah: Hello and welcome to Duck Tales, where we go behind the scenes at DuckDuckGo and discuss the stories, the technology, and the people who help build privacy tools for everyone. In each episode, you’ll hear from employees about our vision, product updates, engineering, or approach to AI. Today, you are going to hear about how we work, I guess, or one facet of how we work, which is using operational defaults and I have with me Marc, who is going to who I’m going to interview about operational defaults. Marc, do you wanna introduce yourself? Marc: Yeah. Marc, I’m on the engineering team at DuckDuckGo. Beah: Okay. That’s about all you need to know. and I’m Beah, I’m on the product team if if you haven’t seen me before. okay, cool. Well let’s jump in. What even is an operational default? Marc: Yeah. Yeah, so defaults are I would say a deceptively simple concept. at at DuckDuckGo we’re always trying to leverage mental models to help us move more quickly and think more clearly and and things of that nature. in that context, the default effect is seen as a negative, right? And and I think we’ve all seen that in apps and in different places. Here we’re trying to leverage the the upside of that, where we’re basically taking any decision that you can make ahead of time that generally is true or has a right answer eighty percent of the time, we’re gonna call that a default. for that other twenty percent, we wanna leave room for our folks to be able to make exceptions, ideally very thoughtful exceptions. Beah: When you say default is a negative in the app, you mean like, you know, if you get an Android phone and the default browser is Chrome and the default search engine is Google and it’s really hard for another player like DuckDuckGo to to break through th those defaults. Is that right? Yeah. Okay. Marc: yeah, exactly. There’s there’s in Gabe’s book of mental models there’s the default effect and again it’s generally negative, but like I said, in this case we’re trying to use defaults as as something that we can leverage to help us go quicker. Beah: Yeah, yeah. So how is that how is it different than a rule? Marc: I mean it’s conceptually the same thing. I think rules are just more binary, right? Like this is something you do or you don’t do pretty much all the time. Where here we’re saying that these are things that are generally true. Like I said, eighty percent of the time is just the number that we made up. and that allows people to potentially make faster decisions. but we also want to include encourage people to think about what they’re doing and not just go on autopilot. And I think that’s the danger of catching something as a rule is that yeah, people will just kind of blindly follow it by default. Beah: Yeah, yeah. I think that distinction is super important. Like, first of all, there are a lot of things where rules just have exceptions and therefore they’re not really good rules, you know? like you have to be pretty sure that there has to be a really good reason to make something a rule because it’s going to fit different situations differently. And yeah, it’s like once it becomes a rule, people like lose power to do anything differently, so they don’t think about it, they don’t feel empowered, and like with a default, there’s still a burden of judgment because you can overturn the default and choose a different path. but the idea, I think, would you care would you say this is a fair characterization is like A, don’t spend brain power thinking about like reinventing the wheel or thinking about something that doesn’t really warrant brain power, like there’s a good default, and B you know just to n to nudge people in the direction of the best average answer, you know. Marc: Yeah, right. It’s leveraging decisions that we’ve deliberated over in the past and you know have come to a good decision on. and exactly what you said. We don’t want folks reinventing the wheel. That said, we do want I mean, we hire really smart people at DuckDuckGo and we wanna, you know, leverage and celebrate that. So yeah, everybody’s encouraged to challenge the norm, so to speak, or you know, pre existing defaults. And in fact that’s a big big part of this. whole concept is coming back and challenging these at times. But yeah, th they’re, you know, i in a lot of cases it’s it would just be wasted effort to be rethinking this from scratch. And as much as there are some that are that are rule or that you know might make better rules because they are more binary, there are others that really don’t make great defaults either. we had a decent example where it was like, yeah, there is something that was true, say fifty percent of the time. I don’t remember what the actual number was, but it just didn’t make a great default. I honestly don’t remember what it is, but yeah, d just to say that not everything c falls into that framework framework. Beah: Yeah, that that’s a good segue. Yeah. T t give me some examples of things that we do think are good operational defaults or that we treat as such. Marc: Sure, yeah. I mean we have a bunch I you know, one of the things that’s so powerful about this is that I think we all do this all the time. so for example at DuckDuckGo we try to prioritize quick wins, which I guess the other thing I should say about defaults is that they are somewhat self evident, like to the point where that’s why I said they’re kind of deceptively simple because there are things that you don’t necessarily feel like you should have to put a lot of time into, a a lot of thought into. But quick wins are one where, you know, we at the company we’ve been, you know, trying to push people toward that. Right. Like the idea of a quick win is something that is relatively low effort but has high impact. And I mean you would saying it out loud, you would say, of course that’s something we should prioritize. But I think it’s also important to acknowledge that people don’t think that way. instinctually in a lot of cases. They wanna sometimes they want to work on, you know, the hardest thing or what they see as the most impact when, yeah, maybe less would do. so that’s one. one of my favorite ones, and I think a lot of people at this company would agree is we do no meetings on Wednesdays. so that’s a very simple one that, yeah, you we we don’t I I I w wouldn’t call it a rule, whereas we don’t you know, you can have a meeting on a Wednesday and sometimes you have to, especially as if it’s with somebody external. But generally you shouldn’t be scheduling meetings on Wednesdays. Beah: See, that’s interesting because I would have called that one a rule. We I specifically I would have called the rule no Marc: I mean Beah: If you want to hop on real time and talk to somebody internally about something as it comes up, fine. If you have like an external call, we’ve also accepted that. But I I try to enforce that one as a rule because I think that one, if it’s a default, people just don’t observe it. They break it way too much. That’s my opinion. Marc: Well, I yeah, but I think you just gave a few exceptions that are good, right? Like I I’m not gonna necessarily schedule something ahead of time, but I will yeah, reach out to somebody and say, Hey, it would be quicker if we talked about this ad hoc. So maybe I mean, yeah, maybe it’s splitting hairs, but Beah: Yeah, it’s interesting though, because I think of those as part of as like the rule is constrained. So I guess making a rule is is safer the more you constrain it. And you could … This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit insideduckduckgo.substack.com

    • Transcript
  • July 15 · 15 min

    Duck Tales: Our first major Duck.ai ad, and how we develop creative at DuckDuckGo (Ep.38)

    In this episode, Cristina (CMO) and Zack (Senior Director, Marketing) discuss our new Duck.ai ad, how we develop, test, and measure creative and campaigns, and why we do a lot of the work in-house. Disclaimers: (1) The audio, video (above), and transcript (below) are unedited and may contain minor inaccuracies or transcription errors. (2) This website is operated by Substack. This is their privacy policy. If you have feedback on Duck Tales, or episode ideas, email us at podcast@duckduckgo.com. Cristina: Hi, and welcome to Duck Tales, where we go behind the scenes at DuckDuckGo and discuss the stories, technology, and people that help build privacy tools for everyone. In each episode, you’ll hear from employees about our vision, product updates, engineering, or approach to AI. Hi, I’m Cristina. I’m on the marketing team, and I’m here today with Zack. Do you want to introduce yourself? Zack: Yeah, my name is Zack Einhorn. I’m on the marketing team as well at DuckDuckGo and been here for nine years now. and I live in LA. Happy to be here. Cristina: Happy to have you, thanks for joining. So today we’re gonna talk about our new ad campaign. On June 29th, we launched Prying Eyes, the name of our first national brand campaign for Duck.ai. And for those of you who don’t know what Duck.ai is, it is a way to chat privately with ChatGPT and other AIs, all in one place for free, no login. So today we’re gonna go behind the scenes, how it came together. Our unique development and production process, our views on AI, and more. Before we jump in, I just want to say to everyone listening: love it, hate it, have ideas for a new episode, please write us at podcast@duckduckgo.com. That’s podcast@duckduckgo.com. We will read all of them and would appreciate any feedback. So, first question: Zack, why why a brand campaign for Duck.ai and why now? Zack: Yeah, well, you know, for years we had been focused on you know performance marketing for as an alternative to Google and Chrome and focusing on search and browse. And we’re introducing a new product market that has virtually zero awareness. And we’re really confident about the product market fit. We know that there’s a lot of built-up anxiety around AI and a desire for private alternatives. And so we know it’s time to let people know that one exists and from a company that you trust and have been trusting. Cristina: So I find that when I chat with people about what I do, they think the the making the ad portion of my work is the most interesting, right? And they’ll ask, like what is it like to be on set and all these kind of things? So I think a lot of people find that industry but interesting. But even for industry veterans, it’s maybe interesting to hear about how we at DuckDuckGo make an ad, because it’s a different bit different than how most companies do it. Can you dive into that? Zack: Yeah, absolutely. so you know, most companies, and in my in my experience, the prior companies, you know, they kind of hand everything over to one agency. You know, everything is sort of with one big house strategy, research, testing. and the way that we do it is a little bit different. Like you said, we’re we tend to we like to be really hands on. and I think, you know, one thing that makes us pretty different too is that, you know, we’re we you know we’re some of like the foremost researchers on this space at the company. And so we you know, whereas it might be really useful if you’re in like a you know a a a category, like you know, consumer package goods, to have like the expertise of an agency that may have many, many clients in that space and can and can, you know, give you strategy and insight into areas that you may not have. but because we really you know, we have a lot of that research and talent in house, the strategy really you know comes from us. and you know, we tend to lean on agencies more for like additional initial ideation. and then from there we really take things into our own hands. We have we have freelancers that we’ve gone back to a handful of times to help us develop ideas. We’ve got internal talent that helps us develop ideas. and then we have production companies that we work directly with. And that I think is a real for us. You know, we we save a lot of, I think, you know, we save a lot of time in the game of telephone that you usually play with your with your agency by being able to, you know, handpick the director, be you know deeply involved in the post-production, like attending edit sessions, coloring. and I think that that gives us a advantage because you know not only do we get to accelerate by making those being hands-on in those choices, but we also continuously build those skill sets. And so you know we’ve been doing it now, we’ve been doing it this way and kind of building on that process for five years now. And we’ve just we’ve built up a a a ton of expertise internally and done a lot of hot like you know, a lot of good hiring to fill the the areas of expertise that we didn’t have, expanded our network of partners. yeah, we’ve really kind of built up this this in-house team. Cristina: Yeah, thanks for walking us through that. So internally, the team has been calling this ad Prying Eyes. Like, what does that mean? Where did the idea come from? Zack: Yeah, absolutely. So it came from one of our one of our agency partners. You know, we we’d we went through a process where you know we realized one of the things that we weren’t super strong at internally was coming up with the initial idea. and so we ran through a process where we worked with a series of agencies and freelancers to to come up with ideas. One of them came up with this idea that was really sticking with us where we had you know giant photorealistic eyeballs following you know c following people and and you know in you know invading their space when they’re doing asking AI sensitive questions. And we had a few directions we were looking at, and we had done a bunch of research. And the thing that we kept coming back to was this thing we called exposure anxiety. And the crux of it was that we realized that when we got a level down into the specific things that people were worried about being spied on. you know, giving away when they’re when they’re using AI, that it became like a bit polarizing. Like, you know, they once you used a specific example, people are like, well that’s not quite really me. But we found the thing that really stuck for everyone, and that was the most visceral thing, which I think is the most important because I think that’s what sticks with you it emotionally in an ad and will make you think of it later and motivate you, was just the actual sensation of of being watched. That was the through line that whether you were worried about, you know, asking AI about something related to, you know, health, or whether you were asking about an issue going on at work, or you know, whether you’re asking AI you know for symptoms of, you know, something that your that your kids dealing with, that that no matter what it was, everyone shared this this this feeling of exposure anxiety and you know what what can make you you know what is more exposing than feeling like there are giant eyes behind you watching everything that you that you type. Cristina: Yeah, this was this was a fun concept. you know, we considered a lot of different ideas, and for me, just seeing and thinking about the eyeballs was just so arresting, right? In a really clear visual way to encompass the feelings that we had heard in research, right? We’re a very data-driven company, and so research is really important to us. We’re not just thinking of something that looks cool, it needs to be grounded in an insight that we think relates back to the problem we’re trying to solve. Zack: Yeah, absolutely. And I think it also just there was a lot of connectivity to to like our overall message, too, like, you know, in in terms of of privacy and and and prior campaigns. I think th… This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit insideduckduckgo.substack.com

    • Transcript
  • July 8 · 12 min

    Duck Tales: The DuckDuckGo browser now blocks ads on YouTube videos, so you can watch without interruption (Ep.37)

    In this episode, Peter (Product) and Dave (Privacy) discuss YouTube Ad Blocking, why we built it, how it works, and how it differs from Duck Player. Disclaimers: (1) The audio, video (above), and transcript (below) are unedited and may contain minor inaccuracies or transcription errors. (2) This website is operated by Substack. This is their privacy policy. If you have feedback on Duck Tales, or episode ideas, email us at podcast@duckduckgo.com. Show notes: Ad Blocking is enabled by default for Mac, iOS and Windows browsers. It will be enabled by default for Android soon, but for now can be turned on in settings. Peter: Hello everyone and welcome to Duck Tales, where we go behind the scenes at DuckDuckGo, we discuss the stories, technology, and the people that help build privacy tools for everyone. In each of these episodes, you’ll hear from employees about our vision, product updates, engineering, or things like approaches to AI. My name is Peter. I’m on the product team at DuckDuckGo, and I’m joined with my colleague Dave. Dave, do you want to introduce yourself? Dave: Sure. Yeah. Hey, I’m Dave. I generally work on the browser experience at DuckDuckGo. That means working on privacy protections, working on making sure that websites work the way that you expect them to work and yeah, making sure that you have a good experience browsing the web. Peter: Awesome. And today we’re gonna be talking about ad blocking, more specifically YouTube ad blocking, but I think we’re gonna talk also just generally about about ad blocking. So Dave, why don’t we why don’t we start at the top? Does DuckDuckGo browser block ads today? Dave: If if you’ve used one of our browsers, you’ve probably noticed that you see quite a few fewer ads. So that’s a side effect of our tracker blocking. So the reason that you’re seeing fewer ads is a lot of these ads come with trackers, you know. They want to see how you interact with the ad. They want more info about you to determine, you know, is that like a a good impression? And you know, they want to build these profiles and all of that. So we block those requests before they’re initiated. And that leads to many fewer ads across the web. But we don’t deploy a like a specific ad blocking feature. Peter: Mm-hmm. Peter: Got it. And so we what what you’re basically saying is a lot of these companies that, you know, serve up advertising are also tracking the heck out of people. And so by by virtue of the fact that we block that tracking, we are basically blocking you know a lot of the advertisements on the internet. Dave: That’s right. That’s right. Peter: Makes sense. And so what’s changing about our ad blocking? Dave: Yeah, so what we’re doing here, and as Peter said, we we’re starting with YouTube. We r have received a ton of user feedback asking for us to do something about this. As as you probably know, YouTube shows up to you know several minutes of ads before videos, during videos, just constantly. And what what’s changing here is we have deployed we’re working on deploying a feature that will just prevent these ads from loading. So instead of, you know, waiting thirty to seconds to a minute before you can watch a video and then getting interrupted in the middle of a video, you should be able to watch the video right away and without interruptions. Peter: Yeah, and so a a lot of you’re saying a lot of our users have been asking for the ability to block ads on on YouTube. I think it’s safe to say that, you know, a lot of DuckDuckGo search users who historically have used other browsers, have have used extensions, ad block extensions to get this benefit. And so Dave, you’re saying a lot of these users have asked us for the similar sort of capability in our browsers. Dave: Yeah, that’s right. Extensions are a very powerful tool. We don’t export extensions in our browsers for for good reason. So they can be a blessing and a curse. If if you’re using the right extensions, there are safe extensions and they can improve your browsing experience by like you know blocking ads or you know auto-filling password fields, that kind of stuff. But they’re also a a really large risk because there are a lot of malicious extensions out there and unscrupulous extensions out there that can you know get full access to everything within the web pages that you’re looking at and exfiltrate your data and track what you’re doing online without you even realizing. Peter: Mm-hmm. Peter: Yeah, I I remember over the last few years, every few months there seems to be a story about some extension that that a lot of people installed that either went rogue or maybe got sold to another company and then they use that extension to to data mine people and spy on their their online browsing behavior overall. And so you’re you’re basically saying, Dave, by adding this capability, the YouTube ad blocking natively to our browser applications. Not only is it easy for our users to enable and get that benefit, but it is also safe to do so. Is that right? Dave: That’s exactly right. Peter: Awesome. Cool. And so we built this based on user demand. But a lot of our browser users already have the benefit of something we call Duck Player. Can you explain what Duck Player is and then let’s talk about how Duck Player differs from the YouTube ad blocking that we’re talking about? Dave: Yeah, totally. So Duck Player, we like to think about it as kind of a theater mode. So if you visit YouTube or you load a YouTube link, you can load it in this kind of standalone window within our browsers that we call Duck Player. And what what’s happening there is we’re loading it through this separate YouTube no cookie domain. And and the advantage of what we’re doing there is that it doesn’t like when you watch videos, they’re they’re not tied to your account and it they won’t influence your viewing history or your, you know, recommended videos. But over time we’ve we’ve seen quite a bit of feedback from users about issues that they’ve run into with Duck Player and that that have made them go back and watch videos on YouTube’s main page. So I can go into this a a little bit here. So quite often, I guess all the time, when when a when a content creator uploads a video to YouTube, they can decide whether they want that video to be viewable on YouTube or whether they want it to be able to be embedded on other sites. So if they say, no, we don’t want this to be embedded on other sites, that makes it so it also can’t be watched in Duck Player. And there are a couple other edge cases here that prevent users from watching videos in in Duck Player. So if there’s an age restriction on a video that you have to sign in to your YouTube account in order to watch the video, that means you also can’t watch it there. And you know th they’re there a variety of issues that we’ve run into or heard from heard about from users. Peter: That makes sense. Yeah, I I think I think it’s safe to say that our our users love Duck Player. A. We we’ve heard from a lot of users that it’s it’s a killer feature that they they use all the time. But as as you said, yeah, between people who do want sometimes they want to see the full full comments and things like that that you’re not gonna get in Duck Player, they want to see those on YouTube, but they also want to benefit from the the ad free experience. That’s part of the reason we built the YouTube ad blocking and to to avoid some of the error messages that you referred to, which tend to come up pretty often, particularly on on desktop browsers, the error where video cannot be watched because a content creator disallowed it from being watched outside of YouTube. It comes up a couple percent of the time overall. So with this new YouTube ad blocking, it should be a little bit more seamless for everybody. Cool. Dave: Yeah, and I I just want to make it clear that Duck Player’s not going anywhere. That that still exists. You can still choose to use it. We’re just creating more optionality here. Peter: Aw… This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit insideduckduckgo.substack.com

    • Transcript
  • July 1 · 21 min

    Duck Tales: AI in the DuckDuckGo browser — private, useful & optional (Ep.36)

    In this episode, Beah (Chief Product Officer) and Aitor (Engineering) discuss AI in the DuckDuckGo browser, including how we’re integrating Duck.ai, our private AI chat. Plus, why it’s important we make AI not just easy to access, but easy to dial down or turn off entirely. Disclaimers: (1) The audio, video (above), and transcript (below) are unedited and may contain minor inaccuracies or transcription errors. (2) This website is operated by Substack. This is their privacy policy. If you have feedback on Duck Tales, or episode ideas, email us at podcast@duckduckgo.com Beah: Hello, and welcome to Duck Tales, where we go behind the scenes at DuckDuckGo and discuss the stories, the technology, and the people that help build privacy tools for everyone. In each episode, you’ll hear from employees about our vision, product updates, engineering, or approach to AI. Today you’re going to hear about our approach to AI in the browser at DuckDuckGo. So we have—we have four browsers. Or we have a browser for four platforms, Android, iOS, Windows, and Mac. And I have with me to talk about this topic today about how we have integrated AI into those browsers, Aitor. Aitor, would you like to introduce yourself briefly? Aitor: Sure. Yeah, so my name is Aitor. I’m originally Spanish, currently living in Portugal. Been in DuckDuckGo for, I don’t know, five years, something like that. I don’t remember anymore. Started as an—as an Android engineer and now I’m leading with other folks what we call the objective for our AI browser integrations, which is what Beah just presented. Beah: Yep. Awesome. And yes, if—if we—if you haven’t met me before, I’m Beah, I’m on the product team at DuckDuckGo. Before we jump in, I have a bunch of questions for Aitor. But before we jump into the questions, I just want to say this is a PSA to the audience. We’ve been running Duck Tales for, I think, a bit over six months now, and have a pretty good following on Substack, and we’d love to hear from the listeners more. Aitor: Okay. Beah: So if you have feedback about what you like, what you don’t like, what topics you’d like to hear more about, send us a note at podcast@duckduckgo.com with your feedback. We’ll also put that address in the show notes. But please, we’d really love to hear from you. So okay, with that said, maybe just a quick kind of introduction to how we’re approaching AI in general at DuckDuckGo before we get into the—the details of how we put it into the—the browser. Since we started adding AI features to our products, we’ve had this like three-prong value system that AI be private, useful, and optional. So I think those are like—private’s probably pretty self-explanatory if you’re listening to this podcast anyway. Useful meaning like not AI for AI’s sake, but actually like solving a meaningful problem for users. And then optional is also maybe deserves a little explanation. Like you can turn AI off in all of our products. So you know there’s an incredible spectrum of opinions about AI and when to use it and how much to use it that ranges from never to all the time and everywhere in between. And we put a lot of care into giving users the like toggles and controls they need to customize their level of interaction with AI. Whatever you choose there, it will always be private. So that’s like a—just a little bit of groundwork. But Aitor, can you tell me a little bit about like how that—how we’ve integrated AI into the browsers and maybe a demo would be in order too. Aitor: Yeah, let’s just do—let’s just try to share—this is where everything goes wrong now. Let’s just try to say how our AI integration looks like in production right now. Let me share my phone. Okay, so can you—can you see that? Beah: Sure. It can. Aitor: So this is how people would basically see our browser whenever they—they open it. In here you have like some favorites. It’s just for—for display. So the way that we’ve integrated AI in the browser right now is through this toggle, as we call it internally. You see above—search and Duck.ai. What we want is to give like a very quick access to search, a very quick access to Duck.ai, and—and a very easy switch between them. So in here, users could start a search or a browse. Similarly they can just switch the toggle or flip the toggle to the other side and they would see basically our integration with chats. You see here there is a bunch of chats, different icons to show whether it’s a voice chat or a text chat. We also want to have this marriage between chats and—and browsing and we’ll get—probably a little bit more into details later. So at the bottom, if you didn’t want to chat, you have like an easy access again to browser—to search. You can access one chat right from here. Then basically we display our Duck.ai chat. And from here you can just continue chatting from here. This is in Spanish, sorry, or you can just access—or your history or you can create a new one. So this is basically how— Beah: That looks like a testing history if ever I’ve seen one. Aitor: Yeah. So this is basically how—how it looks like in production. It will change very, very soon. So we are gonna ship like a—this is like a good experience, but we are gonna improve it like even further. And yeah, in here related to privacy, like you can just like delete your chats for good, you can rename it and this is like our fire button, which if you are a user you should know about it. The context of—of a chat, you can just basically delete a chat and discuss with our privacy story as well. So this is like a very— Beah: Yeah, I love that. I love the chat level delete. Like I—like I don’t—I don’t use the app level fire button hardly ever ‘cause like I want some amount of memory, but I have like a bunch of like quick throwaway chats like all the time and it’s so satisfying to get them out of my like history list, yeah. Yeah. Hey, you mind going back to the toggle—sorry, Aitor. Aitor: Yeah. Yeah. Me too. Yeah, I’m also like a heavy user of this one. Yeah, cool. No, no, I—I was saying that I’m—I’m kinda like the same user. Like I don’t generally use the button to just clear everything. I’m more surgical. So I love the fact that—that this is the integration and experience that we have—that we’ve created for chats. Beah: Yeah. Do you mind going back to the toggle view? I just wanted to like the search or Duck.ai input. So like when you were—yeah, if you go to the Duck.ai side, just to be totally clear, like those are historical chats. So we—so the auto complete is filling—like if you wanted to revisit a chat and if you start typing it’ll filter. So if you have like a very long history list, it’s an easy way to get to—yeah. Aitor: Yes. Exactly. Yeah. Exactly. Yeah. This is the chat history—similar to—it resembles basically the experience of search, although it’s like slightly different. It’s only about chats. And—and yes, as soon as you start typing, it starts autocompleting the ones that they are more relevant to—to your—to your—to your text. There’s a bunch of—of things that we are doing around improving the—the—the searching capabilities. So that it’s not only by title, but it’s like—I don’t know, if you don’t quite remember the exact words of your chat, basically we still wanna present with that option, right? So there’s like a bunch of work as well going on in that direction. Beah: Yeah, it’s interesting. Like it—well, I think one of the s—central product challenges here is like chat is not entirely analogous to search or browse in that you—you know, you pro—you don’t want to like continue a search. I mean you might like branch off from a search, but like what—you know, an old search is an old search. A chat you might want to like revisit a chat to continue. It’s like a living thing that you wanna continue. And so that’s created some interesting, like—we’re—we’re sort of trying to make these parallel worlds that will feel familiar to some extent. Aitor: That’s fine. Exactly. Beah: Good thing. I can’t read Portuguese, huh?… This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit insideduckduckgo.substack.com

    • Transcript
  • June 24 · 14 min

    Duck Tales: AI optionality, and why DuckDuckGo installs are up ~40% since Google swapped search for AI mode (Ep.35)

    In this episode, Cristina (Chief Marketing Officer) and Kamyl (Chief Comms & Public Affairs Officer) discuss the AI announcements of Google I/O, our response, and how our long-term stance on AI optionality led to rapid and record growth. Disclaimers: (1) The audio, video (above), and transcript (below) are unedited and may contain minor inaccuracies or transcription errors. (2) This website is operated by Substack. This is their privacy policy. If you have feedback on Duck Tales, or episode ideas, email us at podcast@duckduckgo.com Cristina: Hi, and welcome to Duck Tales, where we go behind the scenes at DuckDuckGo and discuss the stories, technology, and people that help build privacy tools for everyone. In each episode, you’ll hear from employees about our vision, product updates, engineering, or approach to AI. We’ve been running Duck Tales for over six months now and have a strong and engaged following on Substack, especially. We’d love to get your feedback. What do you like or dislike about Duck Tales? What topics would you like to hear more about? Is there anything you’d like us to go deeper on? You can write to us at podcast at duckduckgo.com. That’s podcast at duckduckgo.com with suggestions. We will read all of them. And you can find our email in the show notes too. So with that said, hi, I’m Cristina. I’m on the marketing team. And today I’m here with Kamyl, who leads our communications and public affairs teams. And we’re gonna interview each other today. Kamyl, do you wanna say hi or anything else? Kamyl: Ha ha. Greetings everyone. Thanks for tuning in. Cristina, I’m really excited to talk about our topic today with you. Cristina: Awesome. Okay, so to jump in, DuckDuckGo has always been known for privacy, but lately we’ve been talking a lot about AI choice. How did private, useful, and optional become the lens we put on AI? Kamyl: So I remember when ChatGPT first launched and I was talking to Gabriel a little bit about, you know, how do we think this is going to show up in DuckDuckGo? And I think one of the things that makes working here at DuckDuckGo really fun and different is that we get the freedom to think a little differently, and to say if everyone is doing one thing, how can we do it a little different. How can we think about AI in a way that’s uniquely DuckDuckGo? And that’s how we landed on private, useful, and optional. Private, what most people know about DuckDuckGo, we’ve always respected our users’ privacy, never collect search histories, anything like that. And we do the same with AI. Useful in that we never wanted to just launch an AI feature. Because it’s AI, but it actually had to do something helpful. It had to do something to improve the search experience or the browsing experience. And then optional, knowing that there are many people out there with many different opinions about AI, and opinions are still forming. Some people want the ability to use it to the their most its most extent. And some people don’t want to see it at all. And that, you know, because of a lot of big tech investments in a in a in AI like Google, they aren’t willing to necessarily just give AI a straight up off button. So we knew that those were things that we could do uniquely, put them together and then that became our lens. Cristina: So because we are in this optional standpoint, we offer a no AI experience, we also offer things like Search Assist and Duck.ai. How do you respond to folks who might say that offering this range is contradictory? Kamyl: Right. You know, I think it’s part of the it’s a major part of our goal at DuckDuckGo to let people use the internet how they wanna do it, but more privately and without trade-offs. And so some people want to use the internet with AI and some people want to use it without AI. And so to us, giving people a way to do whatever they want in a more private way without trade-offs feels really core to our mission. And so it’s not contradictory. We don’t have to have sort of one binary stance on it. We have to think about who our users are and what they want. And instead of forcing them into one experience, we think it’s the right thing to do to let them choose. Cristina: Got it. So for you and I and the team, it’s been a very busy, very exciting few weeks. Yes. And this all started at the Google I/O conference. Can you tell us what was that and why did it have an impact on us? Kamyl: Indeed it has. Yes. So Google I/O happens every year. It’s their developers conference and they announce you know, a extremely long laundry list of new features and products and things that they are excited about. And at the top of that list were changes to core Google search. Essentially that they were going to turn it and are in the process of turning it into a more AI forward experience that is turning the search bar into an AI chat bar. And essentially the moment that that happened we saw organic conversations about it explode over the internet. Why is Google doing this? They’re getting rid of blue links. Here we go again. The issues they we saw on AI Overviews. And it was a moment where you know, if Google has been trying to kind of boil the frog in terms of really slowly changing the experience to turn it into pretty much a full AI chat experience, this was the moment that the frog started to jump out a little bit. And that’s sort of what we saw on social, that people sort of saying. We have enough of this. This is making it worse. This is the last straw. And as people started doing that, you know, we saw people recommending DuckDuckGo in really high numbers. And also starting to download DuckDuckGo in much higher numbers than we were seeing before. Over the two weeks or th— really three weeks since the Google I/O conference, our installs are up thirty to forty percent above baseline. And so it was really exciting to see DuckDuckGo being a part of this conversation and people recognizing after you know talking about optionality for a long time, sort of people recognizing that that’s a really important part of our product and coming to us for that reason. Cristina: Yeah, absolutely. I mean, we saw this amazing conversation a folding unfolding around us. Can you go a little deeper in terms of how we joined the conversations, worked to reach more people and some highlights of what they were saying? Kamyl: Absolutely. There were multiple Reddit threads about, you know, not only the the the news that Google was making these changes, but then about how much we had grown. At one point we had announced that search that that installs were up almost eighty percent, almost seventy-five percent from a pre-Google I/O baseline. And once this news got out and people were reacting to it, it it really just exploded. It was kind of an important social proof, I think, that people were interested in seeing that, you know, people aren’t just complaining about Google, but they’re actually trying out different things. We’ve even done some research about, you know, who are these new folks coming to DuckDuckGo and what are the reasons that they’re that they’re coming to us. And one of the top reasons is that they’re unsatisfied with Google’s search results. That the quality had gone down to to an extent that they had sort of finally had it. And, you know, of course many users feel trapped within the Google ecosystem, so it’s not exactly easy to leave. But I think installing us was sort of the easiest way to do that. And you know, seeing so many threads on Reddit, for example, with twenty K plus upvotes. I think we made the front page of Reddit. It was it was pretty amazing to watch. Cristina: Yeah, absolutely. Well— Kamyl: So as a part of that, you know, I want to now ask you a few questions. You know, that was sort of the tip of the spear when we saw this incredible engagement online. We thought, okay, how could we start to extend the conversation and maybe do some paid channels? What was our approach there? How did we start to pivot a little bit? Crist… This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit insideduckduckgo.substack.com

    • Transcript
  • June 17 · 13 min

    Duck Tales: Voice-mode in Duck.ai. The private, hands-free way to chat with popular AIs (Ep.34)

    In this episode, Beah (Chief Product Officer) and Fran (Engineering) discuss voice-mode in Duck.ai, common use cases, and how it’s private. Disclaimers: (1) The audio, video (above), and transcript (below) are unedited and may contain minor inaccuracies or transcription errors. (2) This website is operated by Substack. This is their privacy policy. If you have feedback on Duck Tales, or episode ideas, email us at podcast@duckduckgo.com Beah: Hello, welcome to another episode of Duck Tales, where we go behind the scenes at DuckDuckGo and discuss the stories, technology, and people that help build privacy tools for everyone. In each episode, you’ll hear about our vision, our product updates, engineering, or approach to AI. In this episode, you are going to hear about our voice AI chat feature. And I have with me today Fran, who played a very large role in building and shipping that feature. So Fran, do you want to just briefly introduce yourself? Fran: Yeah, so hi everyone. I’m Fran. I’m an engineer at DuckDuckGo and I’ve been working on Duck.ai for a long time now and yes, I was heavily involved in building voice chat and yeah, it’s a very exciting feature. Beah: Awesome. Well, thank you for joining us. And I’m Beah. For anyone who hasn’t already met me on one of these podcasts, I’m on our product team. Before, so I have a bunch of questions for Fran, but before I jump in, I want to make a ask of our listeners, actually. So we’ve been doing these podcasts for a little over six months, I think, now, and have a pretty good audience following on Substack. We would love to hear from you, our listeners, get some feedback about like things that you you like about how we’re approaching this, things maybe you don’t like, and also like what topics you would like us to talk more about so we can plan future episodes with your interests in mind. So if you have any feedback or want to talk to us, send us a note at podcast@duckduckgo.com. and we’ll also put that address in the show notes. So with that said, let’s talk more about voice chat. so Fran, can you just tell me like to get started, what is this feature? How does it work? Maybe you can give us a quick demo. Fran: Yes, definitely. so voice chat is a hands-free conversation mode inside Duck.ai. so yes, so far our users have been able to talk with any with many chat models via text. And we wanted to provide a privacy focused way for you to just have a conversation with your model. There’s some really cool real-time models out there right now, and we wanted to incorporate this feature on Duck.ai as well. so yeah. With voice mode, you can basically have a call with the model and talk directly to it. It will listen, it will reply out loud. you can also interrupt it mid conversation and like if you want to correct or actually add some extra information, the model will stop and listen to you and then reply back. It can pick up a little bit how are you expressing yourself to also help that play into the response that it will give back to you. Beah: They have people. Fran: And so I have here on my phone Duck.ai. And if you want to use it, like we have this very handy voice chat, you can go there and you can just start talking. So can you give me the weather for New York today? Beah: Yeah, yeah. Fran: Just new it’s city in New York City, the temperature is around twenty eight degrees Celsius with a heavy thunderstorm. Celsius and the low tonight could drop to twenty-four degrees. There’s a heat advisory in effect as well, so it might feel quite humid. Make sure to stay hydrated and be prepared for possible flooding. You can also check the extended forecast on sites like AccuWeather or the Weather Channel. Yeah, that’s very nice. So yeah, you can ask follow-up questions inside the same session. Right now I’ve muted myself, so you can also mute in case you want the model to not hear you at the moment. And and yeah, it has access to web search as well, so you can also get the news, get weather information or any up to date information. Beah: Nice. I am not too far from New York City and I can vouch for it being very humid today. cool. Yeah, so t tell me, I know that the demo, you know, I hopefully people can see it well enough f on the screen, but if you couldn’t, there’s like a little ghosty character with a bow tie. tell me a little bit. Who’s that? What’s his deal, his or her deal? Fran: yes. so that is our voice mascot. we wanted to provide like a visual aid and like represent that the AI is speaking to you so you can just see when the AI is listening and replying back to you. So we created this mascot to be there with you during the session. And we wanted this mascot to also have a little nod to Dax, our technical mascot. Beah: Yeah. Fran: so that’s why it has also the green bow tie and it’s white, so it it it’s it’s a nod to Dax. Yeah. Beah: Yeah, so if you’re not familiar with Dax, that’s the name of the DuckDuckGo duck that you see, the Debonair, yeah. duck with the bow tie. awesome. and by the way, like on the point about the dem demoing this is a little bit challenging because of the audio and the back and forth, but just go like after this podcast or in the middle of this podcast, go try it. it’s you know, if you don’t already have the DuckDuckGo app, you can download the DuckDuckGo app on your phone. You can also try it on desktop. Fran: Yeah. Beah: And actually, Fran, I should ask, is it free or do users have to pay to use voice chat? Fran: It is completely free. so our free tier users can access voice chat directly from either that button or the sidebar as as you could see. And yes, with with the pro and plus subscriptions you do get more time to speak with the model, but it’s available for everyone right now on your phone on or desktop. Beah: Awesome. cool. So maybe can you tell me a little bit about why we decided to build it at all? Like what instigated this whole project? Fran: yeah, so like I was saying before, like we there’s some cool voice models out there and we wanted to give like this hands-free way for people to talk with with our with their chat model. and we also wanted to have a private way for them to speak, so we did put in place some technical ways for us to improve like our privacy and anonymizing your voice when we when you’re connecting to the provider to speak with it. and yeah we want to give you this free hands-free way of talking with the model is also better for accessibility like we’ve gotten feedback like some people struggle using the text chat so with this you can just connect and start talking with the model uninterrupted. Beah: Even the. Yeah. Okay. Fran: So yeah, it’s been a very, a very cool feature. And we know voice is a very unique thing for the users, so we wanted to provide a way for our users to be able to use that in a private and secure environment. Beah: Everything. Okay. Yeah, yeah. Can you is there anything else that you wanna add about like how we handled priv like how we made it in fact meaningfully private? Fran: Yes, definitely. it was challenging because right now there is so many different ways to handle voice models that are out there. Like different providers have different ways that they provide. Like we did this connection directly with the model using real-time web technologies. So you’re actually like having a call with the model. but there are other ways where you could parse the conversation, maybe turn to text, but then a lot of the details and the nuances of your talk can be lost in between. So we found we looked into this balance of having a good user experience while also preserving your privacy. So the way also that we build, like there is this relay in between you and the provider, and we anonymize all the metadata and the information of your call. So the provider doesn’t really know who you are. Although your va your voice is still unique to you. You should be mindful of that. But apart from that, everything else we anonymize during the call. Yeah. Beah: Hmm. Tha… This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit insideduckduckgo.substack.com

    • Transcript
  • June 10 · 13 min

    Duck Tales: How we've made it easier to generate images privately in Duck.ai (Ep.33)

    In this episode, Beah (Chief Product Officer) and Matej (Engineering) discuss the evolution of image generation in Duck.ai, UX improvements, and the challenge of balancing output quality and speed. Disclaimers: (1) The audio, video (above), and transcript (below) are unedited and may contain minor inaccuracies or transcription errors. (2) This website is operated by Substack. This is their privacy policy. If you have feedback on Duck Tales, or episode ideas, email us at podcast@duckduckgo.com Beah: Hi, welcome to Duck Tales, where we go behind the scenes at DuckDuckGo and discuss the stories, technology, and people that help build privacy tools for everyone. In each episode, you’ll hear from employees about our vision, product updates, engineering, or approach to AI. Today I’m here with Matej, and we’re going to talk about image generation in Duck.ai. I will let Matej introduce himself, but quickly I’ll just say that if you haven’t met me yet, I’m Beah, I’m on the product team here at DuckDuckGo. And yeah, Matej, take it away. Tell us a little bit about yourself. Matej: All right, Matej. I’ve been at DuckDuckGo for a year and a half now, and I’m working on Duck.ai and I work primarily on image generation last year from September until Christmas. Beah: Awesome. Well, okay, so just to kind of get started, tell me a little bit about what that even means. What is image generation in Duck.ai? And if you’re able, I I think a demo would be great. Matej: Yep, definitely. Let me share my screen here. All right. So if you go to the Duck.ai, go to the Duck.ai and you will see basically this screen and you probably notice that there’s this option new image, which is when you click on it, then you type any prompt in here. Duck.ai will try to generate an image for you. So let’s show me an image of a cat on the windows. So hopefully at the end of this we’ll get an image. This is going to take a little while because image generation is quite a heavy process. Yeah, this is the simplest form of it. Beah: Okay. I see it. It’s coming together. Matej: We’re getting, yes, it’s coming together and here’s our little cat. can click on it, zoom on it, download the image and copy it if we need it. Or we can keep it writing on it and ask for adjustments in the image. Beah: That’s pretty good. Good. I mean it has like the right number of limbs. There’s nothing too crazy going on here. I’m pretty impressed. do you wanna demo like any adjustments or anything else you wanna point out while your screen’s being shared? Matej: Yes, that’s correct. Sure, we can try it. Add another cat to the image. Let’s see what it comes up with. Beah: Okay. another cat. yeah. Cool. And what what model is operating here? Matej: So, we’re currently using GPT Image 2 model. We’ve been through multiple iterations of this and it’s always been a trade-off between cost, the output quality and the performance, so how quick the model is. We went through GPT Image 1, 1.5, 1 Mini and 2. Currently the GPT Image 2 model is slower, however it... the output quality is much, much better than previously. You probably cannot see it in images like this. However, if you would prompt it to generate a text, then you would see a clear difference between different models, and GPT Image 2 follows instructions really well and generates the text really well. Beah: Hmm. Got it. So like a bad job if you say if you tell it to put some copy in an image is like it doesn’t get the letter. It like uses different copy, it like mangles the letters. Is that right? Yeah. I’ve definitely been there. But hey, look, this cat also has the right number of limbs. I don’t see anything problematic or fishy about this. I guess it’s kind of a s a softball query, because there’s plenty of cat images on Matej: Exactly, exactly. That’s the case. Yeah. Beah: In in Windows online, huh? Yeah. A demo query. Nice. Cool. okay, awesome. Well tell tell me a little bit, like stepping back again, tell me a little bit about why we even built image generation. Matej: That’s correct, yes. Yes. So I think from the outset, we knew that we will have to at some point. The reason for that is most of the competitors or similar products already provide this feature. We knew that we had the capability, but also we had some user feedback that this is like a highly requested feature. It doesn’t match. Like at this point in time, this is like a baseline feature that is expected by all the users for you to have in any sort of AI product, I would say. Beah: Yeah, yeah, got it. and all right, so what were like did you run into any challenges when you were building this this feature? Matej: So I think challenges were not technical. Surprisingly, most of the challenges would come out of, for example, content moderation. How do we prevent people from generating, for example, self-harm images? And then the second part that I’ve already mentioned is how do we balance the quality, performance, and cost at the same time? So those were the two challenges that I would say were that come to my mind as we’re building this. Beah: Yeah. Gotcha. And like what was the what was the runtime on this work? Like how how long have you been working on this? Matej: So I started working on initial prototype in September last year, and we shipped it to production just before Christmas. So that was it. Beah: Got it. And was it mostly you or was there a team of people working on it? Matej: In the beginning, was mostly me and then another engineer joined me for UI work. So I did mostly the back end and then a little bit of wiring on the front end. Specifically for like, you can also upload your own image and then ask the model to make adjustments to it. So this is the part that I was working on. Beah: Yeah, yeah. Nice. Have we gotten any interesting or surprising feedback since it’s been live? Matej: So I wouldn’t say any interesting, but what was surprising to me was that the reception was quite positive. And I was a bit worried when we built this feature because in general, image generation is perceived as a fairly harmful thing. depending on your intent, you can also do harmful things. However, I was surprised that most of the people were positive and they appreciated to have a privacy focused way of generating images. Beah: Yeah. Mm-hmm. Mm, sounds like the hard work that you put into, you know, putting the right content generation guardrails on it and so forth must have must have paid off. Matej: I hope so. Beah: Nice. So like going forward are there improvements that we’re that you guys are making on this feature? Matej: So we’ve already made a bunch of improvements. This current iteration that you saw in the demo is an evolution of original implementation. Previously, we had a separate mode just for image generation. It was not integrated into your normal conversations. And this is one feedback that we’ve received and we pivoted away from the separate mode into having it in line in your regular chats. Beah: Mm. Matej: Another piece of feedback we’ve heard, and I already mentioned this, we’ve gone through multiple models because people are asking for better output. Going forward, I don’t think we have anything in particular. if you have any feedback, I’m happy to read through it and put something on the roadmap. There are many ways we could take this. I can imagine we have like we had we can add a freeform canvas and you can ask a model to make your image pretty like you draw something with your free hand and you’ll get a nice image or advanced editing you mask out something and you ask a model to replace that bit of an image with something else. So there are many, many different ways we can take it. Beah: Yeah, yeah. Nice. Yeah. going back to a second for the whole the like to the inline versus a separate separate mode thing. So that’s like just just in case it’s not obvious that like it used to be that you had to start your chat in image mode. And if you started with any other model or you know, you were mid-chat, you coul… This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit insideduckduckgo.substack.com

    • Transcript
  • June 3 · 23 min

    Duck Tales: Dax (our mascot) is coming to the physical world, on shoes, shirts, and security keys (Ep.32).

    In this episode, Gabriel (Founder) and Dan (Brand Strategy) discuss our first set of branded collaborations, where the idea came from, and why people would rep Dax in public. Show notes: Shop the collaborations here Disclaimers: (1) The audio, video (above), and transcript (below) are unedited and may contain minor inaccuracies or transcription errors. (2) This website is operated by Substack. This is their privacy policy. If you have feedback on Duck Tales, or episode ideas, email us at podcast@duckduckgo.com Gabriel: Hello again. Welcome to Duck Tales, the show where we delve into all things DuckDuckGo. I’m Gabriel. I do a bunch of these, but not all. I’m the founder of DuckDuckGo. I’m here today with Dan. Dan, you want to introduce yourself? Dan: Yes, absolutely. Hey everybody, I’m Dan. I help lead the brand strategy team and I’m excited to be chatting with Gabriel today. Gabriel: Cool. So we’re gonna actually turn it around today and Dan’s going to interview me a bit about something special we’ve launched recently. That said, before we get started, we have a new email podcast at DuckDuckGo.com where we would love your feedback about Duck Tales. What episodes should we run more of? What do you like? What do you don’t like about the show? Should I get a real microphone? Blah blah blah. Please email us. We’ll we’ll read it and get back to you. But now we’re going to turn it around and Dan, take it away. Dan: Amazing. Before jumping into the questions, I’ll first just introduce this special topic we’re gonna dive into. Today we’re here to talk about the how the DuckDuckGo brand is doing collaborations. And we’re doing branded collaborations with Atoms Shoes, with Cotton Bureau Shirts, with Yubico Hardware Passkeys, and more collaborations to come in the near future. So before diving into the specifics about why we chose each of those collaboration partners, we want to take a step back and chat about why, in general, we’re doing collaborations. We want to chat about brand and the DuckDuckGo brand in the larger landscape that we live in, and just have an interesting conversation about this exciting new work stream we’re doing. So with that in mind, I can jump into the first question. The first question is why go physical now? And to add a little bit more meat onto the bones of that question, allow me just to explain in a little bit more depth. It’s really interesting to see how some brands are bringing gaining cultural influence in unexpected ways. For example, a brand like Teenage Engineering makes audio hardware, but has become a lifestyle statement. A brand like Starface makes acne patches, but it has become a signal a symbol of empowerment. And so that brings us to DuckDuckGo, which is an internet privacy company now releasing branded collaborations with fashion and technology hardware companies. So the first question is, why does it make sense for DuckDuckGo to go from a purely digital brand to one with a physical presence in people’s lives? Gabriel: Yeah, and and if everyone is aware, Dan is relatively new, so he doesn’t know all of DuckDuckGo history. And I this is not as thought out as you might imagine. But let me take you through some of that history. So when when we first started, it was just me and I we’ll get into this a little more deeper, but I really like offline stuff. I mean as most people do, but like particularly like good products and showcasing Dan: Yeah. Gabriel: stylish things and whatnot. So I very early on made stickers and t-shirts. And for several years I would send people stickers for free. You could there was a there was a like a place on the site you could put in your information. I’d only use it to study the sticker and delete it in a privacy respecting way. But I probably sent liter I probably mailed thousands of individual people stickers out. At some point and people love it. And then we also had you know I I almost exclusively wore t-shirts for a long time and I I really had a thought, we’ll get you into this a little bit as to like what makes a really good t shirt. So I had some really good t shirts made and some we had a little store going that was just a cost and we gave away a lot of free t-shirts too. But at some point the free community picked up on this kind of stuff, which is not DuckDuckGo users, just people who want free stuff, and they overwhelmed my inbox and our free program such that we had to like completely take it down. And then we ran the store for a while with just the t-shirts, but our vendors kind of changed, went out of business. Various things happened where the store went down, and then we were like it’s not we got other things to do, so we haven’t put it back up. And so that was probably six, seven years ago, maybe when it last existed. So we did have it for some period or some amount of things. They weren’t collaborations per se, but DuckDuckGo offline products. And then it went away. Since then people continually asked for it. Can I get some DuckDuckGo stickers or t-shirts? And we have them internally, obviously, for company swag, which you probably have gotten already. And so we do send them around occasionally, but they’re not publicly available. Then fast forward to this year, and I just was like, I found myself with some extra time just looking at lots of interesting products for my personal consumption. And I was like, I would love to have a DuckDuckGo collaboration on some of these. And so these are the first ones we did. And I just wanted to exist in the world. And so it was it wasn’t some grand strategy more than I would like it. And then given that I would like it, I thought maybe other people would like it. We did do a lot of data research around this. And so our goal was to put it out, and hopefully our DuckDuckGo fans are interested in it. But that’s that’s really the longest word of it. Not a big strategy, more just like I want it to exist, and I’m very glad that products do exist and we’ll talk about them, but that’s really what it is. If if people really do like it, we’ll do a lot more. But if they don’t, then we’ll probably won’t do a lot more. Dan: Well, I I think that makes total sense. And I also think that the timing for these products makes a lot of sense as privacy becomes goes from what is often considered more of a niche concern to what has really now become a really important mainstream concern for millions and millions of people. And so I’m curious when people wear the DuckDuckGo brand on a t-shirt or shoes or any other product, what does it stand for and why are you excited for people to rep the duck the DuckDuckGo brand? Gabriel: Yeah, so we have a we people don’t really know because we’re not the majority search engine or you know, obviously that’s Google, but like in the US we have about ten percent of people who identify as DuckDuckGo users in the surveys we do. So it’s it’s a really not insignificant amount of people. And you know, our search share is lower because they may not use us all the time or on all devices, but that’s about the percent of users we have in the US. Those people, you know, are are what we call or we call deeply care and act on privacy people. They not only care, a lot of people care and say they care, but they’re doing something to act on it. You know, usually to escape creepy ads or just to protect their personal information from getting out, not leaving as much of a digital footprint, not having as many, you know, recommendations and algorithms, all sorts of good reasons to choose privacy, but they’re making that choice explicitly. And that’s kind of a lifestyle choice. And I think that lends itself to expressing yourself that you know you’re in this choice, like you care about privacy and you want other people to know about it. That also helps DuckDuckGo for everyone listening because most of our growth, the biggest component of our growth has been word of mouth. And so if you are a DuckDuckGo user, you know, you’re already educated enough… This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit insideduckduckgo.substack.com

    • Transcript
  • May 20 · 19 min

    Duck Tales: The role of user research, A/B testing, and "dogfooding" at DuckDuckGo (Ep.31)

    In this episode, Beah (Chief Product Officer) and Zac (SVP, Insights) discuss our approach to user research, how we run robust research while respecting user privacy, and why moving quickly matters. Disclaimers: (1) The audio, video (above), and transcript (below) are unedited and may contain minor inaccuracies or transcription errors. (2) This website is operated by Substack. This is their privacy policy. Beah: Hello and welcome to Duck Tales, where we go behind the scenes at DuckDuckGo and discuss the stories, technology, and people that help build privacy tools for everyone. In each episode, you’ll hear from employees about our vision, product updates, engineering, or approach to AI. In today’s episode, we’re going to talk about user research. And so my guest here is Zac. Zac, do you want to introduce yourself? Zac: Yeah, hi, Zac Pappas. I am on the Insights team at DuckDuckGo. I’ve been here for coming up on 14 years and pretend to participate in a lot of market research, user research, and other conversations that we have where we try to infer what users want and whether or not we’re giving it to them. Beah: Sweet, thanks. And I’m Beah. If you haven’t met me, I’m on the product team at DuckDuckGo. All right, let’s launch into it. I have questions for you, Zac. Are you ready? Zac: Ready as you’ll ever be. Beah: All right, so let’s start. Why don’t you give me an example? Like when we’re talking about validating things with user research, just like let’s set up an example of what that means and what that would look like. Zac: I think so. Yeah. So I guess starting with what is user research and why do we do it? I think the obvious answer that people tend to think about are, you know, sitting in an interview or doing some sort of focus group and learning from people. But really, for us, user research is kind of all of that plus, you know, internal dialogue and real testing like A/B testing. So to put it, you know, simply, I guess, user research for us is just trying to be wrong very productively and being efficient at being wrong productively over time. So for us, everything really starts out as a guess or an assumption about users or their behavior about, you know, what is upcoming in the market and research checks that, you know, our assumptions are correct or at least as close to correct as possible. And we try to do that as cheaply as possible, meaning quickly without spending more time on it than what we’re gaining in terms of the product that we’re creating. So an example could be our homepage at DuckDuckGo.com because our homepage has been around for as long as I think DuckDuckGo has been around, but has gone through many, many, many forms. We’ve done tons of A/B testing on it, showing one version of it to some users and a different version to other users. We’ve done a lot of user testing on it, like sitting down with actual consumers of the homepage or users of the homepage. Everything from discussing with parents how they perceive the homepage. So a lot of subtlety that goes into what we think maybe appears as a pretty simple layout or design. Beah: I had a little connection issue there for a second, but I think it’s alright. Let’s forge ahead. Sorry, audience. So, the homepage, I think, as you pointed out, sort of like deceptively, seems deceptively simple, it’s not highly functional software, it’s a page, there’s a few boxes on it, a field, but like what makes it so tricky and worthy of user research. Zac: Yeah, good question. Because it is kind of subtle, or I guess it doesn’t seem very obvious. So if you think about it, the homepage is really where we have a big mix of different user types coming in. Making any assumption about a part of our product usually means that you have to infer who is using it, meaning are they younger or older? Do they have a lot of context about what they’re doing or very little? So our homepage is actually a mix of different user types. There’s a lot of returning users who are very familiar with DuckDuckGo, they’ve been coming to it for a very long time. And so when they come to the homepage, it’s a pretty like rote act for them. The other group that really comes to our homepage a lot are new users or new visitors to the brand and product space in general. So they have maybe very little context about what DuckDuckGo is or what products we have. And so you can imagine, you have these two very diametrically opposite groups that come in, people who have a kind of a strong habit formation and muscle memory on how to use the page and then others who don’t have anything and they kind of, you know, maybe say meander or explore more than they are, you know, directly going to the thing that they know that they want. So what we learned over years of A/B testing, user testing, and kind of regularly reviewing what the experience is like for real people, we found something kind of interesting, if I can just generalize it, which is new users — like kind of people first visiting DuckDuckGo for the first time — really look at the center of the page. And if you see DuckDuckGo.com today, it has these two prominent boxes in the middle. It depends on the browser that you’re in or the form factor that you’re on. But primarily what we know is new users will tend, their eyes kind of follow the middle of the page. And so when they land, we really want to show them an overview or a good sense of what DuckDuckGo can do for them. Whereas returning users, people who’ve been coming back for a long time, tend to want to find the search box. And so we can, or at least we have some confidence that we can move the search box around, you know, the top of the page where it’s at now, to the bottom, to the middle. And if you’re a returning user, because you kind of expect or know that it’s there, you will more easily be able to hunt and find it. So the configuration that you see today, and maybe changes as things develop, really does to us strike a very good balance between new and returning user needs, both something that a brand new user can figure out and use efficiently and kind of get a lay of the land of what DuckDuckGo is and what we do. And then returning users can quickly get to the search box or other more mechanical parts of the product without too much friction. Beah: So how did we actually learn that? Like what testing methodology did we use? Can you walk me through it? Zac: Yeah, a lot of, I’m sure, pretty standard things for people who are used to product development, but A/B testing primarily. A couple years ago we were running, I think, like at least one A/B test of the homepage, like one alternative version of our homepage every week for pretty much the entirety of 2024, 2025. That year we had a ton and tons of homepage tests. And then independent of the actual A/B experiments that we’re doing, we will regularly run diary studies. So recruiting 10 to 20 DuckDuckGo users or other different user types, even non-users, to give them some background on the product. And then really give them a chance to use it for multiples of weeks and have them do journal entries and take notes of the things that they’re running into that they’ve experienced that are emotionally supercharged or maybe had caused some great duress in how they tried to use the product. So anything that’s really notable to that user can come up in a diary study. What we’ve also done in the past is to try to create alternative versions of our homepage from designs or a design system that we can give to users to play around with in real time. So we can actually simulate what an alternative version of the homepage might look like and how it should act and give them a clickable prototype that they can use, get some feedback before we ever invest too heavily in the platform. So it’s been a mix of really just doing a lot of testing pretty much every week since the conception of the company on some run. The homepage was a big focus for us for the last few years to try to nail someth… This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit insideduckduckgo.substack.com

    • Transcript
  • May 13 · 14 min

    Duck Tales: How DuckDuckGo provides useful “near me” search results, while keeping your location private.

    In this episode, Greg and John (Search) discuss local search results, and how we help you find local cafes, restaurants, and business, without knowing your precise location. Disclaimers: (1) The audio, video (above), and transcript (below) are unedited and may contain minor inaccuracies or transcription errors. (2) This website is operated by Substack. This is their privacy policy. Greg: Hello and welcome to DuckTales where we go behind the scenes at DuckDuckGo and discuss the stories, technology and people that help build privacy tools for everyone. In each episode, you’ll hear from employees about our vision, product updates, engineering or approach to AI. I’m Greg. I work on the search engine here at DuckDuckGo. With me today is John. John, would you like to introduce yourself? John: Hi, I’m John. also work here at DuckDuckGo on the search engine and I’ve been focused on working on local search for most of my time here. Greg: Awesome. Yeah, that’s kind of what we wanted to talk about today is local search. And so I’m looking forward to chatting with you a little bit about how local search works, how we do it at DuckDuckGo and get into some of the challenges that we have as a private search engine and how we solve those. Local search generally, it’s kind of maps related searches. whether you’re searching for places, businesses, restaurants, those kinds of search queries we kind of call local searches. We have a couple different versions of a map that shows up on the search results page. When you do one of those searches, either you’re searching for something kind of in a city and you put the name of that city in your search query, or if you search for something near you, have ways to provide those results. still in a privacy preserving way. So maybe as a starting point, I thought it would be good to just, if you could walk us through a little bit of the life of a local search query, how it goes from kind of something the user has submitted to us to what we decide to show on the page. John: Yeah. So we start with a, we get a user query. So somebody type something in and sends the query to us. And we try to figure out whether that would benefit from some sort of mapping information. So maybe the query contains a number and a few words and then drive or street or road. And you know, that looks like an address. So we’ll show a map of that address. Other common patterns are, you know, common. types of businesses like restaurants, hotels, cafes, and those sometimes come in with location indications. know, cafes in New York City or cafes in Paris. And sometimes they don’t, sometimes it’s just cafes or cafes near me. So we kind of have to handle both those types of situations. And the ones that are nearby are really kind of the more interesting ones. because we have to find a way to figure out where Nearby is for the user. And we have to do that in a very privacy-respecting way because that’s our whole thing. So the browser, the web browser that you’re using will send a location. But we don’t just straight up use that because we deal with lot of partnerships where we have to get some data from our partners at Apple and TripAdvisor. And we don’t want to just send them raw user locations because that is a privacy issue. So what we do is we’ll kind of add some noise to it. So if you say you’re at, you know, this exact location in a city, instead of sending that, we’ll move you a little bit. Depending how big the city is, we might move you just a few hundred meters. If you’re way out in the country though, where maybe you’re our only user for miles, you know, we might move you a few miles. And so that... can affect your results, makes them a little less accurate, but we think we do it with as little noise as possible to get you a lot of privacy benefit while still giving you results that are hopefully very accurate to the location you’re interested in. Greg: Yeah, so there are a couple of things in there that I think are interesting to talk a little bit more about. when you kind of described how we add noise to a user’s location, there’s a lot of documentation, by the way, about this, if you want to read more on our help pages. But I’m wondering how we think about the kind of trade-off between making sure that the results are still good and the way that we’re obfuscating someone’s location is sort of sufficient from a privacy standpoint. So maybe you can talk about the first part first. How do we think about the quality of the results and whether or not we’re showing the right local results for someone when they do one of those nearby queries? John: Right, yeah, we have a lot of criteria that we check against before we show results to users. We’ll get a whole bunch of options that might be relevant to the query. And if you’re searching for a cafe, maybe a restaurant is relevant, but probably a hotel is not so relevant. And so we may make sure we get the category right first. And then we also want to make sure the location is correct. And because we’re dealing with partners, they might give us some locations that aren’t as relevant just because we don’t give them as accurate of a location. And so we’ll kind of refine those on our side without sharing some of that information with a partner to say, you you gave us this location that’s 100 miles from the user and that’s maybe because we gave you the wrong location on purpose. And so we’re not going to show that to the user, but we will show these other locations that are actually nearby and relevant to the users. Greg: Got it. Yeah, and then, I mean, even, you know, sometimes when there is a location in the query, it could be one of those that is still ambiguous to us, right? I think a lot about the difference between Paris, Texas and Paris, France. Users don’t always clarify what they mean. So we have to try to figure that out based on context too, right? John: Exactly. even some locations that are very well defined. If somebody says New York City, that’s just one place that we’re going to look. But New York City is huge. just determining which part of New York City is maybe the most relevant to send to the user is another challenge that we have to figure out. Greg: Yeah, and I mean, just we’re sort of riffing on these now, but, you know, if you search someone searches for New York pizza, right, that could be they’re looking for a pizza restaurant in New York City, or they’re looking for a restaurant near them that serves a New York style pizza. So, yeah, all kinds of things that we have to sort of contend with and try to figure out to give those right results. I’m wondering if maybe we could talk a little bit more than about. the different types of ways we actually display the results once they appear on the page because we have a couple different versions of our local modules that we show depending on the type of result and the number of results we get back. So I’m wondering if you’d say a couple things about that. John: Yeah, we have many different ways to display based on what the user is searching for. As I mentioned earlier, we have a special address display if you’re just looking for a map given a location. That’s a pretty bare result. It’s mostly just a map and the location label. Some more popular landmarks, we have a special display for that where you’ll get the map and if it’s the Eiffel Tower or something like that. Then you’ll get a picture of the Eiffel Tower and a little description that we sourced from. Wikipedia and then there’s a business searches is the next big category and those are kind of divided into two as well if you’re searching for a very specific single business like, you know Joe’s cafe and Las Vegas I don’t think there is a Joe’s cafe in Las Vegas maybe there is Then then we’ll just show you that one Joe’s cafe ideally, you know, we don’t want to show you Bob’s cafe That’s also in Vegas or Joe’s cafe. That’s in Idaho or something Greg: There might be. John: And then there’s the sort of cate… This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit insideduckduckgo.substack.com

    • Transcript
  • May 6 · 12 min

    Duck Tales: How DuckDuckGo uses data science to measure marketing effectiveness, privately (Ep.29)

    In this episode, Cristina (CMO) and Baran (Data Science) discuss our privacy-first approach to marketing measurement, the role of incrementality, and how the team operates day to day. Disclaimers: (1) The audio, video (above), and transcript (below) are unedited and may contain minor inaccuracies or transcription errors. (2) This website is operated by Substack. This is their privacy policy. Cristina: Hi, and welcome to DuckTales, where we go behind the scenes at DuckDuckGo and discuss the stories, technology, and people that help build privacy tools for everyone. In each episode, you’ll hear from employees about our vision, product updates, engineering approach to AI, or how we operate as a company. I’m Cristina on the marketing team, and I’m here today with Baran on the data science. Would you like to say hi? Baran: Hi everyone. Cristina: So for our viewers, if you’ve already listened to episode 9 with me and Chuck, you know that, like our product philosophy, privacy is core to the ethos of our marketing. And most of the common marketing practices we just don’t do, identifying and targeting individual users, retargeting, using behavioral data, using third-party cookies and pixels, all that, all hard nos. We have very thoughtfully developed privacy-respecting measurement that is a bit unique, but includes techniques that I think and hope all marketers can adopt. Thankfully, we’ve come a long way from when I was doing the campaign analysis. And thanks to everyone’s data science background, we have much more sophisticated techniques and models. And I’d really like to dive in on a slice of that today. So first question, most companies measure their marketing through attribution, tracking who clicked on what and then installed. We sometimes do a version of when it’s possible to in aggregate and anonymously of course, but can you explain how does it work for us and is that even the right question to be asking? Baran: Yeah, thank you, Cristina. On one hand, we have a self-built, simple and privacy-respecting attribution. And on the other hand, we have a few channels who do their own attribution. But with both of them, we have three issues. One, only a small percentage of our total impact through the campaigns is captured by attribution. Let’s take the most obvious one, TV campaigns. There might be a QR code on the screen, but most people would just go to the app or Play Store to download the app instead of scanning the QR code. And then it doesn’t work on all channels. Many channels only support the industry standards, more privacy in ways of attribution methods, not necessarily what we built. And third and most importantly, which is also valid for all other companies, is attribution is not the same as incrementality. It measures who clicked, but not which channel actually caused, let’s say, a metric like an install. And the real question is actually incrementality. Cristina: Okay, so then if attribution doesn’t answer the real question, how do we introduce incrementality and how does that answer the question? Baran: So ideally it would be A-B testing for incrementality for a channel within a channel’s advertising platform. But there is no way to do this. Channels don’t provide this. It could also be because this would make it very easy for marketing teams to understand the incremental impact. The closest thing we can do is randomized GeoLift tests. Cristina: Okay, so incrementality is a concept I think a lot of marketers are likely familiar with, but to make sure everyone’s on the same page, can you walk us through what one of these tests actually looks like for us? Baran: Yeah, we can take all the geos in a country, for example, if it’s the US, we have the DMAs, they are like New York, Los Angeles, we would randomize them into two groups of test and control. While doing this randomization, we will optimize for comparability between the groups in terms of the metric that we’re interested in measuring, such as installs. And then once we have run the test, let’s say the test would be launching a campaign in the test geos, we would use the pre-period of the campaign to measure the relationship between these tests and control groups aggregated metric. And then for the campaign periods, we would use that relationship. And then based on the control geos actual metrics in the campaign periods, we would estimate what we call the counterfactual, what we expect the metric in the test group to look like in the absence of a campaign. And the difference between the actual test results minus this counterfactual would give us the causal impact. Cristina: Okay, I think that’s pretty clear. When the test is done though, what kind of answer do we get? Is it as simple as it worked or it didn’t? Baran: Yeah, so it’s not necessarily binary significant or not. In this case, unlike product tests, significant would mean the channel had a significant impact on installs. But maybe it did, but maybe it was too expensive. What matters is, for example, metrics like a cost per install and especially an uncertainty around this metric. If the uncertainty is narrow, we would have high confidence in the result. If it’s wide, we would have lower confidence and take decisions based on this uncertainty. And we do these by using Bayesian methods, which is helping with better decisions than a simple yes or no. Cristina: Got it. So if we think this is the gold standard, why isn’t everyone doing it? Baran: I think the main reason is the operational complexity. A clean test requires ideally a full turn on or off in the test or control geos, and there’s multiple parties involved in this. Let’s say you have companies with a paid search team and you’d like to do a test on the paid search channel. It would mean they would have to turn off their channel and maybe they have goals that they have to hit. Cristina: Yeah, this is an interesting peek into our culture. So can you help our viewers understand why we typically don’t have these problems? Baran: Yeah, we have a small and unified marketing team. No one person or team is controlling a single channel. There are no, let’s say, siloed budgets per channel or channel group. There are no consequences if a channel stops. Let’s say if we don’t run a certain channel anymore based on test results, the people running these channels would switch to another channel, which makes more sense. And also lacking more sophisticated attribution make it even more important to run these randomized GeoLift tests. So in this case the necessity actually becomes a strength from the marketing data science point of view. Cristina: I like the way you position that we turn a bug into a feature. We’ve had to get creative and develop marketing and data science methods that respect user privacy while still giving us the insights we need to make data driven decisions. I think it’s not just about what we do. It’s how we do it. That sets us apart. Our approach to marketing is as unique as our product philosophy. So what was it like the first time you ran one of these at DuckDuckGo? Baran: First time it was also a new experience for me, because I was also used to from previous work the operational complexity part. When we first discussed about turning off a channel, I was very amazed when the team said, okay, let’s just do it, let’s do it like this week, next week. There was no conflict, even though it was a high scale channel, nobody worried about their goals. In the end, the results were not favorable. So we ended up significantly cutting spend and optimizing the campaign from those results, and since then we repeated this approach many times. Cristina: I think that’s a great example. I like to think of us as a somewhat nimble team. And yeah, one of our core values is questioning assumptions. And this marketing experiment is a clear example of that. I really appreciate how we’re not territorial. We’re very much of all on the same team kind of mindset. So you get the results, then what happens? Bara… This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit insideduckduckgo.substack.com

    • Transcript
  • April 29 · 19 min

    Duck Tales: The fire button, a delightful way to delete your browsing data (Ep.28)

    In this episode, Beah (Chief Product Officer) and Sveta (Design) discuss the fire button, the recent redesign, and how it improves both user privacy and delight. Disclaimers: (1) The audio, video (above), and transcript (below) are unedited and may contain minor inaccuracies or transcription errors. (2) This website is operated by Substack. This is their privacy policy. Beah: Hello, welcome to Duck Tales, where we go behind the scenes at DuckDuckGo and discuss the stories, technology, the people that help build privacy tools for everyone. In each episode, you’ll hear from employees about our vision, product updates, engineering, or our approach to AI. In this episode, we’re going to talk about the fire button. And I will be your host today. My name is Bea and I’m on the product team. And we have as our guest Sveta. Sveta, do you want to just quickly introduce yourself? Sveta: Yeah, I’m Sveta. I work on mobile apps at DuckDuckGo for now five years. Beah: Sweet. Thanks. And you’ve been, you’re a designer by trade, right? Sveta: Yeah. I’m on the design team. Beah: And you’ve been doing a lot of work to improve the fire button on mobile. And so that’s what we’ll jump into today. Okay, so first of all, let’s start with the basics. Like, what is the fire button? What does it do? Sveta: Right, so the fire button is a button that’s located quite centrally in mobile UI and it looks like a fire. And when you press it, it removes, it deletes all of your tabs and all of the browsing data and all of the history. So pretty much removes everything, all of the browsing activity and you can start from clean slate. And it also shows a really cool fire animation when you do that. Beah: That seems like a good prompt to actually show it. So let me see if I can share my screen here. Can you see that, Sveta? Okay, then hopefully our audience members can as well. Alright, so this is the fire button here. I’m just on a website, on NASA’s website. I’m going to tap the fire button. And so I have, what are these two choices here? Sveta: So the first, the primary button will delete all of the tabs, all of this data for all sites. And the second button is a choice to delete activity for only this one tab. So it will close this tab and will delete all of the site data associated with the sites visited in this one tab. Beah: Alright, I’m going to choose that one here. Delete this tab. Awesome. All right. I just, I wanted to only delete the one because I also wanted to show like if you’re using, if you’re a Duck AI user, this is a new feature. But if you’re on a particular chat, for instance, a chat about what music your dog might enjoy, you can hit the fire button and now you have this opportunity or this option to just delete this chat. So remove it from your chat history. Sveta: Nice. Beah: Boom. All right. let me get it shared on. Okay, I don’t think we’re sharing anymore. Cool, so like what is the benefit of using the fire button? Sveta: Yes, the primary benefit is privacy reasons, because as you browse the internet and you visit sites, you accumulate different site data such as cookies or different user preferences that then tracking companies can, if you accumulate a lot of it, they can use it to identify you and connect your browsing activity to you. Sell that information to other companies to show you targeted ads. And our browsers, we actually block most of the trackers and most of the cookies, but there are still some cases when we can’t do it. And then that’s a good practice to delete all of this data every now and then. And then the second reason is just still schooled and it makes you, lets you start your next session from clean slate. Beah: Yeah, I like how those two, they’re like different reasons to use the fire button, but I kind of like how they converge too. Like part of what feels good about a clean slate and not having like stuff everywhere is, I think for me, like not having your data everywhere, you know? Like it’s just clean, it’s like a sense of control and I don’t know, care, I suppose, that you can apply more easily with fire button. Like you can tell me if this is how you would characterize it. Like you can delete data in most browsers, but it’s just a lot harder, right? Like you don’t have a button front and center with just the options that you need, like one or two taps away. Sveta: Exactly. It’s usually tucked like hidden somewhere in the settings. I think it’s actually pretty cool that we managed to turn this really mundane and boring technical thing in a really satisfying experience. Beah: Yeah, and one thing I didn’t show is that you can actually pick between, I think, three different animations. Like the fire is the default animation, but there’s like this kind of nice swirly animation and all like water animation. And then you can also just turn animations off if like what delights you is speed and efficiency and not an animation. That’s cool. Cool. Tell me a little bit about like how the fire button has changed over time. Sveta: Yeah, so what the confirmation that we’ve seen just now, that’s updated design that we’ve launched recently. But for years, I think since we first introduced the fire button in our mobile apps, we just had this system, little system confirmation to confirm, delete all of your tabs and data that was very small in the bottom of the screen and it was really easy to press. And it was of course good for users who were regular fire button users because it was quick. But then there was also a big risk that you could just accidentally press it and delete all of your tabs and data without intent. Beah: Yeah, so if your intent was to blow everything away all the time, fine, great, it works great for you. But if you wanted to be a little bit more surgical about it and keep some tabs around, then it neither worked for you. It didn’t really work for you, and if you accidentally used it, you might really regret it. Sveta: Yeah, we did get some that obviously there’s if you’ve accidentally deleted all of your tabs without wanting you would write us an angry feedback, which we sometimes received you open it and you see all caps that chances are from someone who just deleted their tabs. Beah: Yep. So take note, dear reader, if you are writing angry feedback, a kind human like Sveta is reading it and taking it to heart. And so in this case, what did we do about it? Sveta: So we’ve changed a lot how the confirmation dialogue looks like. It’s bigger, that you’ve seen it. It takes a lot of space on the screen, so it’s harder to miss. We’ve on purpose moved the buttons a little bit high up. So when you press the fire button and your thumb is right above the fire button, the confirmation buttons, they are not on the same spot. And there is an animation, pictogram that also attracts attention. it’s just everything is made for you to pause, read the label, and make an informed decision. And then another big change is that we’ve added a second option because before you could have only deleted everything, all of your tabs and all of your data. And now we have a second option that you can delete just one tab and the data for that tab. Beah: Yeah, yeah, I love, by the way, like, I’ve developed, you know, I’ve been using our mobile apps for a long time, but I’ve developed this kind of workflow recently now that we have the single tab, single chat burn, so handy, we have this kind of, we’re in the process of updating behavior when you open the app after an idle period, we take you to a new tab automatically, so you can just start typing your query or your chat or whatever. I like realize there are tabs that I want to keep around, the things I want to keep around, but there are a lot of things that I just want to do a quick search, a quick whatever, and it’s just, it’s throwaway. And like now I open the app, I’m in exactly where I need to be, I don’t have to think do I want a new tab or do I want to, you know, override this tab? And then like when I’m done, you know, f… This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit insideduckduckgo.substack.com

    • Transcript
Showing 1–20 of 26 episodes