Thursday, 27 September 2018

Facebook’s ex-CSO, Alex Stamos, defends its decision to inject ads in WhatsApp

Alex Stamos, Facebook’s former chief security officer, who left the company this summer to take up a role in academia, has made a contribution to what’s sometimes couched as a debate about how to monetize (and thus sustain) commercial end-to-end encrypted messaging platforms in order that the privacy benefits they otherwise offer can be as widely spread as possible.

Stamos made the comments via Twitter, where he said he was indirectly responding to the fallout from a Forbes interview with WhatsApp co-founder Brian Acton — in which Acton hit at out at his former employer for being greedy in its approach to generating revenue off of the famously anti-ads messaging platform.

Both WhatsApp founders’ exits from Facebook has been blamed on disagreements over monetization. (Jan Koum left some months after Acton.)

In the interview, Acton said he suggested Facebook management apply a simple business model atop WhatsApp, such as metered messaging for all users after a set number of free messages. But that management pushed back — with Facebook COO Sheryl Sandberg telling him they needed a monetization method that generates greater revenue “scale”.

And while Stamos has avoided making critical remarks about Acton (unlike some current Facebook staffers), he clearly wants to lend his weight to the notion that some kind of trade-off is necessary in order for end-to-end encryption to be commercially viable (and thus for the greater good (of messaging privacy) to prevail); and therefore his tacit support to Facebook and its approach to making money off of a robustly encrypted platform.

Stamos’ own departure from the fb mothership was hardly under such acrimonious terms as Acton, though he has had his own disagreements with the leadership team — as set out in a memo he sent earlier this year that was obtained by BuzzFeed. So his support for Facebook combining e2e and ads perhaps counts for something, though isn’t really surprising given the seat he occupied at the company for several years, and his always fierce defence of WhatsApp encryption.

(Another characteristic concern that also surfaces in Stamos’ Twitter thread is the need to keep the technology legal, in the face of government attempts to backdoor encryption, which he says will require “accepting the inevitable downsides of giving people unfettered communications”.)

This summer Facebook confirmed that, from next year, ads will be injected into WhatsApp statuses (aka the app’s Stories clone). So it is indeed bringing ads to the famously anti-ads messaging platform.

For several years the company has also been moving towards positioning WhatsApp as a business messaging platform to connect companies with potential customers — and it says it plans to meter those messages, also from next year.

So there are two strands to its revenue generating playbook atop WhatsApp’s e2e encrypted messaging platform. Both with knock-on impacts on privacy, given Facebook targets ads and marketing content by profiling users by harvesting their personal data.

This means that while WhatsApp’s e2e encryption means Facebook literally cannot read WhatsApp users’ messages, it is ‘circumventing’ the technology (for ad-targeting purposes) by linking accounts across different services it owns — using people’s digital identities across its product portfolio (and beyond) as a sort of ‘trojan horse’ to negate the messaging privacy it affords them on WhatsApp.

Facebook is using different technical methods (including the very low-tech method of phone number matching) to link WhatsApp user and Facebook accounts. Once it’s been able to match a Facebook user to a WhatsApp account it can then connect what’s very likely to be a well fleshed out Facebook profile with a WhatsApp account that nonetheless contains messages it can’t read. So it’s both respecting and eroding user privacy.

This approach means Facebook can carry out its ad targeting activities across both messaging platforms (as it will from next year). And do so without having to literally read messages being sent by WhatsApp users.

As trade offs go, it’s a clearly a big one — and one that’s got Facebook into regulatory trouble in Europe.

It is also, at least in Stamos’ view, a trade off that’s worth it for the ‘greater good’ of message content remaining strongly encrypted and therefore unreadable. Even if Facebook now knows pretty much everything about the sender, and can access any unencrypted messages they sent using its other social products.

In his Twitter thread Stamos argues that “if we want that right to be extended to people around the world, that means that E2E encryption needs to be deployed inside of multi-billion user platforms”, which he says means: “We need to find a sustainable business model for professionally-run E2E encrypted communication platforms.”

On the sustainable business model front he argues that two models “currently fit the bill” — either Apple’s iMessage or Facebook-owned WhatsApp. Though he doesn’t go into any detail on why he believes only those two are sustainable.

He does say he’s discounting the Acton-backed alternative, Signal, which now operates via a not-for-profit (the Signal Foundation) — suggesting that rival messaging app is “unlikely to hit 1B users”.

In passing he also throws it out there that Signal is “subsidized, indirectly, by FB ads” — i.e. because Facebook pays a licensing fee for use of the underlying Signal Protocol used to power WhatsApp’s e2e encryption. (So his slightly shade-throwing subtext is that privacy purists are still benefiting from a Facebook sugardaddy.)

Then he gets to the meat of his argument in defence of Facebook-owned (and monetized) WhatsApp — pointing out that Apple’s sustainable business model does not reach every mobile user, given its hardware is priced at a premium. Whereas WhatsApp running on a cheap Android handset ($50 or, perhaps even $30 in future) can.

Other encrypted messaging apps can also of course run on Android but presumably Stamos would argue they’re not professionally run.

“I think it is easy to underestimate how radical WhatsApp’s decision to deploy E2E was,” he writes. “Acton and Koum, with Zuck’s blessing, jumped off a bridge with the goal of building a monetization parachute on the way down. FB has a lot of money, so it was a very tall bridge, but it is foolish to expect that FB shareholders are going to subsidize a free text/voice/video global communications network forever. Eventually, WhatsApp is going to need to generate revenue.

“This could come from directly charging for the service, it could come from advertising, it could come from a WeChat-like services play. The first is very hard across countries, the latter two are complicated by E2E.”

“I can’t speak to the various options that have been floated around, or the arguments between WA and FB, but those of us who care about privacy shouldn’t see WhatsApp monetization as something evil,” he adds. “In fact, we should want WA to demonstrate that E2E and revenue are compatible. That’s the only way E2E will become a sustainable feature of massive, non-niche technology platforms.”

Stamos is certainly right that Apple’s iMessage cannot reach every mobile user, given the premium cost of Apple hardware.

Though he elides the important role that second hand Apple devices play in helping to reduce the barrier to entry to Apple’s pro-privacy technology — a role Apple is actively encouraging via support for older devices (and by its own services business expansion which extends its model so that support for older versions of iOS (and thus secondhand iPhones) is also commercially sustainable).

Robust encryption only being possible via multi-billion user platforms essentially boils down to a usability argument by Stamos — which is to suggest that mainstream app users will simply not seek encryption out unless it’s plated up for them in a way they don’t even notice it’s there.

The follow on conclusion is then that only a well-resourced giant like Facebook has the resources to maintain and serve this different tech up to the masses.

There’s certainly substance in that point. But the wider question is whether or not the privacy trade offs that Facebook’s monetization methods of WhatsApp entail, by linking Facebook and WhatsApp accounts and also, therefore, looping in various less than transparent data-harvest methods it uses to gather intelligence on web users generally, substantially erodes the value of the e2e encryption that is now being bundled with Facebook’s ad targeting people surveillance. And so used as a selling aid for otherwise privacy eroding practices.

Yes WhatsApp users’ messages will remain private, thanks to Facebook funding the necessary e2e encryption. But the price users are having to pay is very likely still their personal privacy.

And at that point the argument really becomes about how much profit a commercial entity should be able to extract off of a product that’s being marketed as securely encrypted and thus ‘pro-privacy’? How much revenue “scale” is reasonable or unreasonable in that scenario?

Other business models are possible, which was Acton’s point. But likely less profitable. And therein lies the rub where Facebook is concerned.

How much money should any company be required to leave on the table, as Acton did when he left Facebook without the rest of his unvested shares, in order to be able to monetize a technology that’s bound up so tightly with notions of privacy?

Acton wanted Facebook to agree to make as much money as it could without users having to pay it with their privacy. But Facebook’s management team said no. That’s why he’s calling them greedy.

Stamos doesn’t engage with that more nuanced point. He just writes: “It is foolish to expect that FB shareholders are going to subsidize a free text/voice/video global communications network forever. Eventually, WhatsApp is going to need to generate revenue” — thereby collapsing the revenue argument into an all or nothing binary without explaining why it has to be that way.



from Android – TechCrunch https://ift.tt/2R3iTls
via IFTTT

Facebook’s ex-CSO, Alex Stamos, defends its decision to inject ads in WhatsApp

Alex Stamos, Facebook’s former chief security officer, who left the company this summer to take up a role in academia, has made a contribution to what’s sometimes couched as a debate about how to monetize (and thus sustain) commercial end-to-end encrypted messaging platforms in order that the privacy benefits they otherwise offer can be as widely spread as possible.

Stamos made the comments via Twitter, where he said he was indirectly responding to the fallout from a Forbes interview with WhatsApp co-founder Brian Acton — in which Acton hit at out at his former employer for being greedy in its approach to generating revenue off of the famously anti-ads messaging platform.

Both WhatsApp founders’ exits from Facebook has been blamed on disagreements over monetization. (Jan Koum left some months after Acton.)

In the interview, Acton said he suggested Facebook management apply a simple business model atop WhatsApp, such as metered messaging for all users after a set number of free messages. But that management pushed back — with Facebook COO Sheryl Sandberg telling him they needed a monetization method that generates greater revenue “scale”.

And while Stamos has avoided making critical remarks about Acton (unlike some current Facebook staffers), he clearly wants to lend his weight to the notion that some kind of trade-off is necessary in order for end-to-end encryption to be commercially viable (and thus for the greater good (of messaging privacy) to prevail); and therefore his tacit support to Facebook and its approach to making money off of a robustly encrypted platform.

Stamos’ own departure from the fb mothership was hardly under such acrimonious terms as Acton, though he has had his own disagreements with the leadership team — as set out in a memo he sent earlier this year that was obtained by BuzzFeed. So his support for Facebook combining e2e and ads perhaps counts for something, though isn’t really surprising given the seat he occupied at the company for several years, and his always fierce defence of WhatsApp encryption.

(Another characteristic concern that also surfaces in Stamos’ Twitter thread is the need to keep the technology legal, in the face of government attempts to backdoor encryption, which he says will require “accepting the inevitable downsides of giving people unfettered communications”.)

This summer Facebook confirmed that, from next year, ads will be injected into WhatsApp statuses (aka the app’s Stories clone). So it is indeed bringing ads to the famously anti-ads messaging platform.

For several years the company has also been moving towards positioning WhatsApp as a business messaging platform to connect companies with potential customers — and it says it plans to meter those messages, also from next year.

So there are two strands to its revenue generating playbook atop WhatsApp’s e2e encrypted messaging platform. Both with knock-on impacts on privacy, given Facebook targets ads and marketing content by profiling users by harvesting their personal data.

This means that while WhatsApp’s e2e encryption means Facebook literally cannot read WhatsApp users’ messages, it is ‘circumventing’ the technology (for ad-targeting purposes) by linking accounts across different services it owns — using people’s digital identities across its product portfolio (and beyond) as a sort of ‘trojan horse’ to negate the messaging privacy it affords them on WhatsApp.

Facebook is using different technical methods (including the very low-tech method of phone number matching) to link WhatsApp user and Facebook accounts. Once it’s been able to match a Facebook user to a WhatsApp account it can then connect what’s very likely to be a well fleshed out Facebook profile with a WhatsApp account that nonetheless contains messages it can’t read. So it’s both respecting and eroding user privacy.

This approach means Facebook can carry out its ad targeting activities across both messaging platforms (as it will from next year). And do so without having to literally read messages being sent by WhatsApp users.

As trade offs go, it’s a clearly a big one — and one that’s got Facebook into regulatory trouble in Europe.

It is also, at least in Stamos’ view, a trade off that’s worth it for the ‘greater good’ of message content remaining strongly encrypted and therefore unreadable. Even if Facebook now knows pretty much everything about the sender, and can access any unencrypted messages they sent using its other social products.

In his Twitter thread Stamos argues that “if we want that right to be extended to people around the world, that means that E2E encryption needs to be deployed inside of multi-billion user platforms”, which he says means: “We need to find a sustainable business model for professionally-run E2E encrypted communication platforms.”

On the sustainable business model front he argues that two models “currently fit the bill” — either Apple’s iMessage or Facebook-owned WhatsApp. Though he doesn’t go into any detail on why he believes only those two are sustainable.

He does say he’s discounting the Acton-backed alternative, Signal, which now operates via a not-for-profit (the Signal Foundation) — suggesting that rival messaging app is “unlikely to hit 1B users”.

In passing he also throws it out there that Signal is “subsidized, indirectly, by FB ads” — i.e. because Facebook pays a licensing fee for use of the underlying Signal Protocol used to power WhatsApp’s e2e encryption. (So his slightly shade-throwing subtext is that privacy purists are still benefiting from a Facebook sugardaddy.)

Then he gets to the meat of his argument in defence of Facebook-owned (and monetized) WhatsApp — pointing out that Apple’s sustainable business model does not reach every mobile user, given its hardware is priced at a premium. Whereas WhatsApp running on a cheap Android handset ($50 or, perhaps even $30 in future) can.

Other encrypted messaging apps can also of course run on Android but presumably Stamos would argue they’re not professionally run.

“I think it is easy to underestimate how radical WhatsApp’s decision to deploy E2E was,” he writes. “Acton and Koum, with Zuck’s blessing, jumped off a bridge with the goal of building a monetization parachute on the way down. FB has a lot of money, so it was a very tall bridge, but it is foolish to expect that FB shareholders are going to subsidize a free text/voice/video global communications network forever. Eventually, WhatsApp is going to need to generate revenue.

“This could come from directly charging for the service, it could come from advertising, it could come from a WeChat-like services play. The first is very hard across countries, the latter two are complicated by E2E.”

“I can’t speak to the various options that have been floated around, or the arguments between WA and FB, but those of us who care about privacy shouldn’t see WhatsApp monetization as something evil,” he adds. “In fact, we should want WA to demonstrate that E2E and revenue are compatible. That’s the only way E2E will become a sustainable feature of massive, non-niche technology platforms.”

Stamos is certainly right that Apple’s iMessage cannot reach every mobile user, given the premium cost of Apple hardware.

Though he elides the important role that second hand Apple devices play in helping to reduce the barrier to entry to Apple’s pro-privacy technology — a role Apple is actively encouraging via support for older devices (and by its own services business expansion which extends its model so that support for older versions of iOS (and thus secondhand iPhones) is also commercially sustainable).

Robust encryption only being possible via multi-billion user platforms essentially boils down to a usability argument by Stamos — which is to suggest that mainstream app users will simply not seek encryption out unless it’s plated up for them in a way they don’t even notice it’s there.

The follow on conclusion is then that only a well-resourced giant like Facebook has the resources to maintain and serve this different tech up to the masses.

There’s certainly substance in that point. But the wider question is whether or not the privacy trade offs that Facebook’s monetization methods of WhatsApp entail, by linking Facebook and WhatsApp accounts and also, therefore, looping in various less than transparent data-harvest methods it uses to gather intelligence on web users generally, substantially erode the value of the e2e encryption that is now being packaged alongside Facebook’s ad targeting people surveillance.

And, well, used as a selling aid for its otherwise privacy eroding practices.

Yes WhatsApp users’ messages will remain private, thanks to Facebook funding the necessary e2e encryption. But the price users are having to pay is very likely still their personal privacy.

And at that point the argument really becomes about how much profit a commercial entity should be able to extract off of a product that’s being marketed as securely encrypted and thus ‘pro-privacy’? How much revenue “scale” is reasonable or unreasonable in that scenario?

Other business models are possible, which was Acton’s point. But likely less profitable. And therein lies the rub where Facebook is concerned.

How much money should any company be required to leave on the table, as Acton did when he left Facebook without the rest of his unvested shares, in order to be able to monetize a technology that’s bound up so tightly with notions of privacy?

Acton wanted Facebook to agree to make as much money as it could without users having to pay it with their privacy. But Facebook’s management team said no. That’s why he’s calling them greedy.

Stamos doesn’t engage with that more nuanced point. He just writes: “It is foolish to expect that FB shareholders are going to subsidize a free text/voice/video global communications network forever. Eventually, WhatsApp is going to need to generate revenue” — thereby collapsing the revenue argument into an all or nothing binary without explaining why it has to be that way.



from Apple – TechCrunch https://ift.tt/2R3iTls

Wednesday, 26 September 2018

See the new iPhone’s ‘focus pixels’ up close

The new iPhones have excellent cameras, to be sure. But it’s always good to verify Apple’s breathless onstage claims with first-hand reports. We have our own review of the phones and their photography systems, but teardowns provide the invaluable service of letting you see the biggest changes with your own eyes — augmented, of course, by a high-powered microscope.

We’ve already seen iFixit’s solid-as-always disassembly of the phone, but TechInsights gets a lot closer to the device’s components — including the improved camera of the iPhone XS and XS Max.

Although the optics of the new camera are as far as we can tell unchanged since the X, the sensor is a new one and is worth looking closely at.

Microphotography of the sensor die show that Apple’s claims are borne out and then some. The sensor size has increased from 32.8mm2 to 40.6mm2 — a huge difference despite the small units. Every tiny bit counts at this scale. (For comparison, the Galaxy S9 is 45mm2, and the soon-to-be-replaced Pixel 2 is 25mm2.)

The pixels themselves also, as advertised, grew from 1.22 microns (micrometers) across to 1.4 microns — which should help with image quality across the board. But there’s an interesting, subtler development that has continually but quietly changed ever since its introduction: the “focus pixels.”

That’s Apple’s brand name for phase detection autofocus (PDAF) points, found in plenty of other devices. The basic idea is that you mask off half a sub-pixel every once in a while (which I guess makes it a sub-sub-pixel), and by observing how light enters these half-covered detectors you can tell whether something is in focus or not.

Of course, you need a bunch of them to sense the image patterns with high fidelity, but you have to strike a balance: losing half a pixel may not sound like much, but if you do it a million times, that’s half a megapixel effectively down the drain. Wondering why all the PDAF points are green? Many camera sensors use an “RGBG” sub-pixel pattern, meaning there are two green sub-pixels for each red and blue one — it’s complicated why. But there are twice as many green sub-pixels and therefore the green channel is more robust to losing a bit of information.Apple introduced PDAF in the iPhone 6, but as you can see in TechInsights’ great diagram, the points are pretty scarce. There’s one for maybe every 64 sub-pixels, and not only that, they’re all masked off in the same orientation: either the left or right half gone.

The 6S and 7 Pluses saw the number double to one PDAF point per 32 sub-pixels. And in the 8 Plus, the number is improved to one per 20 — but there’s another addition: now the phase detection masks are on the tops and bottoms of the sub-pixels as well. As you can imagine, doing phase detection in multiple directions is a more sophisticated proposal, but it could also significantly improve the accuracy of the process. Autofocus systems all have their weaknesses, and this may have addressed one Apple regretted in earlier iterations.

Which brings us to the XS (and Max, of course), in which the PDAF points are now one per 16 sub-pixels, having increased the frequency of the vertical phase detection points so that they’re equal in number to the horizontal one. Clearly the experiment paid off and any consequent light loss has been mitigated or accounted for.

I’m curious how the sub-pixel patterns of Samsung, Huawei and Google phones compare, and I’m looking into it. But I wanted to highlight this interesting little evolution. It’s an interesting example of the kind of changes that are hard to understand when explained in simple number form — we’ve doubled this, or there are a million more of that — but which make sense when you see them in physical form.



from Apple – TechCrunch https://ift.tt/2DDdoqK

In Senate hearing, tech giants push lawmakers for federal privacy rules

Another day, another hearing of tech giants in Congress.

Wednesday’s hearing at the Senate Commerce Committee with Apple, Amazon, Google and Twitter, alongside AT&T and Charter, marked the latest in a string of hearings in the past few months into all things tech: but mostly controversies embroiling the companies, from election meddling to transparency.

This time, privacy was at the top of the agenda. The problem, lawmakers say, is that consumers have little of it. The hearing said that the U.S. was lagging behind Europe’s new GDPR privacy rules and California’s recently passed privacy law, which goes into effect in 2020, and lawmakers were edging toward introducing their own federal privacy law.

Here are the key takeaways.

Tech giants want new federal legislation, if not just to upend California’s privacy law

For once, the tech giants seemed to agree with one another.

AT&T, Apple, Charter and Google used their time in the Senate to call on lawmakers to introduce new federal privacy legislation. Tech companies spent the past year pushing back against the new state regulations, but have conceded that new privacy rules are inevitable.

Now the companies realize that it’s better to sit at the table to influence a federal privacy law than stand outside in the cold.

In pushing for a new federal law, representatives from each company confirmed that they support the preemption of California’s new rules — something that critics oppose.

AT&T’s chief lawyer Len Cali said that a patchwork of state laws would be unworkable. Apple, too, agreed to support a privacy law, but noted as a company that doesn’t hoard user data for advertising — like Facebook and Google — that any federal law would need to put a premium on protecting the consumer rather than helping companies make money.

But Amazon’s chief lawyer Andrew DeVore said that complying with privacy rules has “required us to divert significant resources to administrative tasks and away from invention.”

Sen. John Thune (R-SD) asked the representatives why lawmakers shouldn’t adopt the same standards seen in Europe and California at a federal level, but none of the companies could answer.

“That question lingers here,” said Thune. “The opposition that you’ve expressed to these rules is one that can nonetheless accommodate the kind of rules that we’ve seen in GDPR and California.”

Google made “mistakes” on privacy, but evades China search questioning

Google took a rare moment to admit it hasn’t always taken the right approach to privacy — though, it wouldn’t point to any specific incident.

“We acknowledge that we have made mistakes in the past, from which we have learned, and improved our robust privacy program,” Keith Enright, Google’s chief privacy officer, said in his opening statement.

But that, lawmakers said, contrasted with recent reports of the company’s return to China — almost a decade after it pulled out of the country after allegations of Chinese efforts to hack into the search giant’s systems and ethical conflicts with China’s censorship policies.

Google reportedly began working on “Dragonfly,” a China-focused search engine that would block certain keywords to fall in line with China’s censorship rules. The effort has been widely decried by human rights groups, and led to a high-profile resignation.

Prior to the Senate hearing, a former Google engineer sent a letter to the committee asking lawmakers to pressure Enright to respond.

Google to date has refused to confirm or comment on the reports, but Enright said that “there is a Project Dragonfly.”

“We are not close to launching a search product in China,” he said, in response to one lawmaker. Later, he said that he didn’t think the company “could or would launch a product” without including its privacy and security policies.

Startups might struggle under GDPR-ported rules, companies claim

Startups and small businesses with slimmer resources than the tech giants could be a major casualty if GDPR-like rules were ported into federal law.

Enright said that ensuring compliance under GDPR was complicated and costly, but wouldn’t put a figure on how much Google had spent on complying with GDPR when asked by one lawmaker. Enright suggested that it was likely in the millions of dollars.

But even larger companies like Charter, which are wholly U.S.-based and have no European presence, said they wouldn’t know how they would be affected if GDPR principles were ported over stateside.

Charter’s policy chief Rachel Welch said that the U.S. should “put its own stamp” and not just roll over GDPR principles.

Apple added that self-employed developers and software house startups could suffer under new federal privacy rules. The company has some 20 million developers that rely on its app store to sell their software. “Small companies don’t have teams of lawyers to draft things,” said Apple’s Bud Tribble, and asked that any new federal rules should consider startups “to help make things clear and so that businesses have one set of rules than many sets of rules to follow.”

It’s a line parroted by tech giants before and without much evidence to back it up. Although some companies have shuttered operations in Europe, other startups hit the deadline and continue to thrive.

Sen. Jerry Moran (R-KS) called for greater representation from startups to help understand the cost breakdowns to understand it better.

Thune said that the committee won’t “rush through” legislation, and will ask privacy advocates for their input in a coming hearing.



from Apple – TechCrunch https://ift.tt/2QZjGUi

Tuesday, 25 September 2018

See the new iPhone’s ‘focus pixels’ up close

The new iPhones have excellent cameras, to be sure. But it’s always good to verify Apple’s breathless onstage claims with first-hand reports. We have our own review of the phones and their photography systems, but teardowns provide the invaluable service of letting you see the biggest changes with your own eyes — augmented, of course, by a high-powered microscope.

We’ve already seen iFixit’s solid-as-always disassembly of the phone, but TechInsights gets a lot closer to the device’s components — including the improved camera of the iPhone XS and XS Max.

Although the optics of the new camera are as far as we can tell unchanged since the X, the sensor is a new one and is worth looking closely at.

Microphotography of the sensor die show that Apple’s claims are borne out and then some. The sensor size has increased from 32.8mm2 to 40.6mm2 — a huge difference despite the small units. Every tiny bit counts at this scale. (For comparison, the Galaxy S9 is 45mm2, and the soon-to-be-replaced Pixel 2 is 25mm2.)

The pixels themselves also, as advertised, grew from 1.22 microns (micrometers) across to 1.4 microns — which should help with image quality across the board. But there’s an interesting, subtler development that has continually but quietly changed ever since its introduction: the “focus pixels.”

That’s Apple’s brand name for phase detection autofocus (PDAF) points, found in plenty of other devices. The basic idea is that you mask off half a sub-pixel every once in a while (which I guess makes it a sub-sub-pixel), and by observing how light enters these half-covered detectors you can tell whether something is in focus or not.

Of course, you need a bunch of them to sense the image patterns with high fidelity, but you have to strike a balance: losing half a pixel may not sound like much, but if you do it a million times, that’s half a megapixel effectively down the drain. Wondering why all the PDAF points are green? Many camera sensors use an “RGBG” sub-pixel pattern, meaning there are two green sub-pixels for each red and blue one — it’s complicated why. But there are twice as many green sub-pixels and therefore the green channel is more robust to losing a bit of information.Apple introduced PDAF in the iPhone 6, but as you can see in TechInsights’ great diagram, the points are pretty scarce. There’s one for maybe every 64 sub-pixels, and not only that, they’re all masked off in the same orientation: either the left or right half gone.

The 6S and 7 Pluses saw the number double to one PDAF point per 32 sub-pixels. And in the 8 Plus, the number is improved to one per 20 — but there’s another addition: now the phase detection masks are on the tops and bottoms of the sub-pixels as well. As you can imagine, doing phase detection in multiple directions is a more sophisticated proposal, but it could also significantly improve the accuracy of the process. Autofocus systems all have their weaknesses, and this may have addressed one Apple regretted in earlier iterations.

Which brings us to the XS (and Max, of course), in which the PDAF points are now one per 16 sub-pixels, having increased the frequency of the vertical phase detection points so that they’re equal in number to the horizontal one. Clearly the experiment paid off and any consequent light loss has been mitigated or accounted for.

I’m curious how the sub-pixel patterns of Samsung, Huawei and Google phones compare, and I’m looking into it. But I wanted to highlight this interesting little evolution. It’s an interesting example of the kind of changes that are hard to understand when explained in simple number form — we’ve doubled this, or there are a million more of that — but which make sense when you see them in physical form.



from iPhone – TechCrunch https://ift.tt/2DDdoqK

The new era in mobile

A future dominated by autonomous vehicles (AVs) is, for many experts, a foregone conclusion. Declarations that the automobile will become the next living room are almost as common — but, they are imprecise. In our inevitable driverless future, the more apt comparison is to the mobile device. As with smartphones, operating systems will go a long way toward determining what autonomous vehicles are and what they could be. For mobile app companies trying to seize on the coming AV opportunity, their future depends on how the OS landscape shapes up.

By most measures, the mobile app economy is still growing, yet the time people spend using their apps is actually starting to dip. A recent study reported that overall app session activity grew only 6 percent in 2017, down from the 11 percent growth it reported in 2016. This trend suggests users are reaching a saturation point in terms of how much time they can devote to apps. The AV industry could reverse that. But just how mobile apps will penetrate this market and who will hold the keys in this new era of mobility is still very much in doubt.

When it comes to a driverless future, multiple factors are now converging. Over the last few years, while app usage showed signs of stagnation, the push for driverless vehicles has only intensified. More cities are live-testing driverless software than ever, and investments in autonomous vehicle technology and software by tech giants like Google and Uber (measured in the billions) are starting to mature. And, after some reluctance, automakers have now embraced this idea of a driverless future. Expectations from all sides point to a “passenger economy” of mobility-as-a-service, which, by some estimates, may be worth as much as $7 trillion by 2050.

For mobile app companies this suggests several interesting questions: Will smart cars, like smartphones before them, be forced to go “exclusive” with a single OS of record (Google, Apple, Microsoft, Amazon/AGL), or will they be able to offer multiple OS/platforms of record based on app maturity or functionality? Or, will automakers simply step in to create their own closed loop operating systems, fragmenting the market completely?

Automakers and tech companies clearly recognize the importance of “connected mobility.”

Complicating the picture even further is the potential significance of an OS’s ability to support multiple Digital Assistants of Record (independent of the OS), as we see with Google Assistant now working on iOS. Obviously, voice NLP/U will be even more critical for smart car applications as compared to smart speakers and phones. Even in those established arenas the battle for OS dominance is only just beginning. Opening a new front in driverless vehicles could have a fascinating impact. Either way, the implications for mobile app companies are significant.

Looking at the driverless landscape today there are several indications as to which direction the OSes in AVs will ultimately go. For example, after some initial inroads developing their own fleet of autonomous vehicles, Google has now focused almost all its efforts on autonomous driving software while striking numerous partnership deals with traditional automakers. Some automakers, however, are moving forward developing their own OSes. Volkswagen, for instance, announced that vw.OS will be introduced in VW brand electric cars from 2020 onward, with an eye toward autonomous driving functions. (VW also plans to launch a fleet of autonomous cars in 2019 to rival Uber.) Tesla, a leader in AV, is building its own unified hardware-software stack. Companies like Udacity, however, are building an “open-source” self-driving car tech. Mobileye and Baidu have a partnership in place to provide software for automobile manufacturers.

Clearly, most smartphone apps would benefit from native integration, but there are several categories beyond music, voice and navigation that require significant hardware investment to natively integrate. Will automakers be interested in the Tesla model? If not, how will smart cars and apps (independent of OS/voice assistant) partner up? Given the hardware requirements necessary to enable native app functionality and optimal user experience, how will this force smart car manufacturers to work more seamlessly with platforms like AGL to ensure competitive advantage and differentiation? And, will this commoditize the OS dominance we see in smartphones today?

It’s clearly still early days and — at least in the near term — multiple OS solutions will likely be employed until preferred solutions rise to the top. Regardless, automakers and tech companies clearly recognize the importance of “connected mobility.” Connectivity and vehicular mobility will very likely replace traditional auto values like speed, comfort and power. The combination of Wi-Fi hotspot and autonomous vehicles (let alone consumer/business choice of on-demand vehicles) will propel instant conversion/personalization of smart car environments to passenger preferences. And, while questions remain around the how and the who in this new era in mobile, it’s not hard to see the why.

Americans already spend an average of 293 hours per year inside a car, and the average commute time has jumped around 20 percent since 1980. In a recent survey (conducted by Ipsos/GenPop) researchers found that in a driverless future people would spend roughly a third of the time communicating with friends and family or for business and online shopping. By 2030, it’s estimated the autonomous cars “will free up a mind-blowing 1.9 trillion minutes for passengers.” Another analysis suggested that even with just 10 percent adoption, driverless cars could account for $250 billion in driver productivity alone.

Productivity in this sense extends well beyond personal entertainment and commerce and into the realm of business productivity. Use of integrated display (screen and heads-up) and voice will enable business multi-tasking from video conferencing, search, messaging, scheduling, travel booking, e-commerce and navigation. First-mover advantage goes to the mobile app companies that first bundle into a single compelling package information density, content access and mobility. An app company that can claim 10 to 15 percent of this market will be a significant player.

For now, investors are throwing lots of money at possible winners in the autonomous automotive race, who, in turn, are beginning to define the shape of the mobile app landscape in a driverless future. In fact, what we’re seeing now looks a lot like the early days of smartphones with companies like Tesla, for example, applying an Apple-esque strategy for smart car versus smartphone. Will these OS/app marketplaces be dominated by a Tesla — or Google (for that matter) — and command a 30 percent revenue share from apps, or will auto manufacturers with proprietary platforms capitalize on this opportunity? Questions like these — while at the same time wondering just who the winners and losers in AV will be — mean investment and entrepreneurship in the mobile app sector is an extremely lucrative but risky gamble.



from Apple – TechCrunch https://ift.tt/2Ohn6Uc

Qualcomm doubles down on claims that Apple stole chip secrets for Intel

If you happen to crack open that fancy little iPhone XS casing on your new phone, you’ll notice that there’s a dwindling amount of Qualcomm chips in there and that they’re increasingly being replaced by Intel hardware.

The swap is representative of the cooling state of affairs between the two as the companies’ legal teams battle over Apple’s refusal to pay royalties that Qualcomm claims it is owed. Today, Qualcomm doubled down on its claims that Apple was stealing chip secrets from Qualcomm tech and feeding it to Intel engineers.

CNBC reports:

Qualcomm has unveiled explosive charges against Apple for stealing “vast swaths” of its confidential information and trade secrets for the purpose of improving the performance of chip sets provided by Qualcomm competitor Intel, according to a filing with the Superior Court of California.

The allegations are contained in a complaint that Qualcomm hopes the court will amend to its existing lawsuit against Apple for breaching the so called master software agreement that Apple signed when it became a customer of Qualcomm’s earlier this decade.

The newly filed documents amend an earlier suit by the company, claiming that Intel engineers working with Apple have been using Qualcomm source code.



from Apple – TechCrunch https://ift.tt/2Q2iMVZ