Placeholder Content Image

How AI is hijacking art history

<p>People tend to rejoice in the disclosure of a secret. </p> <p>Or, at the very least, media outlets have come to realize that news of “mysteries solved” and “hidden treasures revealed” generate traffic and clicks. </p> <p>So I’m never surprised when I see AI-assisted revelations about famous masters’ works of art go viral. </p> <p>Over the past year alone, I’ve come across articles highlighting how artificial intelligence <a href="https://www.theguardian.com/artanddesign/2021/jun/06/modigliani-lost-lover-beatrice-hastings">recovered a “secret” painting</a> of a “lost lover” of Italian painter Modigliani, <a href="https://www.cnn.com/style/article/hidden-picasso-nude-scli-intl-gbr/index.html">“brought to life” a “hidden Picasso nude”</a>, <a href="https://www.smithsonianmag.com/smart-news/klimt-painting-restore-artificial-intelligence-color-faculty-paintings-180978843/">“resurrected” Austrian painter Gustav Klimt’s destroyed works</a> and <a href="https://www.bbc.com/news/technology-57588270">“restored” portions of Rembrandt’s 1642 painting “The Night Watch.”</a> <a href="https://www.sciencedaily.com/releases/2019/08/190830150738.htm">The list goes on</a>.</p> <p><a href="https://www.umass.edu/arthistory/member/sonja-drimmer">As an art historian</a>, I’ve become increasingly concerned about the coverage and circulation of these projects.</p> <p>They have not, in actuality, revealed one secret or solved a single mystery. </p> <p>What they have done is generate feel-good stories about AI.</p> <h2>Are we actually learning anything new?</h2> <p>Take the reports about the Modigliani and Picasso paintings. </p> <p>These were projects executed by the same company, <a href="https://www.oxia-palus.com/">Oxia Palus</a>, which was founded not by art historians but by doctoral students in machine learning.</p> <p>In both cases, Oxia Palus relied upon traditional X-rays, X-ray fluorescence and infrared imaging that had already been <a href="https://www.metmuseum.org/art/metpublications/Picasso_in_The_Metropolitan_Museum_of_Art">carried out and published</a> <a href="https://www.theguardian.com/artanddesign/2018/feb/28/modigliani-portrait-comes-to-light-beneath-artists-later-picture">years prior</a> – work that had revealed preliminary paintings beneath the visible layer on the artists’ canvases. </p> <p>The company edited these X-rays and <a href="https://arxiv.org/abs/1909.05677">reconstituted them as new works of art</a> by applying a technique called “<a href="https://arxiv.org/pdf/1508.06576.pdf">neural style transfer</a>.” This is a sophisticated-sounding term for a program that breaks works of art down into extremely small units, extrapolates a style from them and then promises to recreate images of other content in that same style.</p> <p>Essentially, Oxia Palus stitches new works out of what the machine can learn from the existing X-ray images and other paintings by the same artist. </p> <p>But outside of flexing the prowess of AI, is there any value – artistically, historically – to what the company is doing?</p> <p>These recreations don’t teach us anything we didn’t know about the artists and their methods. </p> <p>Artists paint over their works all the time. It’s so common that art historians and conservators have a word for it: <a href="https://www.nationalgallery.org.uk/paintings/glossary/pentimento">pentimento</a>. None of these earlier compositions was an Easter egg deposited in the painting for later researchers to discover. The original X-ray images were certainly valuable in that they <a href="https://www.academia.edu/40255609/The_Getty_Conservation_Institute_From_Connoisseurship_to_Technical_Art_History_The_Evolution_of_the_Interdisciplinary_Study_of_Art">offered insights into artists’ working methods</a>.</p> <p>But to me, what these programs are doing isn’t exactly newsworthy from the perspective of art history.</p> <h2>The humanities on life support</h2> <p>So when I do see these reproductions attracting media attention, it strikes me as soft diplomacy for AI, showcasing a “cultured” application of the technology at a time when skepticism of its <a href="https://www.theguardian.com/technology/2020/jan/13/what-are-deepfakes-and-how-can-you-spot-them">deceptions</a>, <a href="https://nyupress.org/9781479837243/algorithms-of-oppression/">biases</a> and <a href="https://www.wiley.com/en-us/Race+After+Technology:+Abolitionist+Tools+for+the+New+Jim+Code-p-9781509526437">abuses</a> is on the rise.</p> <p>When AI gets attention for recovering lost works of art, it makes the technology sound a lot less scary than when it garners headlines <a href="https://www.cbsnews.com/news/deepfake-artificial-intelligence-60-minutes-2021-10-10/">for creating deep fakes that falsify politicians’ speech</a>or <a href="https://www.politico.eu/article/the-rise-of-ai-surveillance-coronavirus-data-collection-tracking-facial-recognition-monitoring/">for using facial recognition for authoritarian surveillance</a>. </p> <p>These studies and projects also seem to promote the idea that computer scientists are more adept at historical research than art historians. </p> <p>For years, university humanities departments <a href="https://carrollnews.org/3680/campus/art-history-department-to-be-eliminated-tenured-faculty-receive-termination-notices/">have been gradually squeezed of funding</a>, with more money funneled into the sciences. With their claims to objectivity and empirically provable results, the sciences tend to command greater respect from funding bodies and the public, which offers an incentive to scholars in the humanities to adopt computational methods. </p> <p>Art historian Claire Bishop <a href="https://journals.ub.uni-heidelberg.de/index.php/dah/article/view/49915">criticized this development</a>, noting that when computer science becomes integrated in the humanities, “[t]heoretical problems are steamrollered flat by the weight of data,” which generates deeply simplistic results. </p> <p>At their core, art historians study the ways in which art can offer insights into how people once saw the world. They explore how works of art shaped the worlds in which they were made and would go on to influence future generations. </p> <p>A computer algorithm cannot perform these functions.</p> <p>However, some scholars and institutions have allowed themselves to be subsumed by the sciences, adopting their methods and partnering with them in sponsored projects. </p> <p>Literary critic Barbara Herrnstein Smith <a href="https://www.jstor.org/stable/10.3366/j.ctt1r2bq2.9?seq=1#metadata_info_tab_contents">has warned about ceding too much ground to the sciences</a>. In her view, the sciences and the humanities are not the polar opposites they are often publicly portrayed to be. But this portrayal has been to the benefit of the sciences, prized for their supposed clarity and utility over the humanities’ alleged obscurity and uselessness. At the same time, she <a href="https://doi.org/10.1215/0961754X-3622212">has suggested</a> that hybrid fields of study that fuse the arts with the sciences may lead to breakthroughs that wouldn’t have been possible had each existed as a siloed discipline. </p> <p>I’m skeptical. Not because I doubt the utility of expanding and diversifying our toolbox; to be sure, some <a href="http://www.mappingsenufo.org/">scholars working in the digital humanities</a> have taken up computational methods with subtlety and historical awareness to add nuance to or overturn entrenched narratives.</p> <p>But my lingering suspicion emerges from an awareness of how public support for the sciences and disparagement of the humanities means that, in the endeavor to gain funding and acceptance, the humanities will lose what makes them vital. The field’s sensitivity to historical particularity and cultural difference makes the application of the same code to widely diverse artifacts utterly illogical. </p> <p>How absurd to think that black-and-white photographs from 100 years ago would produce colors in the same way that digital photographs do now. And yet, this is exactly what <a href="https://hyperallergic.com/639395/the-limits-of-colorization-of-historical-images-by-ai/">AI-assisted colorization</a> does. </p> <p>That particular example might sound like a small qualm, sure. But this effort to “<a href="https://deepai.org/machine-learning-model/colorizer">bring events back to life</a>” routinely mistakes representations for reality. Adding color does not show things as they were but recreates what is already a recreation – a photograph – in our own image, now with computer science’s seal of approval.</p> <h2>Art as a toy in the sandbox of scientists</h2> <p>Near the conclusion of <a href="https://doi.org/10.1126/sciadv.aaw7416">a recent paper</a> devoted to the use of AI to disentangle X-ray images of Jan and Hubert van Eyck’s “<a href="https://www.getty.edu/foundation/initiatives/past/panelpaintings/panel_paintings_ghent.html">Ghent Altarpiece</a>,” the mathematicians and engineers who authored it refer to their method as relying upon “choosing ‘the best of all possible worlds’ (borrowing Voltaire’s words) by taking the first output of two separate runs, differing only in the ordering of the inputs.” </p> <p>Perhaps if they had familiarized themselves with the humanities more they would know how satirically those words were meant when Voltaire <a href="https://brill.com/view/title/20877">used them to mock a philosopher</a> who believed that rampant suffering and injustice were all part of God’s plan – that the world as it was represented the best we could hope for.</p> <p>Maybe this “gotcha” is cheap. But it illustrates the problem of art and history becoming toys in the sandboxes of scientists with no training in the humanities.</p> <p>If nothing else, my hope is that journalists and critics who report on these developments will cast a more skeptical eye on them and alter their framing. </p> <p>In my view, rather than lionizing these studies as heroic achievements, those responsible for conveying their results to the public should see them as opportunities to question what the computational sciences are doing when they appropriate the study of art. And they should ask whether any of this is for the good of anyone or anything but AI, its most zealous proponents and those who profit from it.</p> <p><em>Image credits: Getty Images</em></p> <p><em>This article originally appeared on <a href="https://theconversation.com/how-ai-is-hijacking-art-history-170691" target="_blank" rel="noopener">The Conversation</a>. </em></p>

Art

Placeholder Content Image

D.B. Cooper, the changing nature of hijackings and the foundation for today’s airport security

<p>Though many Americans may associate airport security with 9/11, it was a wave of hijackings in the late 1960s and early 1970s that laid the foundation <a href="https://theconversation.com/an-entire-generation-of-americans-has-no-idea-how-easy-air-travel-used-to-be-166082">for today’s airport security protocols</a>.</p> <p>During that period, a hijacking occurred, on average, <a href="https://today.ku.edu/2019/06/10/first-soviet-hijacking-triggers-insights-cold-war-boundaries">once every five days globally</a>. The U.S. dealt with its own spate of mile-high crimes, convincing reluctant government officials and airport executives to adopt the first important airport security protocols.</p> <p>The subject of <a href="https://www.imdb.com/title/tt21063148/?ref_=nv_sr_srsg_0">a new Netflix docuseries</a>, hijacker D.B. Cooper emerged as something of a folk hero during this era. While other more violent hijackings might have played a bigger role in prompting early airport security measures, it was the saga of Cooper that captured the imagination of the American public – and helped transform the perception of the overall threat hijackings posed to U.S. air travel and national security.</p> <h2>Incidents become impossible to ignore</h2> <p>The first airplane hijacking happened in <a href="https://www.britannica.com/topic/hijacking">1931 in Peru</a>. Armed revolutionaries approached the grounded plane of pilot Byron Richards and demanded that he fly them over Lima so they could drop propaganda leaflets. Richards refused, and a 10-day standoff ensued before he was eventually released.</p> <p>That remained a somewhat isolated incident until the <a href="https://en.wikipedia.org/wiki/List_of_aircraft_hijackings">late 1940s and 1950s</a>, when several people hijacked airplanes to escape from Eastern Europe to the West. In the context of the Cold War, Western governments granted these hijackers <a href="https://www.ojp.gov/ncjrs/virtual-library/abstracts/hijacking-and-right-asylum-aerial-piracy-and-international-law-p">political asylum</a>. Importantly, none of the airplanes hijacked were flown by U.S. carriers.</p> <p>Beginning in the early 1960s, however, hijackers began targeting U.S. airlines. Most of these individuals were <a href="https://www.tsi-mag.com/the-cuban-hijackings-their-significance-and-impact-sixty-years-on/">Cubans</a> living in the U.S. who, for one reason or another, wished to return to their native land and were otherwise blocked due to <a href="https://www.thecubareader.com/blog/the-strange-story-of-the-us-cuba-hijacking-accord">the U.S. embargo</a> against Cuba.</p> <p>U.S. officials responded by <a href="https://www.law.cornell.edu/uscode/text/49/46502">officially and specifically making hijacking a federal crime</a>. Though the new law didn’t stop hijackings altogether, the crime remained relatively rare. When they did occur, they usually didn’t involve much violence.</p> <p><a href="https://www.aerotime.aero/articles/15042-take-me-to-cuba-the-skyjacking-craze-of-the-1960s">Officials wanted to downplay hijackings as much as possible</a>, and the best way to do this was to simply give the hijacker what they wanted to avert the loss of life. Above all, airline executives wanted to avoid deterring people from flying, so they resisted the implementation of anxiety-inducing security protocols.</p> <p>That changed in 1968. On July 23 of that year, members of the Popular Front for the Liberation of Palestine <a href="https://www.jpost.com/israel-news/on-this-day-el-al-flight-426-hijacked-by-pflp-674735">hijacked an El Al flight</a> from Rome to Tel Aviv. Though that 39-day ordeal ended without any loss of life, it ushered in a new era of more violent – often politically motivated – hijackings of international airlines.</p> <p>From 1968 to 1974, U.S. airlines experienced <a href="https://www.vox.com/2016/3/29/11326472/hijacking-airplanes-egyptair">130 hijackings</a>. Many fell into this new category of politically motivated hijackings, including what has become known as the <a href="https://www.hsdl.org/c/tl/dawsons-field-hijackings/">Dawson’s Field hijackings</a>. In September 1970, the Popular Front for the Liberation of Palestine hijacked four aircraft, including three belonging to U.S. carriers, and forced them to land at Dawson’s Field in Libya. No hostage lives were lost, but the hijackers used explosives to destroy all four aircraft.</p> <p>Additionally, and more worrying to U.S. officials, two different groups of hijackers, <a href="https://www.latimes.com/archives/la-xpm-2001-sep-23-mn-48746-story.html">one in 1971</a> and <a href="https://www.freep.com/story/news/local/michigan/detroit/2016/06/06/detroit-skyjacker-airplane-explanation/85314438/">another in 1972</a>, threatened to crash planes into nuclear power plants.</p> <h2>Cooper inspires copycats</h2> <p>Amid this dramatic rise in the number of hijackings, on Nov. 24, 1971, a man known to the American public as <a href="https://www.fbi.gov/history/famous-cases/db-cooper-hijacking">D.B. Cooper</a> boarded a Northwest Orient 727 flight from Portland, Oregon, to Seattle. Shortly after takeoff, he showed a stewardess the contents of his briefcase, which he said was a bomb. He then instructed the stewardess to take a note to the cockpit. In it, he demanded US$200,000 in $20 bills and four parachutes.</p> <p>Upon arrival in Seattle, Cooper allowed the other passengers to deplane in exchange for the money and the parachutes. Cooper then ordered the pilot to fly to Mexico but low and slowly – <a href="https://www.biography.com/crime-figure/db-cooper">no higher than 10,000 feet (3,048 meters) and under 200 knots (230 mph, 370 kph)</a>. Somewhere between Seattle and a fuel stop in Reno, Nevada, Cooper and the loot disappeared out the back of the aircraft via the 727’s <a href="https://saverocity.com/taggingmiles/wp-content/uploads/sites/16/2016/07/727-Aft-Stairs.jpg">aft stairwell</a>. No one knows for sure what happened to him, though some of the money was recovered in 1980.</p> <p>Cooper wasn’t the first person to hijack an American airliner and demand money. That dubious honor belongs to <a href="https://content.time.com/time/subscriber/article/0,33009,909374,00.html">Arthur Barkley</a>. Frustrated with his inability to get government officials to take seriously his dispute with the IRS, on June 4, 1970, Barkley hijacked a TWA aircraft, demanding $100 million and a hearing before the U.S. Supreme Court. Barkley’s efforts failed, and he ended up confined to a mental institution.</p> <p>The idea that Cooper might have succeeded, however, clearly inspired several imitators. While it remains uncertain whether Cooper lived to enjoy the fruits of his escapade, none of his imitators did. They included <a href="https://www.fbi.gov/history/famous-cases/richard-floyd-mccoy-jr">Richard McCoy, Jr.</a>, <a href="https://www.stltoday.com/news/local/metro/article_1aac5de6-6eb4-5245-a126-7adf324d5eb2.html">Martin J. McNally</a> and <a href="https://www.wfmz.com/features/historys-headlines/historys-headlines-skyjack-of-1972/article_940d5703-8e18-528b-80c4-443b3607b6b0.html">Frederick Hahneman</a>, all of whom successfully parachuted out of the aircraft once they received their ransom payments, only to be eventually caught and punished.</p> <h2>Tightening the screws</h2> <p>In response to the spate of more violent and costly hijackings, the U.S. government established the <a href="https://www.ibm.com/blogs/systems/a-brief-history-of-airline-security-hijackings-and-metal-detectors/">first anti-hijacking security protocols</a>. Most of them aimed to prevent hijackers from getting on aircraft in the first place. The measures included a hijacker profile, metal detectors and X-ray machines. Specific to Cooper, airlines retrofitted aircraft with a devise known as a <a href="https://www.wikimotors.org/what-is-a-cooper-vane.htm">Cooper vane</a> that made it impossible to open aft stairwells during flight.</p> <p>The protocols put in place in the 1970s also laid the foundation for the expansive security measures taken after 9/11. A series of court cases upheld the constitutionality of these early measures. For example, <a href="https://law.justia.com/cases/federal/district-courts/FSupp/328/1077/1428246/">United States v. Lopez</a>, decided in 1971, upheld the use of the hijacker profile.</p> <p>More importantly, in <a href="https://law.justia.com/cases/federal/appellate-courts/F2/454/769/438142/">United States v. Epperson</a>, a federal court ruled in 1972 that the government’s interest in preventing hijackings justified the requirement for passengers to pass through a magnetometer at the airport. And in 1973, the Ninth Circuit Court, in <a href="https://casetext.com/case/united-states-v-davis-51">United States v. Davis</a>, declared that the government’s need to protect passengers from hijackings rendered all searches of passengers for weapons and explosives as reasonable and legal.</p> <p>These rulings upholding early anti-hijacking measures helped create <a href="https://www.ojp.gov/ncjrs/virtual-library/abstracts/post-9-11-challenges-aviation-security-homeland-security-law-and">the strong legal grounds</a> for the rapid adoption of the more rigorous security protocols – including detailed identification checks, random pat-downs and full body scans – adopted after 9/11.</p> <p>The mystery surrounding the fate of Cooper may have afforded him an outsized place in American popular culture, but his crime should also be remembered as one in a consequential wave of hijackings that finally forced the U.S. government, airline executives and airport officials to adopt the first versions of the security measures travelers take for granted today.</p> <p><em>Image credits: Getty Images</em></p> <p><em>This article originally appeared on <a href="https://theconversation.com/d-b-cooper-the-changing-nature-of-hijackings-and-the-foundation-for-todays-airport-security-185562" target="_blank" rel="noopener">The Conversation</a>. </em></p>

International Travel