Reebok Skycush Evolution Lux Black Grey Women Classic Walking Shoes BD2942

[Editor’s Note:  In Part I of this series, Dr. Nick Marsella addressed the duty we have to examine our assumptions about emergent warfighting technologies / capabilities and their associated implications to identify potential second / third order and “evil” effects. WMNS Nike Air Jordan 1 Retro Low NS SZ 10 White Metallic Gold AH7232-100Dr. Scholl's Women's Fly Sneaker Spice Red Switchback Knit Sneakers In today’s post, he prescribes five actions we can embrace both individually and as organizations to avoid confirmation bias and falling into cognitive thinking traps when confronting the ramifications of emergent technologies — Enjoy!]

In part I of my blog post, I advised those advocating for the development and/or fielding of technology to be mindful of the second/third order and possible “evil” effects. I defined “evil” as an unexpected and profound negative implication(s) of the adoption/adaption of a technology and related policy. I also recommended heeding the admonition of Tim Cook, Apple’s CEO, to take responsibility for our technological creations and have the courage to think things through their potential implications – both for the good and the bad.

But even if we as individuals are willing to challenge our assumptions and think broadly and imaginatively, we can still come up short.  Why?  The answer is due in part to the challenges of prediction and the fact we are human with both great cognitive abilities, but also weaknesses.

THE CHALLENGES

First, common sense and many theorists remind us that the future is unknowable.Nike Air Max Wright WM LE White/White-Metallic Silver 378178-100 Women's SZ 6Brooks PureCadence 6 Running Shoe-Women's Size 10M Black/Grey/PinkThe futurist Arthur C. Clark noted in 1962, “It is impossible to predict the future, and all attempts to do in any detail appear ludicrous within a very few years.” Within this fixed condition of unknowing, the U.S. Departments of Defense and the Army must make choices to determine:

– what capabilities we desire and its related technology;

– where to invest in research and development; and

– what to purchase and field.Skechers BOBS Women's Beach Bingo - Dog House Party Sneaker, - Choose SZ/ColorNew Balance Womens 7 WW1350WK 1350 Running Sneakers Shoes Sneakers Black

Source: Penguin Random House

As Michael E. Raynor pointed out in his book, New Balance Womens 7 WTKYMRT1 Running Sneakers Shoes Sneakers Purple Blue, making choices and developing strategies, which include adopting new technology, where the future is unknowable and “deeply unpredictable” either produces monumental successes or monumental failures.Mr/Ms 361 Chaser Running Women's Shoes durability a variety of Vintage tide shoesNew Balance Women's Trail Running Shoes Sz 5.5 For a company this can spell financial ruin, while for the Army, it can spell disaster and the loss of Soldiers’ lives and national treasure.  Yet, we must also choose a “way ahead” – often by considering “boundaries” – in a sense the left and right limits – of potential implications.

Second, our ability to predict when technology will become available is often in error nor can we accurately determine its implications. For example, in a New York Times editorial on December 8, 1903, it noted:  “A man carrying airplane will eventually be built, New Balance Womens 7 WCSTRLN4 Running Sneakers Shoes Sneakers Burgundy RedMan's/Woman's Saucony Grid Cohesion Running Women's Shoes Charming design Online Amoybut only if mathematicians and engineers work steadily for the next ten million years.”5  The Wright Brothers first flight took place the following week, but it took decades for commercial and military aviation to evolve.

The stillborn Future Combat Systems (FCS) was the U.S. Army’s principal modernization program during the first decade of the Twenty-First century / Source: 
PM FCS, U.S. Army

Each of the services has faced force modernization challenges due to the adoption of technologies that weren’t mature enough; whose capabilities were over-promised; or did not support operations in the envisioned Operational Environment.  For the U.S. Army, Future Combat Systems (FCS) was the most obvious and recent example of this challenge – costing billions of dollars and, just as importantly, lost time and confidence.New Balance Womens 7 WARISPA1 Running Sneakers Shoes Sneakers BlackASICS Tiger GEL-Lyte Komachi Women's Mauvewood/Mauvewood 7Z5N2929

Third, in terms of future technology, predictions vary widely. For example, predictions by MIT’s Rodney Brooks and futurist/inventor Ray Kurzweil vary widely to the question – “What year do you think human-level Artificial Intelligence [AI, i.e., a true thinking machine] might be achieved with a 50% probability?” Kurzweil predicts AI (as defined) will be available in 2029, while Brooks is a bit more conservative – the year 2200 – a difference of over 170 years.New Balance Running Course Running Women's ShoesHOKA ONE ONE Women's Odyssey 2 Athletic Running Shoes Pink/Lime Size 5.0W

While one can understand the difficulty of predicting when “general AI” will be available, other technologies offer similar difficulties. The vision of the “self-driving” autonomous vehicle was first written about and experimented with in the 1920s, yet technological limitations, legal concerns, customer fears, and other barriers make implementing this capability challenging.

Gartner Hype Cycle / Source: Nicole Saraco Loddo, Gartner

Lastly, as Rodney Brooks has highlighted, Women's Shoes Skechers Skech Knit Memory Foam 11728 Yellow Sneaker 6M US 36 EU maintains:

we tend to overestimate the effect of a technology in the short run and underestimate the effect in the long run.”Columbia Women's Trail Summit Running Gloves - Choose SZ/Color

SECOND, THIRD ORDER AND EVIL EFFECTS

I contend that we either:Skechers Performance Womens Go Walk Lite-15372 Wide Sneaker- Select SZ/Color.Womens 9 Nike Turbo Shox ID Black / Vivid Pink / Tan 317674-991

intentionally focus on the positive effects of adopting a technology;

ignore the experts and those who identify the potential downside of technology; and

fail to think thorough the short, long, and potentially dangerous effects or dependencies – imaginatively.

We do this because we are human, and more often because we fall into the confirmation bias or other cognitive thinking traps that might affect our program or pet technology. As noted by RAND in Truth Decay:Womens Superga 2790 Cotropew Flatform Rope Wedges Summer Casual TrainersNIB ASICS GT-1000 2 Womens Youth Girls Running Shoes, Raspberry, Size 5. $100

Source: Pixabay

Cognitive biases and the ways in which human beings process information and make decisions cause people to look for information, opinion, and analyses that confirm preexisting beliefs, to weigh experience more heavily than data and facts, and then to rely on mental shortcuts and the beliefs of those in the same social networks when forming opinions and making decisions.”9

Yet, the warning signs or signals for many unanticipated effects can be found simply by conducting a literature review of government, think tank, academic, and popular reports (to perhaps include science fiction). This may deter some, given the sheer volume of literature is often overwhelming, but contained within these reports are many of the challenges associated with future technology, such as:  the potential for deep fakes, loss of privacy, hacking,adidas Women's Pureboost X TR 3.0 LL Cross Trainer - Choose SZ/ColorSkechers Performance Womens Go Walk 4 Achiever Walking Shoe- Select SZ/Color. accidents, deception, and loss of industries/jobs.

At the national level, both the current and previous administrations published reports on AI, as has the Department of Defense – some more balanced in addressing of issues of fairness, safety, governance, and ethics.10

Source: PixabaySkechers Women's New School - Choose SZ/ColorReebok Women's Royal Lumina Pace-W - Choose SZ/Color

For example, using photo recognition to help law enforcement and others seems like a great idea, yet its use is increasingly being questioned. This past May, San Francisco became the first city to ban its use, and others may follow suit.11  While some question this decision to ban vice impose a moratorium until the technology produces less errors, the question remains – did the developers and policy makers consider if there would be push back to its introduction given its current performance?Reebok Women's Freestyle Hi Shoe - Choose SZ/ColorSkechers BOBS Womens Squad-Twinning Fashion Sneaker- Select SZ/Color. What sources did they consult?

Another challenge is language. You’ve seen the commercials – “there is much we can do with AI” – in farming, business, and even beer making.  While “AI” is a clever tag line, it may invoke unnecessary fear and misunderstanding.  For example, I believe for most people equate “robotics” and “AI” with the “Terminator” franchise, raising the fear of uncontrolled autonomous military force overwhelming humanity.  Even worse – under the moniker of “AI,” we will buy into “snake-oil” propositions.

We are at least decades away from “general AI” where a “system exhibits apparently intelligence behavior at least as advanced as a person” across the “full range of cognitive tasks,” but we continue to flaunt the use of “AI” without elaboration.Ryka Women's Dream Cross Trainer - Choose SZ/ColorSkechers Women's Go Step Lite-Innovate Sneaker - Choose SZ/Color

SOME ACTIONS TO TAKE

Embrace a learning organization. Popularized by Peter Senge’s The Fifth Discipline: The Art and Practice of the Learning Organization (1990), a learning organization is a place “where people continually expand their capacity to create the results they truly desire, where new and expansive patterns of thinking are nurtured, where collective aspiration is set free, and where people are continually learning how to learn together.”Under Armour Women's Street Precision Slip Metallic Cross-Trainer Shoe While some question whether we can truly make a learning organization, Senge’s thinking may help solve our problem of identifying 2nd/3rd order and evil effects.

First, we must embrace new and expansive patterns of thinking.  Force developers use the acronym – “DOTMPLF-P” as shorthand for Doctrine, Organization, Training, Materiel, Personnel, Leadership, Facilities, and Policy implications – yet other factors might be as important.

A convoy of leader-follower Palletized Load System (PLS) vehicles at Fort Bliss, TX / Source: U.S. Army photo by Jerome AliottaSkechers Women's Go Flex Max Loafer - Choose SZ/ColorADIDAS WMNS STAN SMITH WONDER PINK Sneakers | CQ2812

For example, trust in automated or robotics systems must be instilled and measured.  In one poll, 73% of respondents noted they would be afraid of riding in a fully autonomous vehicle – up 10% points from the previous year.14  What if we develop a military autonomous vehicle or a leader-follower system and one or more of our host nation allies prohibits its use? What happens if an accident occurs and the host population protests, NEW ADIDAS WOMEN'S ORIGINALS SUPERSTAR SHOES [AC7163] WHITE//COLL NAVYLacoste Ziane BL 2 SPW - Navy - Womensarguing that the Americans don’t care for their safety?

Technologists and concept developers must move from being stove-piped in labs and single-focused to consider the broader view of technological implications across functions.

Embrace Humility. Given that we cannot predict the future and its potential consequences, developers must seek out diversified opinions, and more importantly, recognize divergent opinions.

U.S. B-17 bombers on mission to destroy Germany’s war production industries, Summer of 1944 / Source: U.S. Air Force photo

Embrace the Data.  In New York City during World War II, a small organization of some of the most brilliant minds in America worked in the office of the “Applied Mathematics Panel.”  In Europe, the 8th U.S. Air Force suffered from devastating bomber losses.  Women's Nike Dunk High Retro QS Syracuse Orange 854340-100 size 8.5New Nike W Air Huarache Run Ultra [819151-008] NSW Running Black/Black-WhiteLeaders wondered where best to reinforce the bombers with additional armor without significantly increasing their weight to improve survivability. Reports indicated returning bombers suffered gunfire hits over the wings and fuselage, but not in the tail or cockpits, so to the casual observer it made sense to reinforce the wings and fuselage where the damage was clearly visible.

Abraham Wald, a mathematician, worked on the problem. He noted that reinforcing the spots where damage was evident in returning aircraft wasn’t necessarily the best course of action, given that hits to the cockpit and tail were probably causing aircraft (and aircrew) losses during the mission.  In a series of memorandums, he developed a “method of estimating plane vulnerability based on damage of survivors.” As Sir Arthur Conan Doyle’s Sherlock Holmes noted more than 100 years ago,  “It is a capital mistake to theorize before one has data. Insensibly one begins to twist facts to suit theories, instead of theories to suit facts.”New Women`s Ahnu Fairfax Shoes Waterproof 1009551 MSRP$130NWT Sam Edelman Stillson Oatmeal Suede Pump 9 Ret. $120

Additionally, we need to reinforce our practice of performing quality literature reviews to aid in our identification of these issues.

The office of Devil’s Advocate was established by Pope Sixtus V in 1587 / Source: Wikimedia Commons, Artist unknownAdidas Womens WMNS Iniki Runner W Energy Orange Clear Onxy Gum Boost BA9998 NEWNew Balance Women's Fresh Foam Gobi Trail Running Shoe, Grey/Pink

Employ Skepticism and a Devil’s Advocate Approach.  In 1587, the Roman Catholic Church created the position of Promoter of the Faith – commonly referred to as the Devil’s Advocate. To insure a candidate for sainthood met the qualification of being canonized, the role of the Devil’s Advocate was to be the skeptic (loyal to the institution), looking for reasons why not to canonize the individual.  Similarly, Leaders must embrace the concept of employing a devil’s advocate approach to identifying 2nd/3rd order and evil effects of technology – if not designating a devil’s advocate with the right expertise to identify assumptions, risks, and effects. But creating any devil’s advocate or “risk identification” positions is only useful if their input is seriously considered.

Embrace the Suck.  Lastly, if we are serious in identifying the 2nd/3rd order and evil effects, Sano Mephisto Black Patent Leather Walking Rocker Bottom Sneakers Shoes 8.5 US11Womens Shoes Real Leather Breathable Fashion Sneakers Wedge Oxfords Ankle Bootsto include identifying new dependencies, ethical issues, or other issues which challenge the adaption or development of a new technology or policy – then we must be honest, resilient, and tough. There will be setbacks, delays, and frustration.

FINAL THOUGHT

Technology holds the power to improve and change our personal and professional lives.  For the military, technology changes the ways wars are fought (i.e., the character of war), but it may also change the nature of war by potentially reducing the “human dimension” in war.  If robotics, AI, and other technological developments eliminate “danger, physical exertion, intelligence and friction,”17 is war easier to wage?  Will technology increase its potential frequency?  Will technology create a further separation between the military and the population by decreasing the number of personnel needed? These may be some of the 2nd/3rd order and “evil” effects we need to consider.

If you enjoyed this post, please see Dr. Marsella’s previous post “Second/Third Order, and Evil Effects” – The Dark Side of Technology (NEW Womens NEW BALANCE WT 810 PY2 Gray Purple Yellow Running Sneakers Shoes)

… as well as the following posts:Vans Sk8 Hi Navy Womens - Mens Trainers - VD5INVYHi-Tec Sierra X-Lite Womens Vineyard Wine Boysenberry Outdoors Trail Shoes

Women New Balance Everyday Running Shoe W775LG3 Thunder/Black/Alpha Pink New, by Dr. Nir Buras

NIKE Womens Size 6 Air Zoom Wildhorse 4 Mesh Athletic Hiking Trail Shoes

NEW Womens NIKE FREE TR FIT 5 sz 10.5 GLOW LAVA CRIMSON Running Shoes Sneaker Leather Womens Sequins Bling Multi Athletic Shoes Casual Sports Shoes Sneakers #

Asics Gel-Preleus T480N Women Running Shoes. US Size 5.5 New in Original Box npckhp3671-Athletic Shoes

[Editor’s Note: Mad Scientist Laboratory is pleased to publish today’s post by guest blogger LTCOL Greg Colton, Australian Army, addressing the intellectual component of military power.  In our current drive to modernize the U.S. Army into a Multi-Domain Operations (MDO)-Capable Force by 2028 and set the conditions for fielding an MDO-Ready Force in 2035, we must not forget the lessons learned from our last major transformation in the 1980s. Vans Sk8-Hi Del Pato MTE Duck Boots [Size 8 Men, 9.5 Women US]Asics RoadHawk FF Black/Mint Running Shoes Women's US Size 10 (B3,2) The tactical and operational excellence that enabled us to completely rout Iraqi ground forces in 100 hours was not only the result of effective doctrine and the acquisition of the “Big 5” weapon systems, but also due to the development of our Combat Training Centers (CTCs) and Leader Development platforms like the Non-Commissioned Officer Education System and the School of Advanced Military Studies. Read on to learn how one of our key allies is approaching their Army’s Professional Military Education.]

LTGEN Rick Burr, Australian Chief of Army

We must push ourselves to think in creative and unconstrained ways to ensure our warfighting philosophy is appropriate and informs our future capabilities” — LTGEN Rick Burr, Australian Chief of Army, in Accelerated Warfare

In an increasingly volatile world, militaries need to be prepared to conduct a broad range of contemporary operations while also continuously anticipating the requirements of future conflicts. As the Australian Chief of Army NEW BALANCE Womens 'Classics CW620' Redwoods Casual Sneakers Sz 9.5 NEW! 229758, “Preparedness is dynamic. It requires us to be ready now, while concurrently becoming future ready.” Key to this is the development of the Womens Pull on Fashion Breathable Athletics Sneakers Casual Breathable Shoes NEW, both of individuals and of the Army as an organisation, so that the Army is able to adapt to changes in circumstances quickly enough to win future conflicts.

Yet, as the Asics Gel Fit Sana 3 S751N 9601 Women's Running Shoes 12 Midgrey/White points out, “military institutions recognize the need for leaders who can adapt, but struggle with exactly how to teach or train them to do so.” Within the Australian Army, Professional Military Education (PME) is an important component of a wider approach that blends training, education, and experience to develop a workforce able to cope with the demands of war in an ever-changing environment.

The Army’s approach to PME

The Australian Army’s approach to PME is laid out in its PME Strategy, executed on behalf of the Chief of Army by the Directorate of Professional Military Education, which itself falls under command of the Director-General Training and Doctrine (DG TRADOC). The Directorate uses two broad approaches to enhance the intellectual component of fighting power. First, using the principle of connectivism it seeks to connect those who can impart specialist knowledge to the workforce. Secondly, it seeks to develop organisational adaptability through promoting a contest of ideas. It delivers these approaches through a number of different mechanisms which allows content to be tailored to the target audience. These mechanisms include its online portal, New Womens Athletic Strappy Casual Real Leather Flats Mesh Comfort Fashion Shoes, unit PME packages, webinars, and conferences.

Connectivism

Trialing a UGV during Exercise Talisman Sabre 2019 with the U.S. / Source: Australian Defence Image Library; CPL Tristan Kennedy, Photographer

The Australian Army’s approach to connectivism is based on connecting our soldiers with acknowledged subject matter experts or those who have specific expertise in their field. A good example of the former is TX Hammes who gave a CoveTalk on the development of artificial intelligence in unmanned platforms, while an example of the latter is this article by a military workshop manager on improving the efficiency of his workshop’s layout and processes. Regardless of the source, connectivism enables the Army to link both experts and expertise with the wider workforce to develop the intellectual component of fighting power within our individual soldiers and officers. In doing so, it promotes the dissemination of best practice across the force.

Australian Army soldiers during Exercise Night Naip 2014 with the Papua New Guinea Defence Force / Source: Australian Defence Image Library; Leading Seaman Justin Brown, Photographer

However, this approach only provides half of the solution. For argument’s sake, let’s take as a given that warfare is an ever-evolving phenomenon. As such,Converse One Star Ox Womens Black Gold Leather TrainersNike Air Max 90 Premium Women's Fashion Shoe 443817 010 Size 5.5 best practice in and of itself cannot be enough, as the very term indicates the pre-determination of an optimal solution derived within a static set of variables. The uniqueness of each theatre, campaign, battlefield, or individual soldier’s field of fire will mean that the variables on which best practice has been developed will never exactly replicate. Consequently, tactical solutions to complex problems will rarely (if ever) be found using a cookie cutter Under Armour Womens Speedform Fortis 2 Size 9Superga Womens 2750 Embleaw White Embroidered Fashion Sneakers Size US 8template. Instead, we need an Army that is institutionally flexible enough to recognise and incorporate emerging practice to solve unique problem sets. In other words, if best practice provides the theoretical foundations required to understand the tactical problem, emerging practice provides the intellectual adaptability to actually solve it.

A contest of ideas

This leads us to the second approach we use to enhance the intellectual component of fighting power: New Balance Women's 696 'All Suede Pack' in Mint WL696WPM BNIB Free ShippingWomens Puma Cream Maroon Zip Mid Top Athletic Gym Shoes Casual Fashion Sneakers promoting a contest of ideas.  Fostering a culture of contesting ideas has two benefits. Firstly, it gives our people the confidence to analyse the unique problem set they are faced with and recommend bespoke solutions to a hierarchy that is often one or two steps removed from the ground truth. Secondly, and just as importantly, it inculcates an organisational culture within the Army that is willing to recognise, and accept, emerging practice (i.e., the recommendations from those trying to solve the current problem) rather than always insisting on best practice (i.e., what we have always done in similar circumstances). This is essential if we are to win future wars.Merrell Around Town Sunvue Slide Women's Size 7 Natural Tan 25%OFFGentlemen/Ladies Reebok Shoes 611291 Pink 23.5cm Fine processing special promotion Beautiful and charming

Australian Army Boxer 8×8 Combat Reconnaissance Vehicle (CRV) with 30mm automatic cannon / Source:  Multiple Australian media sites

A good example of how the Australian Army promotes a contest of ideas is The Cove’s recent Manas RAPALLO, femme Sneakers, noir (NERO), 39 EU-, in which readers were invited to submit a ‘script’ of no more than 100 words on what they thought the Army of 2030 should look like. Run over the period of a calendar month, it generated 48 entries from a broad range of authors,New Balance 520 Women's Dusted Peach/White WL520TDPleaser Pink Label Women's Kimberly 04 Wedge Sandal Red Patent Heeled Sandals from front-line practitioners to life-long academics. Collectively, these scripts were viewed over 93,000 times in 31 days and were the genesis for numerous comments on our website, within units and messes across the country, and on social media. At the end of the competition,Skechers Gratis Shake It Off Womens Sneakers Black 11adidas Women's Cf Qt Racer W, - Choose SZ/Color the entries and online discussion were captured and passed on to the Australian Army’s Directorate of Future Land Warfare to inform its work.

This ‘crowd sourcing’ of ideas doesn’t just support the work of those tasked with thinking about the future structures and capabilities of the Army. It also encourages the Army’s people to think about the future of warfare, encourages debate on how the organisation can best meet the challenges of the future, and gives our people the confidence to contribute to that debate.

A complementary approach

The Australian Army’s Combat Training Centre – Jungle Training Wing (CTC-JTW) in TullyDr. Scholl's Women's Madison Fashion Sneaker - Choose SZ/ColorKeds Women's Champion Crochet Fashion Sneaker - Choose SZ/Color

Most readers will already have realised that when these two aspects are combined, they form a complementary approach to PME: collectivism harnesses the experience of experts for the development of the workforce, while a contest of ideas harnesses the experience of the workforce for the development of the organisation. If the Army is to be truly adaptive, one cannot exist without the other. An organisation which always insists on best practice, rather than emerging practice,Skechers 23153 Sport Womens Unity-Pure Bliss Fashion Sneaker- Choose SZ/Color. is risking ruin through imposing dogmatic solutions to complex problems, while an army that automatically reacts to instantaneous suggestions from the workforce, ungrounded in theoretical understanding, risks repeating the mistakes of the past.

Thus, contributions need to be sought from a broad range of viewpoints if the Army is to be ready for future conflict. As Kevin O’Leary from Shark Tank is at Saucony Women's Feel Sneaker - Choose SZ/Color:  “Nobody has a monopoly on good ideas.” This is particularly important to remember within hierarchical organisations such as the military.Vionic Elation Womens Purple & Pink Biomechanic Footbed Memory Foam Trainers NewSkechers Women's Summits Slip on Sneakers Black 6 M It can be all too easy for generals, staff officers, or senior public servants to fall into the trap of believing that experience alone is the foundation of hard-earned knowledge, and that new ideas from juniors that challenge doctrine, the status quo, or the strategic narrative are unnecessarily subversive.

Soldiers from the 7th Combat Signal Regiment (7 CSR) / Source:  adidas Originals BY3738 Womens Shoes | Tubular Invader Strap Fashion SneakersNike Air Huarache Run Black/Black-White 634835-006 Women's SZ 7

Yet, when the next war comes it will not be the desk officers or policy experts that do the fighting, or the dying, in foreign fields. It is the young military practitioner who, regardless of rank, will find themselves trying to solve a unique problem set in the most testing of circumstances. In the words of Nassim Taleb, it is they who have ‘Nike Flyknit Lunar 2 620658-800 Orange Blue White Black Women's Shoes Sz 8 39.’ As such, we owe that young soldier or officer not only the very best foundational professional military education we can give them, but also an organisation willing and able to adapt to bespoke solutions based on ground truth. As an Army, we must set the conditions such that our people challenging the status quo and contesting ideas is our organisation’s comfort zone.

This requires a complementary approach to PME, developed and delivered now, so that we may enhance the intellectual component of fighting power in time for the Army to fight, and win, the next war. It is an approach that the team at The Cove is dedicated to delivering for the Australian Army.

If you enjoyed this post, please read: NEW ADIDAS WOMEN'S 6.5 ORIGINALS NMD R1 STLT PRIMEKNIT W SHOES [CQ2029]ADIDAS ORIGINALS SL 72 Shoes Retro Running Womens 8.5 Silver Gray Suede RARE HTF.