首页
外语
计算机
考研
公务员
职业资格
财经
工程
司法
医学
专升本
自考
实用职业技能
登录
外语
It’s Hard to Clean Big Data A)Karim Keshayjee, a Toronto physician and digital health consultant, crunches mountains of data fro
It’s Hard to Clean Big Data A)Karim Keshayjee, a Toronto physician and digital health consultant, crunches mountains of data fro
admin
2020-06-08
45
问题
It’s Hard to Clean Big Data
A)Karim Keshayjee, a Toronto physician and digital health consultant, crunches mountains of data from 500 doctors to figure out how to improve patient treatment. But it’ s a frustrating slog to get a computer to decipher all the misspellings, abbreviations, and notes written in unintelligible medical shorthand.
B)For example, "smoking information is very hard to parse," Keshayjee said. "If you read the records, you understand right away what the doctor meant. But good luck is trying to make a computer understand. There’s ’never smoked’ and ’smoking = 0.’ How many cigarettes does a patient smoke? That’ s impossible to figure out."
C)The hype around slicing and dicing massive amounts of data, or big data, makes it sound so easy: Just plug a library’ s worth of information into a computer and wait for valuable insights to pour out about how to speed up an auto assembly line, get online shoppers to buy more sneakers, or fight cancer. The reality is much more complicated. Data is inevitably "dirty" thanks to obsolete, inaccurate, and missing information. Cleaning it up is an increasingly important and overlooked job that can help prevent costly mistakes.
D)Although techniques are improving all the time, scrubbing data can only accomplish so much. Even when dealing with a relatively tidy set of information, getting useful results can be arduous and time-consuming. "I tell my clients that the world is messy and dirty," said Josh Sullivan, a vice president at business consulting firm Booz Allen who handles data crunching for clients. "There are no clean data sets."
E)Data analysts start by looking for information that’ s out of the norm. Because the volume of data is so huge, they typically hand the job over to software that automatically sifts through numbers and text to look for anything unusual that needs further review. Over time, computers can improve their accuracy in spotting what’ s belongs and what doesn’t. They can also better understand what words and phrases mean by clustering similar examples together and then grading their interpretations for accuracy. "The approach is easy and straightforward, but training your models can take weeks and weeks," Sullivan said.
F)A constellation of companies offer software and services for cleaning data. They range from technology giants like IBM IBM -0.24% and SAP SAP 0.12% to big data and analytics specialists like Cloudera and Talend Open Studio. A legion of start-ups is also trying to get a toehold as data janitors including Trifacta, Tamr, and Paxata.
G)Healthcare, with all its dirty data, is one of the toughest industries for big data technology. Electronic health records make medical information increasingly easy to dump into computers, but there’ s still a lot room for improvement before researchers, pharmaceutical companies and hospital business analysts can slice and dice all the information they want.
H)Keshavjee, the doctor and CEO of InfoClin, a health data consulting firm, spends his days trying to tease out ways to improve patient treatment by sifting through tens of thousands of electronic medical records. Obstacles pop up all the time.
I)Many doctors neglect to note a patient’ s blood pressure in their medical records, something that no amount of data cleaning can fix. Simply determining what ails patients—based on what’ s in their files—is surprisingly difficult for computers. Doctors may enter the proper code for diabetes without clearly indicating whether it’ s the patient who has the disease or a family member. Or they may just enter "insulin" without mentioning the underlying diagnosis because, to them, it’ s obvious.
J)Physicians also use a lot of idiosyncratic shorthand for medications, illnesses and basic patient details. Deciphering it takes a lot of head scratching for humans and is nearly impossible for a computer. For example, Keshavjee came across one doctor who used the abbreviation"gpa." Only after coming across a variation, "gma," did he finally solve the puzzle—they were shorthand for "grandpa" and "grandma."?"It took a while to figure that one out," he said.
K)Ultimately, Keshavjee said one of the only ways to solve the problem of dirty data in medical records is "data discipline." Doctors need to be trained to enter information correctly so that cleaning up after them is less of a chore. Incorporating something like Google’ s helpful tool that suggests how to spell words as users type them would be a great addition for electronic medical records, he said. Computers can learn to pick out spelling errors, but minimizing the need is a step in the right direction.
L)Another of Keshavjee’ s suggestions is to create medical records with more standardized fields. A computer would then know where to look for specific information, reducing the chance of error. Of course, doing so is not as easy as it sounds because many patients suffer from multiple illnesses, he said. A standard form would have to be flexible enough to take such complications into account.
M)Still, doctors would need to be able to jot down more free-form electronic notes that could never fit in a small box. Nuance like why a patient fell, for example, and not just the injury suffered, is critical for research. But software is hit and misses in understanding free-form writing without context. Humans searching by keyword may do a better job, but they still inevitably miss many relevant records.
N)Of course, in some cases, what appears to be dirty data, really isn’t. Sullivan, from Booz Allen, gave the example the time his team was analyzing demographic information about customers for a luxury hotel chain and came across data showing that teens from a wealthy Middle Eastern country were frequent guests. "There were a whole group of 17 year-olds staying at the properties worldwide,’ Sullivan said. "We thought, ’ That can’ t be true.’ "
O)But after some digging, they found that the information was, in fact, correct. The hotel had legions of young customers that it didn’t even realize were there, and had never done anything to market to them. All guests under 22 were automatically logged as "low-income" in the company’s computers. Hotel executives had never considered the possibility of teens with deep pockets.? "I think it’s harder to build models if you don’t have outliers," Sullivan said.
P)Even when data is clearly dirty, it can sometimes be put to good use. Take the example, again, of Google’ s spelling suggestion technology. It automatically recognizes misspelled words and offers alternative spellings. It’s only possible because Google GOOG -0.34% has collected millions and perhaps billions of misspelled queries over the years. Instead of garbage, the dirty data is an opportunity.
Q)Ultimately, humans, and not machines, draw conclusions from the data they crunch. Computers can sort through millions of documents, but they can’ t interpret the findings. Cleaning data is just one of step in a long trial and error process to get to that point. Big data, for all its hype about its ability to lift business profits and help humanity, is a big headache. "The idea of failure is completely different in data science," Sullivan said. "If they don’t fail 10 or 12 times a day to get to where they should be, they’re not doing it right."
It is impossible that computers make clear how many cigarettes a patient smokes.
选项
答案
B
解析
题干意为电脑不可能弄清楚一个病人抽多少根烟。根据题干中的“cigarettes a patient smokes”可定位至B段末句 “How many cigarettes does a patientsmoke?That’s impossible to figure out.”,题干与该句意思一致,其中,“make clear”与原文中的“figure out”相对应。
转载请注明原文地址:https://kaotiyun.com/show/hGP7777K
0
大学英语六级
相关试题推荐
Forthispart,youareallowed30minutestowriteashortessayentitledHowtoImproveStudents’MentalHealth.Youshouldwri
A、10,000.B、7,950.C、240.D、4,750.D细节题。根据文中提到的ThenumberofpeopletakingtheirownlifewasalreadyincreasingintheUS,butt
A、Becausetheywanttoincreasetheirworkingexperience.B、Becausetheydonotyetknowwhatkindofpermanentjobtheywant.C
A、AcitynamedMilton.B、AtownnamedMilton.C、TorontoAirport.D、MiltonAirport.B细节题。根据Ineedtogettoatowncalledum,Milt
A、Americansvowtochangeit.B、Itisnotasbadasitusedtobe.C、Americansknowhowbaditistotheirhealth.D、Americansd
A、Itmightaffectmothers’health.B、Itmightdisturbinfants’sleep.C、Itmightincreasetheriskofinfants’death.D、Itmight
A、Restructuringthewholecompany.B、Employingmoreforwardingagents.C、PromotingcooperationwithJayalMotors.D、Exportingth
A、Eightypercentoftheicedisappearsinsummertime.B、Mostoftheicewasaccumulatedoverthepastcenturies.C、Theiceensu
A、Ignoringthesignsandsymptomsofaging.B、Adoptinganoptimisticattitudetowardslife.C、Endeavoringtogiveupunhealthyl
A、Gettinghealthcoverage.B、Preventingthespreadofnuclearweapons.C、Fightingagainstterrorism.D、Thefreedomtomarry.D
随机试题
《证券法》第108条规定,“证券交易所依照法律,行政法规定,办理股票公司债权的暂停上市,恢复上市或者终止上市事务”。其具体办法由国务院证券监督管理机构制定,该规定属于()。
低压螺旋式气柜施工时,其施工的关键工序是()。
建造师经( )后,方有资格以建造师名义担任建设工程项目施工的项目经理及从事其他施工活动的管理。
下列关于产品生命周期策略的说法,正确的有()。
甲股份有限公司2013年在上海证券交易所上市,A公司是甲公司的控股股东,持有甲公司35%的股份。甲公司因2014年、2015年净利润均为负数,遂拟进行重组,2016年8月1日公布重组方案:(1)甲公司以全部资产(负债)与重组方乙公司持有的100%丙公司股
道德情感的内容主要包括爱国主义情感、集体主义情感、义务感、责任感、事业感、自尊感和羞耻感。其中,爱国主义情感、责任感和自尊感对于儿童和青少年尤为重要。
神话衰落,哲学兴起,人要自己来解释和安排一切了,他几乎在踌躇满志的同时发现了自己________。面对动物或动物般生活着的芸芸众生,觉醒的智慧感觉到一种神性的快乐。面对宇宙,他却意识到了自己的局限,不得不________由神性不足造成的痛苦。依次填入画横线
人才是创新的根基.创新驱动实质上是人才驱动。深化改革、推动创新,一方面离不开激发民智、汇聚民力,另一方面要发挥高端人才的关键作用。只有大力实施人才强国战略,“掸天下英才而用之,集聚一批站在行业科技前沿、具有国际视野和能力的领军人才”,努力抢占经济科技制高点
HowtoConquerPublicSpeakingFearI.IntroductionA.Publicspeaking—acommonsourceofstressforeveryoneB.Thetruthabou
OnacoldJanuarymorningin1936,GeorgeVwasgivenaking’sburial.Followinghiscoffinwashiseldestson,thehandsome,mu
最新回复
(
0
)