DNACloud:一种基于DNA的大数据存储工具

2015-12-20 CSDN,翻译/王辉 MedSci原创

来自欧洲生物信息研究所的Goldman 和他的同事们告诉我们,DNA可以作为存储介质,在1克的DNA上可以储存1PB的信息,DNACloud软件可以更好地支持在这种存储。 我们去哪里存储人们十分关注的海量数据呢?如何在 DNACloud存储每克DNA中1PB字节的信息? 写入有点慢。你需要把你的的数据文件转换成DNA描述,然后发送给任何一家生物科技公司,他们会给你合成DNA,你可以将其存储

来自欧洲生物信息研究所的Goldman 和他的同事们告诉我们,DNA可以作为存储介质,在1克的DNA上可以储存1PB的信息,DNACloud软件可以更好地支持在这种存储。

我们去哪里存储人们十分关注的海量数据呢?如何在 DNACloud存储每克DNA中1PB字节的信息?

大数据

写入有点慢。你需要把你的的数据文件转换成DNA描述,然后发送给任何一家生物科技公司,他们会给你合成DNA,你可以将其存储在你的冰箱。

读写也有点慢。很明显这些数据可以被非常准确地读取,但是要读写它,你必须先按顺序排好DNA,这可能需要一段时间。

大数据

大数据通常是用来形容来自人类使用的数字媒体,如照相机,互联网,手机,传感器等产生的巨额数据。 基于大数据建立先进的分析模型,我们可以预测用户的很多事情诸如行为,兴趣等。然而在使用这些数据之前,必须解决大数据存储的许多问题。其中两个主要的问题是大存储设备的需要和与之关联的成本。

合成DNA存储似乎是解决这些大数据问题的一个合适的解决方案。在2013年,European Bioinformatics Institute(欧洲生物信息研究所)的Goldman 和他的同事们证实使用合成DNA作为存储介质,可以在1克的DNA上储存1PB的信息,并且还可以成功地以较低的错误率检索数据。这重要的一步意味着合成DNA对于未来的数据存储是一项有用的技术。而DNACloud软件的研发,使得数据更易于被储存在DNA中。

DNACloud1.0版本能够使用任意格式的格式(.text,.PDF,.PNG,.MKV,MP3播放等)将数据文件编码到DNA,也能解码回到原始的文件。您可以使用这款软件在DNA中存储您的Facebook数据或者视频。

最新的版本DNACloud 2.0允许用户使用一种有效的编码技术——非线性编码进行DNA数据编码。不同长度的DNA格雷码(DNA Golay Codes)可根据纠错率和更好的编码速率的要求用于编码。

DNACloud: A Tool For Storing Big Data On DNA

“From the dawn of civilization until 2003, humankind generated five exabytes (1 exabytes = 1 billion gigabytes) of data. Now we produce five exabytes every two days and the pace is accelerating.”

— Eric Schmidt, Executive Chairman, Google, August 4, 2010.

Where are we going to store the deluge of data everyone is warning us about? How about in a DNACloud that can store store 1 petabyte of information per gram of DNA?

Writing is a little slow. You have to convert your data file to a DNA description that is sent to a biotech company that will send you back a vile of synthetic DNA. Where do you store it? Your refrigerator.

Reading is a little slow too. The data can apparently be read with great accuracy, but to read it you have to sequence the DNA first, and that might take awhile.

The how of it is explained in DNACloud: A Tool for Storing Big Data on DNA (poster). Abstract:

The term Big Data is usually used to describe huge amount of data that is generated by humans from digital media such as cameras, internet, phones, sensors etc. By building advanced analytics on the top of big data, one can predict many things about the user such as behavior, interest etc. However before one can use the data, one has to address many issues for big data storage. Two main issues are the need of large storage devices and the cost associated with it. Synthetic DNA storage seems to be an appropriate solution to address these issues of the big data. Recently in 2013, Goldman and his collegues from European Bioinformatics Institute demonstrated the use of the DNA as storage medium with capacity of storing 1 peta byte of information on one gram of DNA and retrived the data successfully with low error rate [1]. This significant step shows a promise for synthetic DNA storage as a useful technology for the future data storage. Motivated by this, we have developed a software called DNACloud which makes it easy to store the data on the DNA. In this work, we present detailed description of the software.

版权声明:
本网站所有内容来源注明为“梅斯医学”或“MedSci原创”的文字、图片和音视频资料,版权均属于梅斯医学所有。非经授权,任何媒体、网站或个人不得转载,授权转载时须注明来源为“梅斯医学”。其它来源的文章系转载文章,或“梅斯号”自媒体发布的文章,仅系出于传递更多信息之目的,本站仅负责审核内容合规,其内容不代表本站立场,本站不负责内容的准确性和版权。如果存在侵权、或不希望被转载的媒体或个人可与我们联系,我们将立即进行删除处理。
在此留言
评论区 (6)
#插入话题
  1. [GetPortalCommentsPageByObjectIdResponse(id=1784624, encodeId=822c1e8462492, content=<a href='/topic/show?id=f32a60e076' target=_blank style='color:#2F92EE;'>#DNACloud#</a>, beContent=null, objectType=article, channel=null, level=null, likeNumber=30, replyNumber=0, topicName=null, topicId=null, topicList=[TopicDto(id=6070, encryptionId=f32a60e076, topicName=DNACloud)], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=11b4465, createdName=ying_wu, createdTime=Tue Mar 01 04:33:00 CST 2016, time=2016-03-01, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=1933576, encodeId=818f19335e617, content=<a href='/topic/show?id=04cb1354312' target=_blank style='color:#2F92EE;'>#OUD#</a>, beContent=null, objectType=article, channel=null, level=null, likeNumber=37, replyNumber=0, topicName=null, topicId=null, topicList=[TopicDto(id=13543, encryptionId=04cb1354312, topicName=OUD)], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=2f5a410, createdName=zxxiang, createdTime=Sat Jan 09 05:33:00 CST 2016, time=2016-01-09, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=48206, encodeId=d3a4482065a, content=值得看,好好收藏, beContent=null, objectType=article, channel=null, level=null, likeNumber=104, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=bc301610909, createdName=hixiaoluo, createdTime=Sat Dec 26 15:56:00 CST 2015, time=2015-12-26, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=48038, encodeId=19c44803823, content=难懂, beContent=null, objectType=article, channel=null, level=null, likeNumber=91, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=45101626056, createdName=忠诚向上, createdTime=Sat Dec 26 14:37:00 CST 2015, time=2015-12-26, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=47397, encodeId=5c3e4e39738, content=好深奥, beContent=null, objectType=article, channel=null, level=null, likeNumber=150, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=null, createdBy=ded71629504, createdName=nizongzan, createdTime=Thu Dec 24 07:16:00 CST 2015, time=2015-12-24, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=46919, encodeId=2cc54691909, content=好深奥, beContent=null, objectType=article, channel=null, level=null, likeNumber=92, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=7cde98330, createdName=milkshark, createdTime=Mon Dec 21 07:22:00 CST 2015, time=2015-12-21, status=1, ipAttribution=)]
    2016-03-01 ying_wu
  2. [GetPortalCommentsPageByObjectIdResponse(id=1784624, encodeId=822c1e8462492, content=<a href='/topic/show?id=f32a60e076' target=_blank style='color:#2F92EE;'>#DNACloud#</a>, beContent=null, objectType=article, channel=null, level=null, likeNumber=30, replyNumber=0, topicName=null, topicId=null, topicList=[TopicDto(id=6070, encryptionId=f32a60e076, topicName=DNACloud)], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=11b4465, createdName=ying_wu, createdTime=Tue Mar 01 04:33:00 CST 2016, time=2016-03-01, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=1933576, encodeId=818f19335e617, content=<a href='/topic/show?id=04cb1354312' target=_blank style='color:#2F92EE;'>#OUD#</a>, beContent=null, objectType=article, channel=null, level=null, likeNumber=37, replyNumber=0, topicName=null, topicId=null, topicList=[TopicDto(id=13543, encryptionId=04cb1354312, topicName=OUD)], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=2f5a410, createdName=zxxiang, createdTime=Sat Jan 09 05:33:00 CST 2016, time=2016-01-09, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=48206, encodeId=d3a4482065a, content=值得看,好好收藏, beContent=null, objectType=article, channel=null, level=null, likeNumber=104, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=bc301610909, createdName=hixiaoluo, createdTime=Sat Dec 26 15:56:00 CST 2015, time=2015-12-26, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=48038, encodeId=19c44803823, content=难懂, beContent=null, objectType=article, channel=null, level=null, likeNumber=91, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=45101626056, createdName=忠诚向上, createdTime=Sat Dec 26 14:37:00 CST 2015, time=2015-12-26, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=47397, encodeId=5c3e4e39738, content=好深奥, beContent=null, objectType=article, channel=null, level=null, likeNumber=150, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=null, createdBy=ded71629504, createdName=nizongzan, createdTime=Thu Dec 24 07:16:00 CST 2015, time=2015-12-24, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=46919, encodeId=2cc54691909, content=好深奥, beContent=null, objectType=article, channel=null, level=null, likeNumber=92, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=7cde98330, createdName=milkshark, createdTime=Mon Dec 21 07:22:00 CST 2015, time=2015-12-21, status=1, ipAttribution=)]
    2016-01-09 zxxiang
  3. [GetPortalCommentsPageByObjectIdResponse(id=1784624, encodeId=822c1e8462492, content=<a href='/topic/show?id=f32a60e076' target=_blank style='color:#2F92EE;'>#DNACloud#</a>, beContent=null, objectType=article, channel=null, level=null, likeNumber=30, replyNumber=0, topicName=null, topicId=null, topicList=[TopicDto(id=6070, encryptionId=f32a60e076, topicName=DNACloud)], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=11b4465, createdName=ying_wu, createdTime=Tue Mar 01 04:33:00 CST 2016, time=2016-03-01, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=1933576, encodeId=818f19335e617, content=<a href='/topic/show?id=04cb1354312' target=_blank style='color:#2F92EE;'>#OUD#</a>, beContent=null, objectType=article, channel=null, level=null, likeNumber=37, replyNumber=0, topicName=null, topicId=null, topicList=[TopicDto(id=13543, encryptionId=04cb1354312, topicName=OUD)], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=2f5a410, createdName=zxxiang, createdTime=Sat Jan 09 05:33:00 CST 2016, time=2016-01-09, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=48206, encodeId=d3a4482065a, content=值得看,好好收藏, beContent=null, objectType=article, channel=null, level=null, likeNumber=104, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=bc301610909, createdName=hixiaoluo, createdTime=Sat Dec 26 15:56:00 CST 2015, time=2015-12-26, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=48038, encodeId=19c44803823, content=难懂, beContent=null, objectType=article, channel=null, level=null, likeNumber=91, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=45101626056, createdName=忠诚向上, createdTime=Sat Dec 26 14:37:00 CST 2015, time=2015-12-26, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=47397, encodeId=5c3e4e39738, content=好深奥, beContent=null, objectType=article, channel=null, level=null, likeNumber=150, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=null, createdBy=ded71629504, createdName=nizongzan, createdTime=Thu Dec 24 07:16:00 CST 2015, time=2015-12-24, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=46919, encodeId=2cc54691909, content=好深奥, beContent=null, objectType=article, channel=null, level=null, likeNumber=92, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=7cde98330, createdName=milkshark, createdTime=Mon Dec 21 07:22:00 CST 2015, time=2015-12-21, status=1, ipAttribution=)]
    2015-12-26 hixiaoluo

    值得看,好好收藏

    0

  4. [GetPortalCommentsPageByObjectIdResponse(id=1784624, encodeId=822c1e8462492, content=<a href='/topic/show?id=f32a60e076' target=_blank style='color:#2F92EE;'>#DNACloud#</a>, beContent=null, objectType=article, channel=null, level=null, likeNumber=30, replyNumber=0, topicName=null, topicId=null, topicList=[TopicDto(id=6070, encryptionId=f32a60e076, topicName=DNACloud)], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=11b4465, createdName=ying_wu, createdTime=Tue Mar 01 04:33:00 CST 2016, time=2016-03-01, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=1933576, encodeId=818f19335e617, content=<a href='/topic/show?id=04cb1354312' target=_blank style='color:#2F92EE;'>#OUD#</a>, beContent=null, objectType=article, channel=null, level=null, likeNumber=37, replyNumber=0, topicName=null, topicId=null, topicList=[TopicDto(id=13543, encryptionId=04cb1354312, topicName=OUD)], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=2f5a410, createdName=zxxiang, createdTime=Sat Jan 09 05:33:00 CST 2016, time=2016-01-09, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=48206, encodeId=d3a4482065a, content=值得看,好好收藏, beContent=null, objectType=article, channel=null, level=null, likeNumber=104, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=bc301610909, createdName=hixiaoluo, createdTime=Sat Dec 26 15:56:00 CST 2015, time=2015-12-26, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=48038, encodeId=19c44803823, content=难懂, beContent=null, objectType=article, channel=null, level=null, likeNumber=91, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=45101626056, createdName=忠诚向上, createdTime=Sat Dec 26 14:37:00 CST 2015, time=2015-12-26, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=47397, encodeId=5c3e4e39738, content=好深奥, beContent=null, objectType=article, channel=null, level=null, likeNumber=150, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=null, createdBy=ded71629504, createdName=nizongzan, createdTime=Thu Dec 24 07:16:00 CST 2015, time=2015-12-24, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=46919, encodeId=2cc54691909, content=好深奥, beContent=null, objectType=article, channel=null, level=null, likeNumber=92, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=7cde98330, createdName=milkshark, createdTime=Mon Dec 21 07:22:00 CST 2015, time=2015-12-21, status=1, ipAttribution=)]
    2015-12-26 忠诚向上

    难懂

    0

  5. [GetPortalCommentsPageByObjectIdResponse(id=1784624, encodeId=822c1e8462492, content=<a href='/topic/show?id=f32a60e076' target=_blank style='color:#2F92EE;'>#DNACloud#</a>, beContent=null, objectType=article, channel=null, level=null, likeNumber=30, replyNumber=0, topicName=null, topicId=null, topicList=[TopicDto(id=6070, encryptionId=f32a60e076, topicName=DNACloud)], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=11b4465, createdName=ying_wu, createdTime=Tue Mar 01 04:33:00 CST 2016, time=2016-03-01, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=1933576, encodeId=818f19335e617, content=<a href='/topic/show?id=04cb1354312' target=_blank style='color:#2F92EE;'>#OUD#</a>, beContent=null, objectType=article, channel=null, level=null, likeNumber=37, replyNumber=0, topicName=null, topicId=null, topicList=[TopicDto(id=13543, encryptionId=04cb1354312, topicName=OUD)], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=2f5a410, createdName=zxxiang, createdTime=Sat Jan 09 05:33:00 CST 2016, time=2016-01-09, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=48206, encodeId=d3a4482065a, content=值得看,好好收藏, beContent=null, objectType=article, channel=null, level=null, likeNumber=104, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=bc301610909, createdName=hixiaoluo, createdTime=Sat Dec 26 15:56:00 CST 2015, time=2015-12-26, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=48038, encodeId=19c44803823, content=难懂, beContent=null, objectType=article, channel=null, level=null, likeNumber=91, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=45101626056, createdName=忠诚向上, createdTime=Sat Dec 26 14:37:00 CST 2015, time=2015-12-26, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=47397, encodeId=5c3e4e39738, content=好深奥, beContent=null, objectType=article, channel=null, level=null, likeNumber=150, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=null, createdBy=ded71629504, createdName=nizongzan, createdTime=Thu Dec 24 07:16:00 CST 2015, time=2015-12-24, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=46919, encodeId=2cc54691909, content=好深奥, beContent=null, objectType=article, channel=null, level=null, likeNumber=92, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=7cde98330, createdName=milkshark, createdTime=Mon Dec 21 07:22:00 CST 2015, time=2015-12-21, status=1, ipAttribution=)]
    2015-12-24 nizongzan

    好深奥

    0

  6. [GetPortalCommentsPageByObjectIdResponse(id=1784624, encodeId=822c1e8462492, content=<a href='/topic/show?id=f32a60e076' target=_blank style='color:#2F92EE;'>#DNACloud#</a>, beContent=null, objectType=article, channel=null, level=null, likeNumber=30, replyNumber=0, topicName=null, topicId=null, topicList=[TopicDto(id=6070, encryptionId=f32a60e076, topicName=DNACloud)], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=11b4465, createdName=ying_wu, createdTime=Tue Mar 01 04:33:00 CST 2016, time=2016-03-01, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=1933576, encodeId=818f19335e617, content=<a href='/topic/show?id=04cb1354312' target=_blank style='color:#2F92EE;'>#OUD#</a>, beContent=null, objectType=article, channel=null, level=null, likeNumber=37, replyNumber=0, topicName=null, topicId=null, topicList=[TopicDto(id=13543, encryptionId=04cb1354312, topicName=OUD)], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=2f5a410, createdName=zxxiang, createdTime=Sat Jan 09 05:33:00 CST 2016, time=2016-01-09, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=48206, encodeId=d3a4482065a, content=值得看,好好收藏, beContent=null, objectType=article, channel=null, level=null, likeNumber=104, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=bc301610909, createdName=hixiaoluo, createdTime=Sat Dec 26 15:56:00 CST 2015, time=2015-12-26, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=48038, encodeId=19c44803823, content=难懂, beContent=null, objectType=article, channel=null, level=null, likeNumber=91, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=45101626056, createdName=忠诚向上, createdTime=Sat Dec 26 14:37:00 CST 2015, time=2015-12-26, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=47397, encodeId=5c3e4e39738, content=好深奥, beContent=null, objectType=article, channel=null, level=null, likeNumber=150, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=null, createdBy=ded71629504, createdName=nizongzan, createdTime=Thu Dec 24 07:16:00 CST 2015, time=2015-12-24, status=1, ipAttribution=), GetPortalCommentsPageByObjectIdResponse(id=46919, encodeId=2cc54691909, content=好深奥, beContent=null, objectType=article, channel=null, level=null, likeNumber=92, replyNumber=0, topicName=null, topicId=null, topicList=[], attachment=null, authenticateStatus=null, createdAvatar=, createdBy=7cde98330, createdName=milkshark, createdTime=Mon Dec 21 07:22:00 CST 2015, time=2015-12-21, status=1, ipAttribution=)]
    2015-12-21 milkshark

    好深奥

    0

相关资讯

卢光琇教授:大数据时代的临床遗传学策略

12月3日,由生物谷主办的2015下一代测序发展论坛:行业探讨与临床应用于上海斯波特大酒店隆重召开。人类干细胞国家工程研究中心主任,中信湘雅生殖与遗传专科医院院长卢光琇教授参加了会议并为我们带来了精彩的报告"大数据时代的临床遗传学策略"。 大数据在临床遗传学最经典的应用就是基因组学,应用下一代测序技术(NGS)产生的海量数据与基因序列分析技术一起,让发现疾病的过程变得更快、更容易和更便宜。目

如何让Hadoop结合R语言做统计和大数据分析?

前言 写过几篇关于RHadoop的技性文章,都是从统计的角度,介绍如何让R语言利用Hadoop处理大数据。今天决定反过来,从计算机开发人员的角度,介绍如何让Hadoop结合R语言,能做统计分析的事情。 目录 R语言介绍 Hadoop介绍 为什么要让Hadoop结合R语言? 如何让Hadoop结合R语言? R和Hadoop在实际中的案例 1.

Hadoop和大数据:60款**大数据开源工具,包括平台,数据,分析等

说到处理大数据的工具,普通的开源解决方案(尤其是Apache Hadoop)堪称中流砥柱。弗雷斯特调研公司的分析师Mike Gualtieri最近预测,在接下来几年,“100%的大公司”会采用Hadoop。Market Research的一份报告预测,到2011年,Hadoop市场会以58%的年复合增长率(CAGR)高速增长;到2020年,市场产值会超过10亿美元。IBM更是非常看好开源大数据

李彦宏:大数据可以破解中医、癌症之谜

昨天上午,在世界互联网大会“互联网创新与可持续发展”论坛上,百度公司创始人、董事长兼CEO李彦宏发表主旨演讲,分享了他对大数据、人工智能等前沿技术话题的洞察。 尝试证实或证伪中医理论 在演讲中,李彦宏谈到了大数据给医疗带来的机会,他提出,其实可以用大数据的方法进行证实或者证伪中医相关理论。李彦宏谈到,由于过去十几年的积累,人们已经可以看到在大数据、人工智能方面有很多新的机会出现。这

科学家拟用“大数据”解决流感!

几乎每年都发生流感流行。有时新病毒株甚至可以导致全球大流行。近年来发现治疗流感药物对A型流感病毒(IAV)不敏感,产生了耐药性。流感是由流感病毒感染引起的,导致严重的呼吸道症状。病毒依靠宿主分子在呼吸道细胞内繁殖。近年来尝试识别和阻断该进程的宿主分子,以阻止病毒复制。苏黎世大学参与的一项国际研究探究这种方法。来自瑞士、德国和美国的研究团队分析了关于IAV宿主分子的文献。这些研究关注病毒所需的全部基