Analysis

Examples and Considerations of Big Data Information Systems harnessing Machine Learning and Artificial Intelligence

Daniel C Doolan Teaching , , , , , , , , , , , , , , , , , , , , ,

A coursework / assignment that I’ve set for university students studying computing is to write a report that discusses the need for Information Systems in the modern world. The theme in question being: Big Data Information Systems harnessing Machine Learning and Artificial Intelligence.

The report should provide some background / context to the topic, explore the various components and architecture of the Information System, the associated Software Life cycle, the Tools / Technologies / Methodologies to hand and on through to Deployment.

The following is a list of some areas / systems they could consider. Do you have any other interesting examples that you could add in the comments section of a Big Data Information System that makes use of ML & AI tools / techniques?

Formula 1 Real-time Telemetry Data AnalysisMRI Image Analysis
NASA James Webb Space TelescopeEarthquake Early Warning Systems
BOINCHuman Genome Project
Search for Extra Terrestrial IntelligenceLive Face Identification System
Amazon AlexaUncovering the Past with LIDAR
Google AssistantSmart City, Real-time Traffic Analysis
Weather ForecastingMedical Diagnosis
Movie Recommendation SystemsSurface and Subsurface Analysis of Hydrocarbon Potential in the Oil & Gas Industry
Music Recommendation SystemsSentiment Analysis in Social Media
Self Driving VehiclesAutomated Warehouse
Crime PredictionSmart IoT Enabled Retail Shop
Smart Patient Monitoring & Analysis with Bio-medical SensorsCERN Large Hadron Collider
Humanoid Robot (Boston Dynamics)Humanoid Robot (Tesla)

Some of topic areas above may benefit from consideration towards Ethics, Data Protection / GDPR, would such elements also be useful / key things that could/should be given all due consideration in a report exploring Big Data Information Systems. Many interesting considerations can be found in the ACM Code of Ethics and Professional Conduct (poster) (booklet). Do add your thoughts in the comments section.

Do you have any interesting thoughts on the realm of High Performance Computing (HPC) in the form of C / Fortran MPI operations vs the world of Cloud Computing Services, Graphical Processing Unit (GPU), Tensor Processing Unit (TPC) or Quantum Computing? Again would be interesting to hear your thoughts in the comments section.  

Would Explainable AI be of particular importance, particularly with areas such as Medical Diagnosis? Once again comment below on your insights with regard to the need for Explainable AI?

Advertisement

CoVID: Milestones, Data Sources, Dashboards and Visualisations a Data Science World

Daniel C Doolan News , , , , , , , , , , , , , , , , , , , , ,

CoVID Key Milestones

Date Milestone
22/12/2021 UK exceeds 100,000 Daily Cases (106,122)
16/12/2021 China reaches 100,000 Total Cases, +77 cases for the day.
UK by comparison +88,376 for the day.
12/12/2021 Russia reaches 10,000,000+ Cases
06/12/2021 USA reaches 50,000,000+ Cases, 40M+ 31/08/2021, 30M+ 13/03/2021, 20M+ 30/12/2020, 10M+ 06/11/2020)
25/11/2021 UK reaches 10,000,000+ Cases
23/11/2021 Germany reaches 100,000+ Deaths
06/11/2021 Global Cases reach 250,000,000+
29/10/2021 Global Deaths Reach 5,000,000+
31/08/2021 USA reaches 40,000,000+ Cases, 30M+ 13/03/2021, 20M+ 30/12/2020, 10M+ 06/11/2020)
06/08/2021 UK reaches 6,000,000+ Cases
04/08/2021 UK Deaths reach 130,000
03/08/2021 Global Cases exceed 200,000,000 (28/04/2021 150M, 25/01/2021 100M, 07/11/2020 50M Cases recorded)
08/07/2021 UK reaches 5,000,000+ Cases
05/07/2021 Global Deaths Reach 4,000,000+
28/04/2021 Global Cases exceed 150,000,000 (25/01/2021 100M, 07/11/2020 50M Cases recorded)
26/04/2021 Global Deaths Reach 3,120,000+ => 400 per 1M World Population
16/04/2021 Global Deaths Reach 3,000,000+
13/03/2021 USA reaches 30,000,000+ Cases, 20M+ 30/12/2020, 10M+ 06/11/2020)
24/02/2021 Global Deaths Reach 2,500,000+
26/01/2021 UK Deaths exceed 100,000
26/01/2021 Indonesia (first country to reach 1M+ in 2021) joins South Africa, Ukraine, Peru, Turkey, Iran, Poland, Germany, Mexico, Italy, UK, Colombia, France, Argentina, Spain, Russia, India, Brazil and USA in having 1M+ Cases (19 Countries now at 1M+ cases)
25/01/2021 Global Cases exceed 100,000,000
16/01/2021 Global Active Cases exceeds 25,000,000
15/01/2021 USA exceeds 400,000 Deaths
14/01/2021 Global Deaths Reach 2,000,000+
05/01/2021 India Reaches 150,000+ CoVID Deaths
05/01/2021 UK Daily Cases exceed 60,000 (60,916)
04/01/2021 Global Cases Reach 85.8M => 11K/1M => 1.1% world population
03/01/2021 Ireland Reaches 100,000+ Cases
03/01/2021 UK Reaches 75,000+ CoVID Deaths
01/01/2021 UK reaches 2,500,000+ Cases
31/12/2020 2020 End of Year Summary
Global Cases: 83,793,959, (10,750/1M)
Global Deaths: 1,824,915, (234.1/1M)
Global Active Cases: 22,648,237
Global Serious Critical Cases: 106,365   

101 Countries at 25K+ of which 90 at 50K+, 76 at 100K+, 48 at 200K+, 38 at 300K+, 34 at 400K+, 27 at 500K+, 24 at 600K+, 21 at 700K+, 18 at 1M+, 8 at 2M+, Russia at 3.1M, Brazil at 7.6M, India at 10.2M, USA at 20.4M

USA Cases: 20,445,654, Deaths: 354,215
India Cases: 10,286,329, Deaths: 149,018
Brazil Cases: 7,675,973, Deaths: 194,976
Russia Cases: 3,159,297, Deaths: 57,019
UK Cases: 3,159,297, Deaths: 57,019
Ireland Cases: 91,779, Deaths: 2,237
China Cases: 87,052, Deaths: 4,634

Greatest Daily Cases: 30/12/2020 at 744,664
Greatest Daily Deaths: 30/12/2020 at 15,124
30/12/2020 Global Daily Deaths exceed 15,000
30/12/2020 USA exceeds 350,000 Deaths
30/12/2020 USA reaches 20,000,000+ Cases, a 5M+ increase in just two dozen days (had reached 15M+ 06/12/2020, a 50% increase from 10M+ a month before 10M+ 06/11/2020)
29/12/2020 First person in Ireland receives vaccine (online)
29/12/2020 Cases in Ireland 88,439 (now in 80th position) exceed that of China 87,003 (81st).
Ireland population 4,964,891, China population 1,439,323,776 (~290 times greater).
Bahrain 79th position with 91,935 Cases and population of 1,730,072 therein China’s population is ~832 times greater.
29/12/2020 UK Daily Cases exceed 50,000 (53,135)
28/12/2020 UK Daily Cases exceed 40,000 (41,385)
28/12/2020 Brazil reaches 7,500,000+ Cases
27/12/2020 South Africa joins Ukraine, Peru, Turkey, Iran, Poland, Germany, Mexico, Italy, UK, Colombia, France, Argentina, Spain, Russia, India, Brazil and USA in having 1M+ Cases (18 Countries now at 1M+ cases)
25/12/2020 Global Cases Reach 80M
25/12/2020 Global Deaths Reach 1,750,000+
25/12/2020 UK Reaches 70,000+ CoVID Deaths
24/12/2020 Italy becomes 8th country to exceed 2,000,000+ Cases
24/12/2020 Ukraine joins Peru, Turkey, Iran, Poland, Germany, Mexico, Italy, UK, Colombia, France, Argentina, Spain, Russia, India, Brazil and USA in having 1M+ Cases (17 Countries now at 1M+ cases)
22/12/2020 Global Cases Reach 78.3M => 10K/1M => 1.0% world population
22/12/2020 Peru joins Turkey, Iran, Poland, Germany, Mexico, Italy, UK, Colombia, France, Argentina, Spain, Russia, India, Brazil and USA in having 1M+ Cases (16 Countries now at 1M+ cases)
19/12/2020 UK reaches 2,000,000+ Cases
18/12/2020 India reaches 10,000,000+ Cases
16/12/2020 USA exceeds 250,000 Daily Cases
16/12/2020 Global Daily Deaths exceed 13,500
13/12/2020 Global Active Cases exceeds 20,000,000
12/12/2020 Turkey joins Iran, Poland, Germany, Mexico, Italy, UK, Colombia, France, Argentina, Spain, Russia, India, Brazil and USA in having 1M+ Cases (15 Countries now at 1M+ cases) Turkey had been just below 1M, then suddenly changed to being over 1.75M (10/12/2020) on track for 1M+ 12/12/2020 at original rate of change
11/12/2020 USA exceeds 300,000 Deaths
11/12/2020 Global Daily Cases Reach 700K
10/12/2020 Global Cases Reach 70.4M => 9K/1M => 0.9% world population
10/12/2020 70 Countries now with 100,000+ Cases, of which 25 Countries are 500,000+
09/12/2020 Global Cases Reach 70M
09/12/2020 USA Exceeds 3000 Daily Deaths
08/12/2020 First person in the UK receives vaccine (online)
06/12/2020 USA reaches 15,000,000+ Cases (a 50% increase on the 10M+ cases just one month before 06/11/2020)
04/12/2020 40 Countries now with 200,000+ Cases of which 26 are 500,000+ and 14 are 1,000,000+
03/12/2020 Global Deaths Reach 1,500,000+
03/12/2020 Iran joins Poland, Germany, Mexico, Italy, UK, Colombia, France, Argentina, Spain, Russia, India, Brazil and USA in having 1M+ Cases (14 Countries now at 1M+ cases)
03/12/2020 UK Reaches 60,000+ CoVID Deaths
02/12/2020 Poland joins Germany, Mexico, Italy, UK, Colombia, France, Argentina, Spain, Russia, India, Brazil and USA in having 1M+ Cases (13 Countries now at 1M+ cases)
02/12/2020 Global Daily Deaths exceed 12,500
28/11/2020 Global Cases Reach 62.3M => 8K/1M => 0.8% world population
26/11/2020 Germany joins Mexico, Italy, UK, Colombia, France, Argentina, Spain, Russia, India, Brazil and USA in having 1M+ Cases (12 Countries now at 1M+ cases)
25/11/2020 Global Cases Reach 60M
21/11/2020 60 Countries now with 100,000+ Cases
20/11/2020 USA exceeds 200,000 Daily Cases
17/11/2020 Global Serious Critical Cases reach 100,000+
15/11/2020 Global Cases Reach 54.6M => 7K/1M => 0.7% world population
15/11/2020 Mexico joins Italy, UK, Colombia, France, Argentina, Spain, Russia, India, Brazil and USA in having 1M+ Cases (11 Countries now at 1M+ cases)
14/11/2020 USA exceeds 250,000 Deaths
14/11/2020 Global Active Cases exceeds 15,000,000
12/11/2020 20 Countries now with 500,000+ Cases, of which 10 Countries are 1,000,000+
11/11/2020 Global Daily Deaths exceed 10,000
11/11/2020 Italy joins UK, Colombia, France, Argentina, Spain, Russia, India, Brazil and USA in having 1M+ Cases (10 Countries now at 1M+ cases)
11/11/2020 UK Reaches 50,000+ CoVID Deaths
07/11/2020 Global Cases Reach 50M
06/11/2020 USA reaches 10,000,000+ Cases
05/11/2020 Global Daily Cases Reach 600K
05/11/2020 Global Serious Critical Cases reach 90,000+
04/11/2020 Global Active Cases exceeds 12,500,000
01/11/2020 Global Cases Reach 46.77M => 6K/1M => 0.6% world population
31/10/2020 50 Countries now with 100,000+ Cases of which 32 are 200,000+, 20 are 400,000+ and 9 are 1,000,000+
31/10/2020 UK joins Colombia, France, Argentina, Spain, Russia, India, Brazil and USA in having 1M+ Cases
30/10/2020 USA Daily Cases Reach 100K, (Daily Cases Reach 573K)
30/10/2020 Global Cases Exceed 1,000,000,000 given current case numbers of 45.89M, computed by factoring up on WHO Estimates (05/10/2020) 10% of world population contracted CoVID (online) ~780M ~22x greater than recorded cases of 35.75M
28/10/2020 Global Daily Cases Reach 500K
28/10/2020 Global Serious Critical Cases reach 80,000+
24/10/2020 Colombia joins France, Argentina, Spain, Russia, India, Brazil and USA in having 1M+ Cases
24/10/2020 Global Active Cases exceeds 10,000,000
23/10/2020 France joins Argentina, Spain, Russia, India, Brazil and USA in having 1M+ Cases
19/10/2020 Argentina joins Spain, Russia, India, Brazil and USA in having 1M+ Cases
18/10/2020 Spain joins Russia, India, Brazil and USA in having 1M+ Cases
18/10/2020 Global Cases Reach 40M
16/10/2020 Global Daily Cases Reach 400K
15/10/2020 Global Cases Reach 39M => 5K/1M => 0.5% world population
14/10/2020 Global Serious Critical Cases reach 70,000+
05/10/2020 WHO Estimates 10% of world population contracted CoVID (online) ~780M ~22x greater than recorded cases of 35.75M
27/09/2020 Global Deaths Reach 1,000,000+
27/09/2020 Global Active Cases 7.5M
20/09/2020 Global Cases Reach 31.2M => 4K/1M => 0.4% world population
16/09/2020 Global Cases Reach 30M
15/09/2020 USA exceeds 200,000 Deaths
04/09/2020 Global Daily Cases Reach 300K
01/09/2020 Russia joins India, Brazil and USA in having 1M+ Cases
23/08/2020 Global Cases Reach 23.5M => 3K/1M => 0.3% world population
09/08/2020 Global Cases Reach 20M
18/07/2020 Global Active Cases 5M
23/07/2020 Global Cases Reach 15.6M => 2K/1M => 0.2% world population
16/07/2020 India joins Brazil and USA in having 1M+ Cases
02/07/2020 Global Daily Cases Reach 200K
27/06/2020 Global Cases Reach 10M => 1.28K/1M => 0.128% world population
19/06/2020 Brazil joins USA in having 1M+ Cases
13/06/2020 Global Cases Reach 7.795M => 1K/1M => 0.1% world population
22/05/2020 USA exceeds 100,000 Deaths
20/05/2020 Global Daily Cases Reach 100K
20/05/2020 Global Cases Reach 5M
16/05/2020 Global Active Cases 2.5M
27/04/2020 USA reaches 1M+ Cases
06/04/2020 Global Active Cases 1M
01/04/2020 Global Cases Reach 1M
24/03/2020 Global Cases Reach 500K
17/03/2020 Global Cases Reach 250K
04/03/2020 Global Cases Reach 100K
12/02/2020 Global Cases Reach 50K

Table data sourced from worldometers (online).

The following sources / links provide a selection of data and visualisations regarding the spread of the CoVID-19 virus. You may perhaps find it useful to bookmark them and look in from time to time to get some sense of the Coronavirus progression.

These graphs, visualisations, dashboards are a clear example of where Computer Science / Data Science can help distill and enhance ones understanding of a problem domain. Such systems will become all the more common as we move to a world of Smart Homes, Smart Cities, Smart Countries and a Smart Planet. The Internet of Things coupled with Cloud Computing Services, Data Analysis, improved communications throughput speeds and Mobile Computing will provide us with a far more integrated and real-time world than we know of today.

Global Level Sites

  • Worldometers, Detailed country by country tables, cases, deaths, population data, graphs (online)
  • Interactive World Map Visualisation Dashboard by Johns Hopkins University (JHU) (online)
  • John Hopkins University, Coronavirus Resouces Centre, World Map, US Map and Critical Trends (online)
  • World Health Organisation, situation reports [pdfs compiled each day] (online)
  • World Health Organisation, World Map Dashboard, with graphs by region / country (online)
  • ncov2016, Series of world and region level table summaries (online)
  • European Centre for Disease Prevention and Control, Dashboard, World Map and Graphs (online)
  • University of Virginia, Biocomplex Institute, Dashboard, Worldmap and Graphs (online)

Country Specific Sites

  • Ireland’s CoVID19 Data Hub (online)
  • Coronavirus (COVID-19) in the UK (online)
  • Coronavirus (COVID-19) in the UK (online)
  • Centre for Disease Control, United States Map (online)

Comments, Reply’s, Thoughts, Questions

  • If you know of any other interesting data sources or visualisations, then perhaps you can add a reply/comment to this post, and the list can be duly updated.
  • What are your thoughts on: The Internet of Things, Cloud Computing, Data Analysis, improved communications throughput speeds, Mobile Computing and what will the SmartWorld of tomorrow be like?
  • Will Smart Clothes that can monitor our vitals become the norm?

Some Key CoVID Milestone Tweets

The following tweets capture some key milestones, such as reaching 1K cases per 1M population 13th June 2020, or reaching 10M cases just two weeks later on the 27th June 2020. At the time of publishing this post 6th July 2020 the number of cases have reached 0.15% of world population (online). Hence in a little over three weeks the number of global cases have increased 50%, i.e. moving from 1K/1M to 1.5K/1M. We have also seen several recent days where >200K new cases are reported each day.