KGC


[ Japanese ]
INTERNET MEASUREMENT AND DATA ANALYSIS (GIGA)

NEWS


TitleINTERNET MEASUREMENT AND DATA ANALYSIS (GIGA) [ Syllabus ]
http://web.sfc.keio.ac.jp/~kjc/classes/sfc2013f-measurement/


Faculty Kenjiro Cho
Term2013 Fall
Level Undergraduate


Inquiry - Inquiry about this course


Lecture Video & MaterialsFlash Player
Flash Player is required to play the videos.
Click the lecture title to see lecture materials and video
#012013/09/25 Introduction
- reading material (URL)
- lecture slides (pdf) (URL)
- Big Data and Collective Intelligence
- Internet measurement
- Large-scale data analysis
- exercise: introduction of Ruby scripting language


#022013/10/02 Data and variability
- lecture slides (pdf) (URL)
- excercise data (marathon.txt) (URL)
- Summary statistics
- Sampling
- How to make good graphs
- exercise: graph plotting by Gnuplot


#032013/10/09 Data recording and log analysis
- lecture slides (pdf) (URL)
- exercise data (sample_access_log.zip (20MB)) (URL)
- exercise script (parse_accesslog.rb) (URL)
- Network management tools
- Data format
- Log analysis methods
- exercise: log data and regular expression


#042013/10/23 Distribution and confidence intervals
- lecture slides (pdf) (URL)
- data for assignment 1 (honolulu-marathon-2012.txt) (URL)
- Normal distribution
- Confidence intervals and statistical tests
- Distribution generation
- exercise: confidence intervals
- assignment 1


#052013/10/30 Diversity and complexity
- lecture slides (pdf) (URL)
- Long tail
- Web access and content distribution
- Power-law and complex systems
- exercise: power-law analysis


#062013/11/06 Correlation
- lecture slides (pdf) (URL)
- exercise data (correlation-data-1.txt) (URL)
- exercise data (correlation-data-2.txt) (URL)
- Online recommendation systems
- Distance
- Correlation coefficient
- exercise: correlation analysis


#072013/11/13 Multivariate analysis
- lecture slides (pdf) (URL)
- Data sensing
- Linear regression
- Principal Component Analysis
- exercise: linear regression


#082013/11/27 Time-series analysis
- lecture slides (pdf) (URL)
- exercise data (autocorr_5min_data.txt) (URL)
- exercise data (ifbps-2011.txt) (URL)
- data for assignment 2 (twitter_degrees.zip) (164MB) (URL)
- data for assignment2 (numeric2screen.zip) (365MB) (URL)
- Internet and time
- Network Time Protocol
- Time series analysis
- exercise: time-series analysis
- assignment 2


#092013/12/04 Topology and graph
- lecture slides (pdf) (URL)
- exercise data (topology.txt) (URL)
- exercise script (dijkstra.rb) (URL)
- Routing protocols
- Graph theory
- exercise: shortest-path algorithm


#102013/12/11 Anomaly detection and machine learning
- lecture slides (pdf) (URL)
- exercise script (naivebayes.rb) (URL)
- exercise data (km-data.txt) (URL)
- Anomaly detection
- Machine Learning
- SPAM filtering and Bayes theorem
- exercise: naive Bayesian filter


#112013/12/18 Data Mining
- lecture slides (pdf) (URL)
- exercise script (k-means.rb) (URL)
- Pattern extraction
- Classification
- Clustering
- exercise: clustering


#122013/12/25 Search and Ranking
- lecture slides (pdf) (URL)
- exercise script (pagerank.rb) (URL)
- exercise data (sample-links.txt) (URL)
- data for final report (links-simple-sorted.zip) (324MB) (URL)
- sample data for final report (links-100k.zip) (URL)
- data for final report (titles-sorted.zip) (URL)
- Search systems
- PageRank
- exercise: PageRank algorithm


#132014/01/08 Scalable measurement and analysis
- lecture slides (pdf) (URL)
- Distributed parallel processing
- Cloud computing technology
- MapReduce
- exercise: MapReduce algorithm



Powered by SOI Copyright(c) 2002-2019, Keio University Shonan Fujisawa Campus. All rights reserved.
Copyright of this site