KGC


[ Japanese ]
INTERNET MEASUREMENT AND DATA ANALYSIS (GIGA)

NEWS


TitleINTERNET MEASUREMENT AND DATA ANALYSIS (GIGA) [ Syllabus ]
http://web.sfc.keio.ac.jp/~kjc/classes/sfc2014f-measurement/


Faculty Kenjiro Cho
Term2014 Fall
Level Undergraduate


Inquiry - Inquiry about this course


Lecture Video & MaterialsFlash Player
Flash Player is required to play the videos.
Click the lecture title to see lecture materials and video
#012014/09/22 Introduction
- lecture slides (pdf) (URL)
- exercise script (count.rb) (URL)
- optional reading material (URL)
- Big Data and Collective Intelligence
- Internet measurement
- Large-scale data analysis
- exercise: introduction of Ruby scripting language


#022014/09/29 Data and variability
- lecture slides (pdf) (URL)
- exercise data (marathon.txt) (URL)
- exercise script (mean.rb) (URL)
- exercise script (median.rb) (URL)
- exercise script (stddev2.rb) (URL)
- Summary statistics
- Sampling
- How to make good graphs
- exercise: graph plotting by Gnuplot


#032014/10/20 Data recording and log analysis
- lecture slides (pdf) (URL)
- exercise data (sample_access_log.zip) (21MB) (URL)
- exercise script (parse_accesslog.rb) (URL)
- exercise script (access.plt) (URL)
- Network management tools
- Data format
- Log analysis methods
- exercise: log data and regular expression


#042014/10/27 Distribution and confidence intervals
- exercise script (box-muller-hist.plt) (URL)
- exercise script (conf-interval.rb) (URL)
- lecture slides (pdf) (URL)
- exercise script (box-muller.rb) (URL)
- exercise script (box-muller-hist.rb) (URL)
- exercise script (conf-interval.plt) (URL)
- Normal distribution
- Confidence intervals and statistical tests
- Distribution generation
- exercise: confidence intervals
- assignment 1


#052014/11/10 Diversity and complexity
- lecture slides (pdf) (URL)
- exercise script (count_contents.rb) (URL)
- exercise script (make_ccdf.rb) (URL)
- exercise script (ccdf.plt) (URL)
- Long tail
- Web access and content distribution
- Power-law and complex systems
- exercise: power-law analysis


#062014/11/17 Correlation
- lecture slides (pdf) (URL)
- exercise script (correlation.rb) (URL)
- exercise data (correlation-data-1.txt) (URL)
- exercise data (correlation-data-2.txt) (URL)
- exercise script (similarity.rb) (URL)
- exercise data (scores.txt) (URL)
- Online recommendation systems
- Distance
- Correlation coefficient
- exercise: correlation analysis


#072014/12/01 Multivariate analysis
- lecture slides (pdf) (URL)
- exercise script (leastsquare.rb) (URL)
- exercise script (regress-1.plt) (URL)
- exercise script (regress-2.plt) (URL)
- Data sensing and GeoLocation
- Linear regression
- Principal Component Analysis
- exercise: linear regression


#082014/12/08 Time-series analysis
- lecture slides (pdf) (URL)
- exercise data (autocorr_5min_data.txt) (URL)
- exercise data (ifbps-201205.txt) (URL)
- exercise script (autocorr.rb) (URL)
- exercise script (autocorr.plt) (URL)
- exercise script (hourly_out.rb) (URL)
- exercise script (hourly_out.plt) (URL)
- exercise script (weekview_out.rb) (URL)
- exercise script (week_out.plt) (URL)
- exercise script (correlation_out.rb) (URL)
- Internet and time
- Network Time Protocol
- Time series analysis
- exercise: time-series analysis
- assignment 2


#092014/12/15 Topology and graph
- lecture slides (pdf) (URL)
- exercise data (topology.txt) (URL)
- exercise script (dijkstra.rb) (URL)
- Routing protocols
- Graph theory
- exercise: shortest-path algorithm


#102014/12/22 Anomaly detection and machine learning
- lecture slides (pdf) (URL)
- exercise script (naivebayes.rb) (URL)
- Anomaly detection
- Machine Learning
- SPAM filtering and Bayes theorem
- exercise: naive Bayesian filter


#112015/01/14 Data Mining
- lecture slides (pdf) (URL)
- exercise script (k-means.rb) (URL)
- exercise data (km-data.txt) (URL)
- exercise script (km-results.plt) (URL)
- Pattern extraction
- Classification
- Clustering
- exercise: clustering


#122015/01/19 Search and Ranking
- lecture slides (pdf) (URL)
- exercise script (pagerank.rb) (URL)
- exercise data (sample-links.txt) (URL)
- exercise data (links-100k.txt) (URL)
- Search systems
- PageRank
- exercise: PageRank algorithm



Powered by SOI Copyright(c) 2002-2019, Keio University Shonan Fujisawa Campus. All rights reserved.
Copyright of this site