KGC


[ Japanese ]
INTERNET MEASUREMENT AND DATA ANALYSIS (GIGA)

NEWS


TitleINTERNET MEASUREMENT AND DATA ANALYSIS (GIGA) [ Syllabus ]
http://web.sfc.keio.ac.jp/~kjc/classes/sfc2012f-measurement/


Faculty Kenjiro Cho
Term2012 Fall
Level Undergraduate


Inquiry - Inquiry about this course


Lecture Video & MaterialsFlash Player
Flash Player is required to play the videos.
Click the lecture title to see lecture materials and video
#012012/09/26 Introduction
- lecture slides (pdf) (URL)
- reading material (pdf) (URL)
	Big Data and Collective Intelligence,

	Internet measurement,

	Large-scale data analysis,

	exercise: introduction of Ruby scripting language


#022012/10/03 Data and variability
- lecture slides (pdf) (URL)
- exercise data (marathon.txt) (URL)
	Summary statistics,

	Sampling,

	How to make good graphs,

	exercise: graph plotting by Gnuplot


#032012/10/17 Data recording and log analysis
- lecture slides (pdf) (URL)
- exercise data (sample_access_log.bz2 (14MB)) (URL)
- exercise data (sample_access_log.zip (28MB)) (URL)
- exercise data (test-100lines) (URL)
	Network management tools,

	Data format,

	Log analysis methods,

	exercise: log data and regular expression


#042012/10/24 Distribution and confidence intervals
- lecture slides (pdf) (URL)
- data for assignment 1 (URL)
	Normal distribution,

	Confidence intervals and statistical tests,

	Distribution generation,

	exercise: confidence intervals,

	assignment 1


#052012/10/31 Diversity and complexity
- lecture slides (pdf) (URL)
	Long tail,

	Web access and content distribution,

	Power-law and complex systems,

	exercise: power-law analysis


#062012/11/07 Correlation
- exercise data 2 (URL)
- lecture slides (pdf) (URL)
- exercise data 1 (URL)
	Online recommendation systems,

	Distance,

	Correlation coefficient,

	exercise: correlation analysis


#072012/11/14 Multivariate analysis
- lecture slides (pdf) (URL)
	Data sensing,

	Linear regression,

	Principal Component Analysis,

	exercise: linear regression


#082012/11/20 Time-series analysis
- lecture slides (pdf) (URL)
- exercise data (autocorr_5min_data.txt) (URL)
- exercise data (ifbps-2011.txt) (URL)
- data for assignment 2 (URL)
	Internet and time,

	Network Time Protocol,

	Time series analysis,

	exercise: time-series analysis,

	assignment 2


#092012/11/28 Topology and graph
- lecture slides (pdf) (URL)
- exercise data (topology.txt) (URL)
- exercise script (dijkstra.rb) (URL)
	Routing protocols,

	Graph theory,

	exercise: shortest-path algorithm


#102012/12/05 Anomaly detection and machine learning
- lecture slides (pdf) (URL)
- exercise script (naivebayes.rb) (URL)
	Anomaly detection,

	Machine Learning,

	SPAM filtering and Bayes theorem,

	exercise: naive Bayesian filter


#112012/12/12 Data Mining
- lecture slides (pdf) (URL)
- exercise script (k-means.rb) (URL)
- exercise data (km-data.txt) (URL)
	Pattern extraction,

	Classification,

	Clustering,

	exercise: clustering


#122012/12/19 Search and Ranking
- lecture slides (pdf) (URL)
- exercise script (pagerank.rb) (URL)
- exercise data (sample-links.txt) (URL)
- final report data (links-simple-sorted.zip) (323MB) (URL)
- final report data (links-100k.zip) (14MB) (URL)
- final report data (titles-sorted.zip) (28MB) (URL)
	Search systems,

	PageRank,

	exercise: PageRank algorithm


#132012/12/26 Scalable measurement and analysis
- lecture slides (pdf) (URL)
	Distributed parallel processing,

	Cloud computing technology,

	MapReduce,

	exercise: MapReduce algorithm


#142013/01/09 Privacy Issues
- lecture slides (pdf) (URL)
	Internet data analysis and privacy issues,

	Summary of the class



Powered by SOI Copyright(c) 2002-2019, Keio University Shonan Fujisawa Campus. All rights reserved.
Copyright of this site