Network Information Theory

Modules and Lectures

We provide three modules which consist of two lectures, the first half takes place in the summer term and the second half in the winter term. The students will be examined in an oral exam and will receive 6 CPs. Exchange students receive 3 CPs for each lecture.

Moreover we offer a project module which takes place every semester.

Course Offering: Winter semester 2023/24

ModuleCurrent LectureLecturerSWSTimeEnrollment 
Mathematics of Machine LearningMathematical Introduction to Machine Learning (VL)Dr. rer. nat. Igor Bjelakovic2Wed, 12am-2pm (18.10.23- 14.02.24)ISIS
Modern Signal Processing for CommunicationsMathematical Introduction to Machine Learning (VL)Dr. rer. nat. Igor Bjelakovic2Wed, 12am-2pm (18.10.23- 14.02.24)ISIS
Modern Wireless CommunicationsFundamentals of Digital Wireless Communications (VL)Prof. Dr.-Ing. Slawomir Stanczak2Mon, 12am-2pm (16.10.23- 12.02.24)ISIS
Master Project Network Information SystemsNetwork Information Systems(PJ)Dr.-Ing. Julius Schulz-Zander6 ISIS

Course Offering: Summer semester 2023

ModuleCurrent LectureLecturerSWSTimeEnrollment
Mathematics of Machine LearningTheory and Algorithms of Machine Learning for Communication (VL)Prof. Dr.-Ing. Slawomir Stanczak2Mon, 2pm- 4pm c.t. (17.04.23- 17.07.23)ISIS
Modern Signal Processing for CommunicationsModern Signal Processing for Communications (VL)Dr. Renato L.G. Cavalcante2Tue, 2pm -4pm c.t. (18.04.23- 18.07.23)ISIS
Modern Wireless CommunicationsSelected Topics in Wireless Communications and Networking (VL)Dr. Ing. Zoran Utkovski2Tue, 4pm -6pm c.t. (18.04.23- 18.07.23)ISIS
Master Project Network Information SystemsNetwork Information Systems(PJ)Dr.-Ing. Julius Schulz-Zander6 ISIS
     

Module Overview

1. Mathematics of Machine Learning

Module Components:

  • Link to the module in MOSES
  • 6 Credit Points
  • Module No.: 40894
  • Person in Charge: Dr.rer.nat. Igor Bjelakovic, Prof. Dr.-Ing. Slawomir Stanczak
  • Course Names:
    • SS : Theory and Algorithms of Machine Learning for Communications
    • WS : Mathematical Introduction to Machine Learning

Learning Objectives:
After completing the module the students will have a solid understanding of theoretical foundations of Machine Learning and will be able to develop, apply, and analyze the complexity of the resulting learning algorithms. Moreover, a special emphasis will be put on applications of Machine Learning in areas such as Signal Processing and Wireless Communications and the students will be able to theoretically analyze and algorithmically solve learning problems arising in these fields.

Content:
Learning Model, Learning via Uniform Convergence, Bias-Complexity Tradeoff, Stochastic Inequalities and Concentration of Measure, Suprema of empirical Processes, Vapnik- Chervonenkis Dimension (VC Dimension), Nonuniform Learning, Runtime of Learning, Hilbert Spaces and Projection Methods, Kernel and Multi-Kernel Methods, Information Innovation, Regularization, Dimension Reduction and Compressive Sensing

2. Modern Signal Processing for Communications

Module Components:

  • Link to the module in MOSES
  • 6 Credit Points
  • Module No.: 40829
  • Person in Charge: Dr.rer.nat. Igor Bjelakovic, Dr. Renato L.G. Cavalcante
  • Course Names:
    • SS : Modern Signal Processing for Communications
    • WS : Mathematical Introduction to Machine Learning

Learning Objectives:
After completion of this module, the students have the ability to apply various methods and tools of modern signal processing to solve problems in a broad area of wireless communications. Moreover, they will better understand the fundamental relationships in wireless networks and obtain valuable insights into the design and operation of such networks. Finally the lecture intends to convey a comprehensive understanding of selected theoretical concepts used in wireless network optimization such as random matrix theory and non-linear Perron-Frobenius theory.

Content:

  • Modern signal processing methods for interference reduction in spread spectrum and MIMO systems, adaptive beamforming, PAPR reduction in OFDM systems, acoustic source localization with wireless sensor networks, environmental modeling in wireless multi-agent systems
  • Fundamentals of (convex) optimization theory, projection methods, principles of convex relaxation
  • Axiomatic framework for interference modeling, existence and uniqueness of fixed points, fixed-point algorithms, applications of standard interference functions
  • Non-linear Perron-Frobenius theory
  • (Non-asymptotic) random matrix theory

3. Modern Wireless Communications

Module Components:

  • Link to the module in MOSES
  • 6 Credit Points
  • Module No.: 40828
  • Person in Charge: Prof. Dr.-Ing. Slawomir Stanczak, Dr.-Ing. Zoran Utkovski
  • Course Names:
    • WS : Selected Topics in Wireless Communications and Networking
    • WS : Fundamentals of Digital Wireless Communications

Learning Objectives:
After completing this module, the students will have a basic knowledge of wireless communications systems and they will be able to master some fundamental mathematical methods that are widely used in the analysis and optimization of modern wireless communications systems. In particular, the students will learn how to model the wireless channel and how to exploit the spatial diversity using multiple antenna systems. Further the lectures intends to convey a basic understanding of modern modulation and multiple access techniques such as CDMA and OFDMA. Regarding the mathematical methods for the analysis and optimization of wireless communications systems, the students will learn how to use mathematical methods when designing modern wireless communications networks. In doing so the lectures will combine the mathematical precision with practical examples. As a result, the acquired knowledge will enable the students to better understand complex interdependencies in such networks, which is essential for efficient design and operation of wireless networks.Content:

  • A brief overview of typical wireless communications scenarios, the main challenges and differences when compared with wired communications
  • Wireless channel as a time-varying linear system (time-varying impulse response), large-scale and small-scale fading, multi-path fading, existing approaches to modeling of wireless channels
  • Basic principles of stochastic modeling for wireless channels, Rayleigh and Rician channels, log-normal shadowing
  • Time-frequency correlation functions, wide-sense stationary uncorrelated scattering model, Doppler spread and coherence time, delay spread and coherence bandwidth, flat versus frequency-selective fading
  • Performance measures used in wireless communications: signal-to-noise ratio, rate, ergodic capacity, outage capacity, delay-limited capacity
  • Definitions of time, frequency and spatial diversity, other notions of diversity
  • Some basic diversity techniques including repetition coding, maximal ratio combiner (RAKE receiver), receive antenna diversity (SIMO), transmit antenna diversity (MISO), the impact of channel state information
  • Principlesofspread-spectrumtechniques and orthogonal frequency division multiplex(OFDM)
  • Basic multiaccess techniques including TDMA, FDMA, DS-CDMA and OFDMA
  • Mathematical methods that are used to solve many real-world problems in modern wireless communications systems/networks. As concrete applications that are in the focus of the lectures, we cite interference reduction in spread spectrum and MIMO systems, adaptive beamforming, PAPR reduction in OFDM systems. In particular, a special attention is attached to the following topics: basic principles of (functional) analysis that are relevant in the design of modern communications systems, fundamentals of matrix analysis, fundamentals of (convex) optimization theory, projection methods, principles of convex relaxation, algorithm design, convergence properties.

4. Master Project Network Information Systems

Project Components:

  • Link to the project module in MOSES
  • 9 Credit Points
  • 6 SWS
  • Module No.: #41020 / #1
  • Person in Charge: Dr.-Ing. Julius Schulz-Zander
  • Cycle: every summer and winter semester
  • Course Name:
    • Network Information Systems (No. 3433 L837)

Learning Outcomes:
Students acquire methods and skills to solve a scientific question in the area of network information systems. They can formulate scientific questions as well as to proof or disprove a hypothesis in this field. In particular, they can systematically produce and publish results to validate the thesis and derive conclusions for further studies in this research area. Furthermore, students are able to pursue research approaches independently and to critically review related work in this field.

Content:
Network information systems are continuously improved to connect an ever-increasing number of computing devices and to fulfil a wide range of different requirements. In particular, higher throughput, lower latency, and higher reliability paved the the way for future application scenarios, e.g., augmented reality, autonomous driving, and reliable industrial communication. However, new use cases often come with new requirements implying that wireless communication systems need to be adapted continuously. In the project, students will develop solutions for selected topics in the area of network information systems. Students work with a member of our institute on a current research topic. In particular, students will design, implement, and evaluate prototypes improving network information systems.

Teaching and Learning Methods:
Topics will be individually determined based on skills and capacity. A researcher of our group will supervise the project. We expect students to have prior experience in network information systems. Moreover, good analytical and programming skills are required. Students realize a prototype in the area of network information systems. Students will write a technical report and present their results.

Assigned Degree Programs: