Adaptive Real-Time RTP Streaming and IPTV over the wired Internet

Goal: Improvement of IP-based real-time Multimedia delivery systems for wired channels like ADSL
The delivery of real-time media data via the unreliable protocol UDP over wired channels like ADSL is analyzed in this project. The problem of network congestion and its relationship to the real-time media is mainly investigated. The extensive use of congestion unaware protocols like UDP could lead to uncontrollable loss and congestion scenarios. An important task is the interaction with congestion avoiding protocols like TCP and the development of strategies for a TCP-friendly media delivery. Therefore the protocols used for media transport RTP/RTCP are extended with Acknowledgement (ACK) packets for use in a transmission rate and congestion control algorithm on the Application Layer. Depending on the incoming ACK packets the server is adjusting the transmission rate to the available transmission rate and performs retransmission if required and reasonable. By adjusting the transmission rate the media rate has to be adjusted as well in dependence on the client buffer. For the media rate adjustment techniques like Temporal Scalability and Bit Stream Switching are used.
In a certain degree technologies like ADSL can solve the last mile problem. Thus data rates for HD IPTV are available at home. First analysis has been conducted regarding the H.264/MPEG4-AVC coding efficiency in relation to delay constraints. A result was that HD resolutions like 720p can be transferred at bit rates from 3-5 MBit/s. The HD transmission was realized with the adaptive RTP real-time streaming system. The work was conducted with special emphasis on the demonstration of the feasibility of such a service. Currently the described approaches are analyzed together with the use of the scalable extensions of H.264/MPEG4-AVC and in Internet Broadcast scenarios.
The work has been published at international conferences [1]. Proposal have been made at the ISMA [3][2] by that a new work item has been launched. The streaming system has been presented at different exhibitions [4][5].

Transmission and media rate adaptation methods used in the adaptive streaming system

H.264/MPEG4-AVC Temporal Layers used for media rate adaptation

Bit Stream Switching for media rate adaptation at H.264/MPEG4-AVC IDR pictures

Publications

Publications in Conference Proceedings

2004

  • Thomas Schierl and Thomas Wiegand:
    H.264/AVC Rate Adaptation for Internet Streaming,
    14th International Packet Video Workshop (PV), Irvine, CA, USA, December 2004.
  • Huu Thanh Nguyen, Michael Kleis, and Thomas Schierl:
    An Overlay Open Architecture with QoS Support for Multimedia Streaming,
    International Symposium on Intelligent Multimedia, Video and Speech Processing (ISIMP), Hong Kong, October 2004.
  • Thomas Schierl:
    Adaptives H.264/AVC Internet Streaming,
    Proc. FKTG, 21. Jahrestagung der Fernseh- und Kinotechnischen Gesellschaft, May 2004, in German.

Contributions to Standardization

2005

  • Niko Färber, Thomas Wiegand, and Thomas Schierl:
    Work Item Proposal on Adaptive Streaming,
    TN0015.doc, San Jose, USA, September 2003.

2004

  • Thomas Schierl and Thomas Wiegand:
    Adaptive Streaming Testbed using PSS Rel.6 Features, Tdoc S4-040729,
    3GPP TSG-SA4 33th meeting, Helsinki, Finland, November 2004.
  • Thomas Schierl and Thomas Wiegand:
    H.264/AVC streaming with retransmission and rate adaptation,
    Meeting of 3GPP SA4, Montreal, Canada, Tdoc S4-040287, May 2004.
  • Thomas Schierl and Thomas Wiegand:
    Demonstration of H.264/AVC streaming with retransmission and rate adaptation,
    14th ISMA Forum, Santa Clara, USA, TN00154.doc, May 20042005
  • Niko Färber, Thomas Wiegand, and Thomas Schierl:
    Work Item Proposal on Adaptive Streaming,
    TN0015.doc, San Jose, USA, September 2003.

2004

  • Thomas Schierl and Thomas Wiegand:
    Adaptive Streaming Testbed using PSS Rel.6 Features, Tdoc S4-040729,
    3GPP TSG-SA4 33th meeting, Helsinki, Finland, November 2004.
  • Thomas Schierl and Thomas Wiegand:
    H.264/AVC streaming with retransmission and rate adaptation,
    Meeting of 3GPP SA4, Montreal, Canada, Tdoc S4-040287, May 2004.
  • Thomas Schierl and Thomas Wiegand:
    Demonstration of H.264/AVC streaming with retransmission and rate adaptation,
    14th ISMA Forum, Santa Clara, USA, TN00154.doc, May 2004.

Exhibitions

2004

  • Thomas Wiegand:
    H.264/AVC RTP based HD Streaming,
    National Association of Broadcasters Exhibition (NAB'04), Las Vegas, USA, April 2004.
  • Thomas Wiegand:
    H.246/AVC Video Streaming,
    CeBIT 2004, Hannover, Germany, March 2004.

2003

  • Thomas Wiegand:
    H.264/AVC Video Streaming Over the Internet and Mobile Channels,
    Internationale Funkausstellung (IFA 2003), Berlin, Germany, September 2003.
  • Thomas Wiegand:
    H.264/AVC Video Streaming,
    International Broadcast Convention (IBC'03), Amsterdam, Netherlands, September 2003.