Announcement- jigg R1 - Look Ahead Mezzianne with Transfer Encoding

Announcement- jigg R1 - Look Ahead Mezzianne with Transfer Encoding

Post by Jason Nun » Mon, 31 Mar 2003 07:36:49



Announcement-

jigg - Look Ahead Mezzianne with Transfer Encoding

Arafura Connect, Darwin, NT, Australia
-----------------------------------------------------------------------------

jigg is a concept that implements nice features that squid should
implement but doesn't.... and perhaps never will.

jigg runs on the same machine a web cache does (squid). Users configure
their web browsers to point to jigg.

/-------------\???????????????????? /------------------\
? web browser?? <----------------->?? jigg <---> squid
\-------------/???????????????????? \------------------/
users machine????????????????????????? web cache server

jigg will compress HTTP responses where it can, and when it sees a
TEXT/HTML response, it will look for any IMG SRC links and tell the web
cache to go get them (this is called "looking ahead")... so that by the
time the client browser requests those links, the web cache will already
have them. It will request the most occurring links first.

My boss asked me to code a C program from a perl concept (zipproxy.pl -
by Randal L. Schwartz).? My job was to implement "Transfer encoding"
plus the additional feature of "look aheads"-- to precache links ahead
of the client requesting them. The idea is to speed dialup users web
request/responses.

jigg is an experimental concept (but hopefully a useful working
utility). I've developed jigg to the point now where I can say, "yeah
the concept works" and go to my boss and give him my result.

Arafura Connect may not be round of much longer, so for now, I'm just
going to bzip it up and make it available on my homepage (for however
long that remains). I encourage anyone with web cache server to grab it
and have a look at it. Tell me what you think and if it's worth
pursuing.

If Arafura Connect is still around, I'll perhaps develop it further,...
if not, then I guess it's on to other wonders ;).

Available at-

jigg page: http://jsno.arafuraconnect.com.au/proj_ac/jigg.html

--
Jason Nunn- Electronics Technician, Systems Programmer, Network Specialist
Arafura Connect & Arafura Internet Services - 1300 137 363

Personal: http://jsno.arafuraconnect.com.au

##########################################################################

# PLEASE remember a short description of the software and the LOCATION.  #
# This group is archived at http://stump.algebra.com/~cola/              #
##########################################################################

 
 
 

1. Transfer-Encoding: chuunked AND Content-Encoding: deflate

using zlib
http://www.cdrom.com/pub/infozip/zlib/
and
http://www.winimage.com/zLibDll/

with HTTP/1.1
http://sunsite.auc.dk/RFC/rfc/rfc2616.html

I am attempting to send
Transfer-Encoding: chunked
Content-Encoding: deflate

(from a home-built web server)

to a client browser that has indicated its willingness to accept this:
HTTP HEADER FOLLOWS:
GET / HTTP/1.1
Accept: image/gif, image/x-xbitmap, image/jpeg, image/pjpeg, application/vnd.ms-excel, application/msword, application/vnd.ms-powerpoint, */*
Accept-Language: en,en-ca;q=0.9,de;q=0.8,fr;q=0.7,it;q=0.6,es;q=0.4,da;q=0.3,he;q=0.2,yi;q=0.1
Accept-Encoding: gzip, deflate
User-Agent: Mozilla/4.0 (compatible; MSIE 5.0; Windows 95; DigExt)
Host: 127.0.0.1
Connection: Keep-Alive

Ive RFC'd myself and tested the component peices individually . successfully.
my interpretation of the RFC leads me to format my HTTP response as:

Headers
chunksize n
deflatedData
chunksize n
deflatedData
chunksize 0

where n is the size of the deflated data

I am applying this deflation to arbitrary mime types and
maintaining the original mime-type.

if i had a website to look at that DOES do this successfully
I could compare  the output to see what I am doing wrong.. or indeed if
my browser is not handling it properly.

Does my interpretation of the RFC as to the format of the chunked and compressed
output seem correct?

Thanks in advance..
-db-

2. Mkfs (Mac68k) last version

3. chunked Transfer-Encoding forbidden: /cgi-bin/echo.pl

4. writing a sh script

5. examples of Transfer-Encoding: chunked

6. pppoa on adsl

7. Apache 1.2.x and Transfer-Encoding

8. WP 5.1 printing problems

9. transfer-encoding??

10. write cache and read look-ahead in ffs

11. Looking for X-fonts for Cyrillic Windows-1251 encoding

12. Looking for command line automated ripping/encoding for MP3's

13. Looking for video encoding apps or apis