iwla Commit Details

Date:

2017-05-07 16:56:12 (6 years 6 months ago)

Author:

Grégory Soutadé

Branch:

dev, master

Commit:

d08085faf0cb566190e52362ba28a9f81c6925a9

Parents:

3ce35b7b47482c4796af92f22ee540045eb9bf21

Message:

Don't save all robots requests (only first pass is kept) which allow to save a large amount of memory/disk space

Changes:

M	iwla.py (1 diff)

File differences

-310
311 311
312 312
313 
313
314
315
314 316
315 317
316 318
+            self._createVisitor(hit)␊
␉␊
        super_hit = self.current_analysis['visits'][remote_addr]␊
        super_hit['requests'].append(hit)␊
        # Don't keep all requests for robots␊
        if not super_hit['robot']:␊
            super_hit['requests'].append(hit)␊
        super_hit['bandwidth'] += int(hit['body_bytes_sent'])␊
        super_hit['last_access'] = self.meta_infos['last_time']␊
␊
             self._createVisitor(hit)␊
 ␉␊
         super_hit = self.current_analysis['visits'][remote_addr]␊
-        super_hit['requests'].append(hit)␊
+        # Don't keep all requests for robots␊
+        if not super_hit['robot']:␊
+            super_hit['requests'].append(hit)␊
         super_hit['bandwidth'] += int(hit['body_bytes_sent'])␊
         super_hit['last_access'] = self.meta_infos['last_time']␊
 ␊