Bugfender has the capability of uploading your logs to an Amazon S3 bucket so that you can perform your own data analysis.
How does it work?
Bugfender uploads a file every day, named in the format of YYYY-MM-DD.csv.gz. Days are split at midnight GMT.
The file format is the same as the CSV download you can get when you download logs from multiple devices from the Bugfender dashboard.
The time of the file upload is variable: you can use a S3 notification to know when a file has been uploaded.
Please note a file might contain logs from previous days, if they were generated in the past but received after midnight.
The file is compressed in gzip format to save space and download time.
How much does it cost?
This feature is included in our Pro and Premium plans (also in the legacy Business plan). Please bear in mind that Amazon might charge for the usage of the S3 service.
How to set it up?
Log in to Amazon Web Services console
First of all let's create a bucket. Go to S3, press Create Bucket and give your bucket a name:
Then we will set up the permissions. Go to IAM > Policies > Create policy, then select Create Your Own Policy, call it s3-bugfender-logs (or whatever you like) and copy and paste the following code, replace <bucket-name> with the name you just chose for your bucket in the previous step:
It will look something like this:
Then go to Users > Add user and call it bugfender (or whatever you like), tick Programatic access:
Then select Attach existing policies directly and tick the policy we just created (s3-bugfender-logs).
Then click next, review the results and download the resulting credentials:
Once AWS is set up, go to your Bugfender Dashboard, in the application Settings tab, enter the details in the integration configuration:
Bugfender respects the default encryption setting for the S3 bucket. If you want your logs encrypted, you can configure encryption in your bucket.
If you don't want to keep your logs forever, you can set up a lifecycle rule to expire logs after some time.
Bugfender uploads files using the Standard storage class. You can use lifecycle rules to transition files to a different storage class.
Per-session format (deprecated, no longer available):
Bugfender uploads the logs in batches, every day around midnight (GMT). Days are split at midnight GMT.
One folder is created for every day in the format of YYYY-MM-DD.
Each folder contains a set of files, each file representing a session, with the naming format deviceId_sessionId.log.
All sessions that have been changed during that day are uploaded. If a session spans across several days it will be uploaded every day until it finishes. Each time the file will contain the full session (not only the logs of that day).
See also: What does a session actually represent?