Skip to main content

Event Driven (Instant)

Set up S3 event notifications via SQS for near-instant log ingestion. When you upload a file to S3, Chipper is notified immediately and processes it within seconds.

Prerequisites​

Before configuring push notifications, make sure you've completed:

Configure S3 Event Notifications​

2.1 Open S3 Bucket Properties​

  1. Go to S3 Console
  2. Click on your bucket
  3. Go to Properties tab
  4. Scroll to Event notifications

2.2 Create Event Notification​

  1. Click "Create event notification"
  2. Event name: Enter a name, e.g., chipper-new-files
  3. Prefix (optional): Folder path to monitor
    • Example: logs/production/
    • Leave empty to monitor entire bucket
  4. Suffix (optional): File extension filter
    • Example: .log to only notify on .log files
    • Leave empty to notify on all files

2.3 Select Event Types​

Check "All object create events" or select specific events:

  • ✅ s3:ObjectCreated:Put
  • ✅ s3:ObjectCreated:Post
  • ✅ s3:ObjectCreated:Copy
  • ✅ s3:ObjectCreated:CompleteMultipartUpload

2.4 Set Destination​

  1. Destination: Select SQS queue

  2. Enter SQS queue ARN based on your bucket's region:

    RegionRegion CodeSQS Queue ARN
    US East (N. Virginia)us-east-1arn:aws:sqs:us-east-1:715354373868:log-ingestion
    US East (Ohio)us-east-2arn:aws:sqs:us-east-2:715354373868:log-ingestion
    US West (Oregon)us-west-2arn:aws:sqs:us-west-2:715354373868:log-ingestion
    EU (Ireland)eu-west-1arn:aws:sqs:eu-west-1:715354373868:log-ingestion
    Asia Pacific (Tokyo)ap-northeast-1arn:aws:sqs:ap-northeast-1:715354373868:log-ingestion
    tip

    Important: Use the queue in the same region as your S3 bucket. S3 event notifications can only send to SQS queues in the same region.

    If your bucket is in a different region, contact support@chipperbot.com to add support for that region.

  3. Click Save changes

Chipper will take care of the rest automatically.

Next Steps​

  • ✅ Monitor ingestion: Check Recent Ingestions for real-time status
  • ✅ View dashboards: See your logs in Dashboards
  • ✅ Create alerts: Set up alerts based on log patterns
  • ✅ Tune filtering: Adjust S3 event prefix/suffix for better targeting