Celery Tasks

ConsoleMe uses Celery to run tasks on schedule or on demand. Celery consists of one scheduler, and number of workers.

ConsoleMe's celery tasks perform the following functions:

Task Name	Description	Frequency
cache_iam_resources_across_accounts	Retrieves a list of your AWS accounts. In your primary region, this task will invoke a celery task ( cache_iam_resources_for_account ) for each account. In other regions, ConsoleMe will attempt to retreive this information from yourconsoleme_iamroles_global global DynamoDB table to sync roles.	Every 45 minutes
cache_iam_resources_for_account	Retrieves and caches a list of IAM principals and policies for the current account. Stores data in DynamoDB, Redis, and (optionally) S3.	On demand
clear_old_redis_iam_cache	Deletes IAM roles that haven't been updated in the last 6 hours.	Every 6 hours
cache_policies_table_details	Generates and caches the data needed to render the Policies Table.	Every 30 minutes
report_celery_last_success_metrics	Reports metrics on when a celery task was last successful. These metrics are useful for alerting, and verifying the health of your ConsoleMe deployment.	Every minute
cache_managed_policies _across_accounts	Retrieves a list of your AWS accounts and invokes a celery task ( cache_managed_policies_for_account ) for each account.	Every 45 minutes
cache_managed_policies _for_account	Caches a list of IAM managed policies for the requested account. Used for the managed policy typeahead in the IAM policy editor.	On demand
cache_s3_buckets_across_accounts	Retrieves a list of your AWS accounts and invokes a celery task ( cache_s3_buckets_for_account ) for each account.	Every 45 minutes
cache_s3_buckets_for_account	Caches a list of S3 buckets for the requested account.	On demand
cache_sqs_queues_across_accounts	Retrieves a list of your AWS accounts and invokes a celery task ( cache_sqs_queues_for_account ) for each account.	Every 45 minutes
cache_sqs_queues_for_accounts	Caches a list of SQS queues for the requested account.	On demand
cache_sns_topics_across_accounts	Retrieves a list of your AWS accounts and invokes a celery task ( cache_sns_topics_for_account ) for each account.	Every 45 minutes
cache_sns_topics_for_account	Caches a list of SNS topics for the requested account.	On demand
get_iam_role_limit	Generates a ratio of IAM roles to max IAM roles for each of our accounts, and emits this as a metric that you can alert on.	Every 24 hours
cache_cloudtrail_errors_by_arn	Uses your internal logic to generate a mapping of recent cloudtrail errors by ARN. This is shown on the policy editor page to your end-users.	Every 1 hour
cache_resources_from_ aws_config_across_accounts	Retrieves a list of your AWS accounts and invokes a celery task ( cache_resources_from_aws_config_for_account ) for each account.	Every 1 Hour
cache_policy_requests	Caches all of your policy requests from DynamoDB to Redis. Used by the /requests endpoint.	Every 1 Hour
cache_cloud_account_mapping	Retrieves and caches details about your AWS accounts. Retrieval depends on configuration.	Every 1 Hour
cache_credential_authorization _mapping	Generates and caches a mapping of groups/users to IAM roles. This is used to determine authorization for role credentials.	Every 5 minutes