• v5.0
    • Versions
    • master

 

  • Install Akeneo PIM
    • Install Akeneo PIM for development with Docker
    • Install Akeneo PIM manually
      • System Requirements
      • System installation on Debian 10 (Buster)
      • System installation on Ubuntu 18.04 (Bionic Beaver)
      • System installation on Ubuntu 20.04 (Focal Fossa)
      • Installing Akeneo PIM Community Edition (CE)
      • Installing Akeneo PIM Enterprise Edition (EE) with the Archive
      • Setting up the job queue daemon
      • Setting up the Events API
    • How to customize the Dataset
    • How to Add Translation Packs
  • Upgrade Akeneo PIM projects
    • How to apply a patch?
      • How to apply a patch - Community Edition
      • How to apply a patch - Enterprise Edition - Flexibility Cloud offer
      • How to apply a patch - Enterprise Edition - On Premise offer
    • Where is the Changelog?
    • How to upgrade to a minor version?
    • How to upgrade to a major version?
      • Upgrade from 3.2 to 4.0
      • Upgrade from 4.0 to 5.0
  • Import and Export data
    • How import works
    • Understanding the Product Import
    • Understanding the Product Export
    • Formats
      • Localized labels
      • Scopable labels
      • Association types data structure
      • Attribute data structure
      • Category data structure
      • Family data structure
      • Family variant data structure
      • Group data structure
      • Options data structure
      • Product data structure
      • Product model data structure
    • Akeneo Connectors
    • How to Customize Import / Export
      • How to create a new Connector
      • How to import Products from a XML file
      • How to clean a CSV file during a Product import
      • How to automate imports/exports
  • Manipulate the Akeneo PIM data
    • How to Customize Mass Edit Operations
      • How to register a new bulk action
      • How to Register a New Mass Edit Action on Products
    • How to Manipulate Products
      • How to Query Products
      • How to Create Products
      • How to Update Products
      • How to Validate Products
      • How to Save Products
      • How to Remove Products
    • How to Manipulate Non-Product Objects
      • How to Query Non-Product Objects
      • How to Create Non-Product Objects
      • How to Update Non-Product Objects
      • How to Validate Non-Product Objects
      • How to Save Non-Product Objects
      • How to Remove Non-Product Objects
    • How to add a custom action rule
      • General information about rule format
      • How to add a custom action in the rule engine
    • How to Define Access Control List
    • How to Customize the Catalog Structure
      • How to Create a Reference Data
    • How To Customize Teamwork Assistant (Enterprise Edition)
      • Customize notifications
      • Add a calculation step
      • How to log calculation step
      • Remove projects impacted by a custom catalog update
    • How to store assets externally
    • How to Configure Measurement Limits
  • Maintain Akeneo PIM projects
    • First aid kit
    • Bug qualification
    • Common issues
    • Scalability Guide
      • Audit with 3 Representative Catalogs
      • More than 10k attributes?
      • More than 10k families?
      • More than 10k categories?
      • More than 500 attributes usable in the product grids?
      • More than 100k products to export?
      • More than 1GB of product media to export?
    • How to purge history
      • How to Purge jobs executions
      • How to adapt the version purger to your needs
  • Contribute to Akeneo PIM
    • How to report an issue?
    • How to translate the user interface?
    • How to enhance the documentation?
    • How to contribute to a Connector?
    • How to submit a patch to the PIM?
    • How to contribute to the frontend part of the application
    • How behavior tests are architectured in the PIM?
      • Establishing Decorator Pattern
      • Using Spin In Behat
  • Use SSO authentication locally
  • Reference Entities
    • Configure Entity Limits
    • Create a new Reference Entity Attribute type
    • Enrich Records with a new Reference Entity Attribute type
    • Add a Custom Property to Your Custom Attribute Type
    • Refresh records completeness
  • Troubleshooting guide
  • Technical overview
    • Product Information
    • Teamwork Assistant (Enterprise Edition)
      • Project creation
      • Project completeness
      • Project Completeness widget
      • Catalog update impact
      • Scalability guide
      • Users permission summary for Behat tests
    • Collaborative workflow
      • Simple workflow
      • Partial workflow
  • Technical architecture
    • Best Practices
      • Create a project
      • Create a reusable bundle
      • Code Conventions
      • Coding Standards
    • How to implement your business logic using the event system
    • Events
      • Storage events
      • Workflow events (Enterprise Edition only)
    • How to Localize your data
      • How to change the PIM locale
      • How to Use Localizers
      • How to use Presenters
    • How to Add a Notification
    • Performances Guide
      • Memory usage of rules execution (Enterprise Edition)
      • Memory leak fix in Rules Engine (ORM)
      • More than 100 WYSIWYG editors in a page
      • PHP7 and HHVM Compatibility?
      • Job product batch size
    • How to Use the Web REST API
    • Standard format
      • Products
      • Other entities
      • Usage
    • Application Technical Information
      • Application Technical Dependencies
      • Server side set up for hosting
      • System Requirements
      • Recommended configuration
      • Client side configuration and compatibilities
      • Operation processes
      • Flow Matrix
  • Akeneo Cloud Edition
    • Flexibility
      • Environment accesses
      • System Administration & Services Management
      • Periodic tasks & Crontab configuration
      • Composer settings
      • Queue Management & Workers
      • Disk Usage Management
    • Serenity
  • Akeneo Onboarder
    • Prerequisites
    • How to install the Onboarder bundle
    • Synchronization
    • How to update a minor version or to apply a patch
      • How to update the Onboarder bundle - Enterprise Edition - Flexibility Cloud offer
      • How to update the Onboarder bundle - Enterprise Edition - On Premise offer
    • How to upgrade to a major version
    • Troubleshooting
    • How to uninstall the Onboarder bundle
    • Environment variables
      • Using the DotEnv file
      • Using environment variables

Queue Management & Workers¶

Job consumers¶

Processes¶

Akeneo PIM uses daemons to execute jobs (i.e: imports, exports, etc.) from a queue.

Job daemons are managed by systemd which allows multiple operations such as:

  • start/stop/restart a daemon,

  • enable/disable a daemon,

  • check the status/see logs of a daemon.

Warning

Please note that, while the number of running job consumers is not enforced, it is not recommended to increase it above the server capability. Between 1 and 3 consumers is recommended.

To see how and which commands are available, please refer to Privilege escalation

Configuration¶

Configurations of daemons are stored under /home/akeneo/.systemd/pim_job_queue. The name of the file is the daemon identifier. Make it simple and use only integer numbers.

As of PIM 3.1, each daemon can be dedicated to run certain job(s), hence making sure the jobs will be executed in a timely manner, and that their execution will not interfere with other business operations.

Daemons files can be configured for 3 behaviors:

  • Handle all jobs: (Default) Keep the configuration file empty,

  • Specific jobs: (Whitelist) Write their names (One per line) in the configuration file,

  • Exclude jobs: (Blacklist) Write their names (One per line), preceded by a ! (exclamation mark) in the configuration file.

Once their configuration files are created, you can manipulate these daemons through our tool called partners_systemctl as you would do with systemctl.

Examples¶

  • Create a new daemon which handles all type of jobs:
    1# Create a file for the new daemon and keep it empty to handle all jobs
    2touch /home/akeneo/.systemd/pim_job_queue/3.conf
    3
    4# Start the worker with its name (configuration filename without extension)
    5partners_systemctl pim_job_queue@3 start
    6
    7# Enable the worker to be started automatically at instance boot up
    8partners_systemctl pim_job_queue@3 enable
    
  • Create a new daemon which handles specific jobs:
     1# Create a file with specific jobs
     2echo -e "csv_product_export\ncsv_category_export\ncsv_family_export" > /home/akeneo/.systemd/pim_job_queue/4.conf
     3
     4cat /home/akeneo/.systemd/pim_job_queue/4.conf
     5csv_product_export
     6csv_category_export
     7csv_family_export
     8
     9# Start the worker with its name (configuration filename without extension)
    10partners_systemctl pim_job_queue@4 start
    11
    12# Enable the worker to be started automatically at instance boot up
    13partners_systemctl pim_job_queue@4 enable
    
  • Create a new daemon which excludes specific jobs:
     1# Create a file with specific jobs
     2echo -e "!csv_product_export\n!csv_category_export" > /home/akeneo/.systemd/pim_job_queue/5.conf
     3
     4cat /home/akeneo/.systemd/pim_job_queue/5.conf
     5!csv_product_export
     6!csv_category_export
     7
     8# Start the worker with its name (configuration filename without extension)
     9partners_systemctl pim_job_queue@5 start
    10
    11# Enable the worker to be started automatically at instance boot up
    12partners_systemctl pim_job_queue@5 enable
    
  • Remove an existing daemon (not possible on Akeneo default ones):
    1# Stop the worker with its name (configuration filename without extension)
    2partners_systemctl pim_job_queue@7 stop
    3
    4# Disable the worker not to be started automatically at instance boot up
    5partners_systemctl pim_job_queue@7 disable
    6
    7# Delete its configuration file
    8rm /home/akeneo/.systemd/pim_job_queue/7.conf
    
  • Manage all daemons at once:
    1# Check the status of all daemons
    2partners_systemctl pim_job_queue@* status
    3
    4# Restart all daemons
    5partners_systemctl pim_job_queue@* restart
    

Onboarder¶

While Onboarder requires workers to run at all times, those are disabled by default since some customers do not use Onboarder.

Learn more about Onboarder and its configuration in the PIM in the dedicated section Akeneo Onboarder.

Examples¶

Similarly to PIM job consumers, here is how you can manipulate Onboarder daemons:

 1# Start the worker
 2partners_systemctl pim_onboarder_worker@1 start
 3
 4# Enable worker #1 to be started at instance boot
 5partners_systemctl pim_onboarder_worker@1 enable
 6
 7# Check the status of the daemon #1
 8partners_systemctl pim_onboarder_worker@1 status
 9
10# Stop daemon #1
11partners_systemctl pim_onboarder_worker@1 stop

Found a typo or a hole in the documentation and feel like contributing?
Join us on Github!